Feeds:
Posts
Comments

Archive for the ‘m4D’ Category

AnthropologyThere’s a popular saying amongst the tech and development crowd that 10% of an ICT4D initiative is the tech and the rest is…. well, the rest. I’ve recently heard a modified version that says 5% is the idea and 10% is the business model, and the other 85% is…. well, the rest. The ‘rest’ is mostly made up of people, culture, context and the stuff of anthropologists.

At the Slush conference in Helsinki in November, I joined a short ‘Fireside Chat’ with Tanya Accone (UNICEF) and Mika Valitalo (Plan Finland) about the importance of that other 85-90%, which Tanya referred to as ‘peopleware’.

Tanya kicked off the panel by asking people to think about how much time they’d dedicated to the technology of their start-up idea or their tech solution – the hardware and the software – and to then ask themselves how much time they’d spent on the people component. “People are what will make or break your idea,” she said. When it comes to mobile adoption, for example, we are seeing an exponential adoption pattern all over the world, and people are driving that. “I bet every single one of you at SLUSH hopes to see that curve in your future.”

She went on to note that conventional wisdom is that ‘content is king,’ however a key takeaway from her work in the mobile and social entrepreneurship space is that content been deposed by context. For example, when working with the U-Report project in Liberia, lessons from other countries where it had been rolled out were incorporated, but they had to be contextualized to make them work in Liberia. This involved talking and working directly with youth to ensure that the programming could be adapted properly.

Screen Shot 2014-11-29 at 4.34.47 PMMika agreed that ‘peopleware’ is a critical consideration. “I’ve witnessed this 10:90% ratio several times when co-designing and supporting projects using technology for social impact in African countries,” he said, and told the story of working on enhancing birth registration in Kenya, where the slow and manual flow of information between people and the government seemed to be a key challenge that could be tackled with use of mobiles and computers and applications.

“However, the deeper we dug the more varied the challenges seemed to be. We realized that people might be reluctant to register children when local practices were not in sync with the existing legislation. For example, if men are marrying girls under the age of 18, they might not like the idea of birth registration as it would prove a girl’s age. People living near the Kenya-Tanzania border might not want to be identified as being from one or the other country, because being unregistered may allow them to move back and forth across the border more easily and receive some type of benefit or commerce opportunity.

Even with a functioning mobile phone and app in their hand, people will weigh multiple aspects based on their personal situation before taking action. So, spending enough time with end-users and trying to see the world through their eyes as much as possible is crucial, especially when working in places that are not familiar to you. This may sound self-evident, but I’d encourage everyone keep this top on the list.”

Screen Shot 2014-11-29 at 4.28.39 PMI shared two of the key points from the Technology Salon earlier in the week on the topic of start-ups and social impact: a) the importance of partnership and collaboration (eg, people), and b) knowing the local context — not just the technical landscape, but people and culture.

These two aspects were really highlighted for me when I was working on a project in Cameroon that trained youth to use mobile phones to make short videos that they used to organize and advocate for change in their communities and more broadly. The donor was a large mobile phone manufacturer who assumed youth would use their higher-end phones to create the videos. The youth, however, were much more familiar with simple phones like the Nokia 1100. The phones we purchased in order to get good video quality had too many layers and folders and features. So we ended up getting some Flip cameras, because what we really needed was a push and shoot video camera, and this design was a better fit for low-income rural youth who had limited experience with technology.

We also realized that though the training was set up for youth, community adults were really interested in learning to make videos too. So we had to find ways to engage them so that they would not feel left out and so that we could ensure their continued support for the youth’s efforts. This meant we had to spread our resources out a little further than we had imagined, but we saw it as necessary. In all these processes we had to balance the context and reality on the ground, the expectations of the youth and community, expectations of our local partners, and those of the donor.

Tanya added that achieving success with social impact sometimes means rethinking your business model, because you’re in pursuit of the double dividend of financial return and social impact. She gave an example in Burundi where only 3% of the population has access to the electricity grid. “You would think it’s a market ripe for alternative energy solutions. But many businesses avoided it because their existing retail and distribution models simply would not work in that context. It took deconstructing and reconstructing business models to create something that does work — a network of microfinanced microfranchises operated by village-level entrepreneurs.” Now the families use robust, fast-charging LED lights recharged through a pedal-powered generator, a system that also recharges mobile phones. 

Another aspect is understanding the value proposition, she said. It would seem to be basic business, but all too often well-intended initiatives forget this and rush in with a cheaply-made solution. “In the process, they trample over the basic human dignity of their target consumer or beneficiary.” She suggested keeping in mind that people with limited resources are among the most discerning consumers because they don’t have disposable income. They are cost conscious, and equally, they are looking at value for money and return on investment in the durability, feature sets and total cost of ownership of everything they buy and value. This means that more energy-efficient chips, better battery technology, and robust handsets are important to economically challenged users.

Tanya also noted that ‘base of the pyramid’ users are no less style-conscious or aspirational than consumers in general, so “don’t disrespect them by skimping on the design and delivery of your solution. And like you and me, consumers in marginalized communities seek enjoyment and entertainment and fun too. Music has huge pull and potential… and don’t forget that pay-as-you-go comes with data!”

Screen Shot 2014-11-29 at 4.29.41 PMMika shared an example where the technology that was introduced carried almost too much power with it. In this project, a mobile phone was loaded with videos and connected to a portable projector. Daycare workers and parents were able to watch good childcare practices from model early childhood care and development centers. “What we found out was that using new technology not seen before sometimes amplified the message so much that caregivers wanted to discard what they already knew and replace it with what they saw on the screen from the model daycare centers.” Though the project showed the power of tech, unintended consequences may come up at the intersection of software, hardware and ‘peopleware’.

Mika talked about another project in Uganda that supported parents’ involvement into school activities. Plan realized that men were more willing to come to parent-teacher meetings once they introduced a mobile SMS service through which they sent invitations. The technology lowered the threshold for men to participate in issues they might have previously considered ‘women’s issues’. These subtle dynamics in the local context can have a big influence on how an innovation works, he noted.

Mika’s takeaways for startups and innovators were that civil society organizations might offer good synergy for co-designing, testing out and distributing products and services. “I’ve seen startups getting needs and ideas from the ground through NGOs, and then innovating products and services together. For example we produced a start-up mobile data gathering tool called Poimapper based on the needs coming from our frontline staff. We did on the ground pilots and product development in Kenya with actual end users who gave crucial feedback to make the service work well. Peopleware matters and partnering with NGOs can help startups to get it right,” he said.  “INGOs often have a wide presence around the world, and they are on the ground in communities and the surrounding society. They know quite a lot about peopleware, participatory methods, and community engagement. Then again, they don’t necessary have the same agility and fast innovation processes combined with new business models that startups are often good at.  So, my advice to NGOs is to go and meet startups and visa versa.”

I added that it’s important to understand who has access to and control of devices, and to ensure that a product or service is valuable to people in the long-term. So first — Who owns the phone? Who controls it? Often the story is that everyone has a phone but you may find that some people own 2 phones, some don’t have any. You may find that the people you least expect to have phones have them or can access them, and those you’d think would have a phone don’t. This is critical especially when working with girls and women who typically have lower access and control – and of course you should be sure the project is including girls and women!

Screen Shot 2014-11-29 at 4.31.42 PMAlso, you may be working with people who have very little disposable cash – but if your application or idea saves time and money and meets a real need, they may be willing to move their resources from one thing to another. For example, using solar for light and charging up phones can save money and time as well as eliminate the health risks of kerosene lamps. However, you need to make sure that what you offer is a long-term and sustainable change. When people have limited resources, they’ll be hesitant to invest in something new if they are not assured that it will be available, sustainable and cheaper in the long term.

Lastly, as Mika said, partnering with non-profits can offer start-ups a way to reach communities, because some non-profits are quite well-known and respected by the community (though of course, some are not too!). But ethical non-profits will not risk their reputations on ideas that they do not believe in, that are unconvincing, or that seem to take advantage of the poor. Start-ups will need to have clear ideas and evidence that a proposition is solid, because most non-profits have a low tolerance for risk and failure and (one hopes) a higher ethical standard than a basic money-making operation.

Tanya closed us out by summing up the key points:

  1. People are your critical success factor. “People” include your end-user as well as those that you may be partnering with.
  2. Context is king! Understand the social dynamics, know who owns and controls the device, know what people spend money on.
  3. Build a better business model.
  4. Understand the value proposition — Figure out how your application/tool/innovation can help save precious $ and time.
  5. Understand your partners — Remember that brand and reputation are very important to non-profits, and they don’t like risk.

Thanks to Tanya and Mika for co-collaboration on the Fireside Chat and this blog post!

Read Full Post »

IMG_5689Technology Salon Helsinki kicked off as part of Slush, a fantastic start-up and technology event that takes place with about 10,000 people every Fall in the Finnish capital. Slush added a social impact stream for the first time this year, making it a good fit for Technology Salon. Plan Finland organized the Salon and Netlight hosted.

Our topic for this Salon was broad – how can technology increase social impact? – but lead discussants (Jussi Hinkkanen of Fuzu, René Parker from rLabs, and Mika Valitalo of Plan Finland) brought inspiring personal stories, fundamental questions, practical experiences, challenges and questions that made for an intimate and lively conversation that incorporated expertise from everyone in the room.

The discussion raised a number of key points for social impact start-ups and those working in the development space:

1. Making a direct contribution to social impact is a prime motivator. Most people in the room who considered themselves to be entrepreneurs or who felt they were working with a ‘start-up’ or ‘social innovation’ mentality had tried different pathways before landing on their current one, yet had found them unsatisfying due to bureaucracy, lack of agility, unsustainable efforts, systems not based on merit, and feelings of not being able to input into or control decisions. “Do I want a job where I’m comfortable, well-paid and getting accolades for the supposed social good I’m doing, but where I know I’m not having any real impact, or do I want to be somewhere that I’m paid less but I’m actually doing something worthwhile?” summed up one participant.

2. It’s not clear how to best achieve social impact at scale. There was some disagreement in the room regarding whether it was better to work outside of the system to avoid the above-noted problems with corporate social responsibility efforts, governments, multi-laterals and international development agencies, or whether it was imperative to work with those institutions in order to achieve longer-lasting impact at scale. Questions were also raised about what is meant by scale. If we help communities to demand better government services through some kind of innovative approach, that can also lead to a scaled impact and more resources and social good coming into a community, even though the scaled impact is not so directly attributable. The big question is how to achieve scale yet remain locally relevant and contextually sensitive.

3. Keeping a social impact focus is a challenge. It’s critical to think about both social impact and sustainability from the very beginning, participants agreed. A social impact start-up, like any business, needs to pay salaries and other costs, so it needs a good business model that brings in enough revenue. “If you do not show revenue and growth, you will drive off investors,” said others, “and then your start-up won’t grow.” Yet those in the lowest income bracket will not have the highest capacity to pay for services, and donors often have policies prohibiting them from funding profit-building entities, even if they start off as non-profits. Ensuring that investors have a social impact motivation so that the mission of the start-up does not skew as it grows can also be a challenge. This area is being somewhat addressed by ‘social impact investing’ however, “as a start-up entrepreneur,” said one participant, “you know that next phase investors don’t like it if you have an impact investor already on board, so that makes it difficult to get further funding.” This all poses real challenges for start-ups.

4. Social good is in the eye of the beholder. Everyone will say that their company is values-based and that it’s ‘doing good’ but who decides on and judges the social function of a company? “Maybe one way is to see if it motivates Generation Y,” said one participant. Another pointed out that one company might be doing something that is perceived as ‘socially good’, but it might have a very small impact. Whereas another company might be doing something not perceived as ‘socially good’ (say, selling clothing) yet it has embedded strong values, good business ethics, pays workers well with good benefits, doesn’t pollute the environment and contributes to local economic growth in a large way. People won’t think of the second company as doing social good even if its social impact is greater than the first company. The idea of social impact is largely in the mind of the beholder, concluded one person, it’s in the psyche.

5. Staying true to social impact values in the long-term is difficult. As one discussant noted, keeping the social impact mindset requires constant consideration as to whether you are doing good with and for your employees, but you also need to ask the community that you are serving what they think. “It’s easy to say you are doing social good, but if you go directly to ask people in the community whether your initiative is doing what it says and if it’s having a good impact, you’ll see it’s not easy. When an investor comes along who wants to change things, you always have to go back to look at who you are, how you started, how a particular change will impact the organization, and how it will impact on the thousands of people who rely on you.”

6. A sustainable business model helps bring autonomy according to one discussant. A start-up can remain agile and make its own decisions if there are no donors or external funders. Having its own sustainable revenue stream will allow it to stay true to its vision and to community needs, or at least provide enough to cover staff and operations costs. However, partnership and collaboration are key. “You have to work with other people whether you like it or not. If you are working as a social impact start-up, you’ll need to partner with those already working in the community, and work with everyone to bring in their part. Just because there is a community out there somewhere, you can’t assume that they don’t know what is happening or that they don’t know anything. You need to partner with these local groups and work with the existing community context and structures.”

7. An innovative business model trumps innovative technology. Many of the places where non-profits are working and where people may think about ‘social good’ start-ups are those where the market doesn’t work and people have very few resources. Yet these are the very people we want to support the most in terms of social impact, said one discussant, so how can we do it? Targeting solutions and payment for different parts of the markets might be one way, for example, offering a solution to the segment of the market that can pay and in that way extending the services to those who cannot pay. “The most innovative thing here is the business model, not the technological solution,” advised another person. “And if you really listen to people and you build according to people’s needs, you may uncover needs as well as new markets and business models.” Your services will need to keep evolving over time, however, as people’s needs and the context changes. “You need to go there and spend time with people in order to deeply understand their needs, their contexts and their behaviors.”

8. People won’t think like you think. Another participant quoted activists in the disability movement “Nothing about us without us,” saying that start-ups should follow that mantra also. All the really bad examples of NGO, government, development or corporate failures have been when people are looking top-down or outside-in, she said. “When you think ‘since those people are poor, they have nothing, they will really want this thing I’m going to give them,’ you will fail,” she added. “People everywhere already have values, knowledge, relationships, things that they themselves value. This all impacts on what they want and what they are willing to receive. The biggest mistake is assuming that you know what is best, and thinking ‘these people would think like me if I were them.’ That is never the case.”

9. There is space for various approaches. You won’t want one single product or service to monopolize, said one person. “There are roles and limitations for different entities in any community. There are some non-income generating things that can and need to happen, and that is actually fine. It used to be a charity and welfare mentality, but now we think markets will solve everything. Neither extreme is correct. We need to have space for various partners and efforts.” At the same time, there needs to be space for different partners at different stages in time. It is important for the various partners to understand what their role is. Emergency support is good in an immediate post-conflict stage, for example, but then humanitarian organizations need to step aside and open space for other actors when a community or country moves to a more stable development and growth period.

10. It’s difficult to find investors for social impact in ‘the South.’ The perceived risk in investing in start-ups that want to ‘go South’ or start-ups already based in ‘the South’ makes it hard to find investors. “Finnish investors are myopic,” said one person. “Finland has already provided examples of how companies can access these new opportunities and also have a social impact. Spending power has skyrocketed in some countries. If investors looked properly, they would see the potential of making more money in some of these vast markets than they can in Europe or Finland,” noted another person. The risk is indeed greater due to various elements in some of these countries, added one person. “It’s like courtship – you can’t go after people who are not in your league or not right for you. But if you find the right investor who understands the risk as well as the significant potential returns, it can be a great marriage.”

11. NGOs and start-ups can be great partners. They can come up with ideas from scratch, or they can partner later in the process. NGOs can take advantage of start-up applications and services, whereas the start-ups can find new customers, build a portfolio, do field-testing and get feedback on what to improve with their idea. In addition the two have a lot to teach each other, said one discussant. “NGOs can learn a lot from start-ups about how to operate. They should be learning how to think about iterative improvements, pivoting and changing quickly, failing fast and learning fast.” Start-ups can also learn from NGOs. “Some NGOs are quite good at participatory practices, knowing the community well, collaborating at multiple levels with various stakeholders, communities and governments.” In addition, community-based organizations know the community very well and often work together well with start-ups and NGOs.

12. Pacing and timing can make collaboration tricky. The pacing in these different organizations and partners is quite different, however, and that causes friction and frustration. But even large multi-lateral agencies can be helpful for start-ups who want to gain entry into different countries or communities because they are well-known and because they can provide an ethical and legal framework that helps protect the start-up from making big mistakes due to a lack of understanding of these key elements. NGOs can also serve as a kind of infrastructure upon which to build start-up efforts. Lack of NGO and donor agility however sometimes causes efforts to fail. Hybrid models of funding that can enable start-up-NGO collaboration are needed. One discussant emphasized the importance for start-ups to generate their own funding on the one hand while seeking donor funds for some things too, but never doing anything for a donor that is not part of the organizations core mission.

13. You need to lose the ego. In every sector, egos and brands get in the way of social impact. Start-up founders have egos too, and the start-up personality may often be one that wants the spotlight, or in order to obtain funding the start-up may need to act in a particular way, and this can be detrimental. “For social impact work, we need to think about catalyzing something, not being the center of it. We need to help bring snowballs to the top of the hills, and then let them roll down on their own without branding,” recommended one participant. “We hear that 60% of mHealth initiatives die before they thrive. They are isolated, with little connection and interface with one another. We need more platforms and sharing, less egos and brands.”

IMG_5690Next Technology Salon Helsinki. Plan Finland is hoping to continue convening in Helsinki. If you are interested, sign up to get invitations at Technology Salon!

I’d also recommend attending Slush next year – especially if you like high energy, high-tech, Helsinki and lasers! I’m sure next year’s impact stream will be as good or even better than this year.

Thanks again to Plan for convening and sponsoring the first Salon, to Slush for including it as part of their Social Impact Stream, and to Netlight for hosting at their beautiful offices!

Read Full Post »

Today as we jump into the M&E Tech conference in DC (we’ll also have a Deep Dive on the same topic in NYC next week), I’m excited to share a report I’ve been working on for the past year or so with Michael Bamberger: Emerging Opportunities in a Tech-Enabled World.

The past few years have seen dramatic advances in the use of hand-held devices (phones and tablets) for program monitoring and for survey data collection. Progress has been slower with respect to the application of ICT-enabled devices for program evaluation, but this is clearly the next frontier.

In the paper, we review how ICT-enabled technologies are already being applied in program monitoring and in survey research. We also review areas where ICTs are starting to be applied in program evaluation and identify new areas in which new technologies can potentially be applied. The technologies discussed include hand-held devices for quantitative and qualitative data collection and analysis, data quality control, GPS and mapping devices, environmental monitoring, satellite imaging and big data.

While the technological advances and the rapidly falling costs of data collection and analysis are opening up exciting new opportunities for monitoring and evaluation, the paper also cautions that more attention should be paid to basic quality control questions that evaluators normally ask about representativity of data and selection bias, data quality and construct validity. The ability to use techniques such as crowd sourcing to generate information and feedback from tens of thousands of respondents has so fascinated researchers that concerns about the representativity or quality of the responses have received less attention than is the case with conventional instruments for data collection and analysis.

Some of the challenges include the potential for: selectivity bias and sample design, M&E processes being driven by the requirements of the technology and over-reliance on simple quantitative data, as well as low institutional capacity to introduce ICT and resistance to change, and issues of privacy.

None of this is intended to discourage the introduction of these technologies, as the authors fully recognize their huge potential. One of the most exciting areas concerns the promotion of a more equitable society through simple and cost-effective monitoring and evaluation systems that give voice to previously excluded sectors of the target populations; and that offer opportunities for promoting gender equality in access to information. The application of these technologies however needs to be on a sound methodological footing.

The last section of the paper offers some tips and ideas on how to integrate ICTs into M&E practice and potential pitfalls to avoid. Many of these were drawn from Salons and discussions with practitioners, given that there is little solid documentation or evidence related to the use of ICTs for M&E.

Download the full paper here! 

Read Full Post »

Screen Shot 2014-06-05 at 7.10.25 AMPlan International’s Finnish office has just published a thorough user-friendly guide to using ICTs in community programs. The guide has been in development for over a year, based on experiences and input from staff working on the ground with communities in Plan programs in several countries.

It was authored and facilitated by Hannah Beardon, who also wrote two other great ICT4D guides for Plan in the past: Mobiles for Development (2009) and ICT Enabled Development (2010).

The guide is written in plain language and comes from the perspective of folks working together with communities to integrate ICTs in a sustainable way.

It’s organized into 8 sections, each covering a stage of project planning, with additional practical ideas and guidance in the annexes at the end.

Chapters include:

1 Assessing the potential of ICTs

2 Assessing the social context for ICTs

3 Assessing the physical context for ICTs

4 Reviewing

5 Choosing the ICT

6 Planning for sustainability

7 Building capacity

8 Monitoring, evaluation and sharing learning

Screen Shot 2014-06-05 at 7.27.32 AMThe sections are not set up as a linear process, and depending on each situation and the status of a project the whole guide can be used, or smaller sections can be pulled out to offer some guidance. Each section includes steps to follow and questions to ask. There are detailed orientations in the annexes as well, for example, how to conduct a participatory communications assessment at the community level, how to map information and communication flows and identify bottlenecks where ICTs might help, how to conduct a feasibility study, how to budget and consider ‘total cost of ownership.’

One thing I especially like about the guide is that it doesn’t push ICTs or particular ‘ICT solutions’ (I really hate that term for some reason!). Rather, it helps people to look at the information and communication needs in a particular situation and to work through a realistic and contextually appropriate process to resolve them, which may or may not involve digital technology. It also assumes that people in communities, district offices and country offices know the context best, and simply offers a framework for pulling that knowledge together and applying it.

Screen Shot 2014-06-05 at 7.07.45 AM99% of my hands-on experience using ICTs in development programming comes from my time at Plan International, much of it spent working alongside and learning from the knowledgeable folks who put this guide together. So I’m really happy to see that now other people can benefit from their expertise as well!

Let @vatamik and @tuuliavirhia know if you have questions, or if you have feedback for them and the team!

Download “A practical guide to using ICTs” here.

 

 

Read Full Post »

We looked at the role of mobiles in youth financial inclusion at our March 11th Technology Salon in New York City. Tim Nourse, Making Cents; Peter Goldstein, Intermedia; and Jamie Zimmerman, Bankable Frontier Associates; joined as lead discussants.

Though mobile financial services are seen by many as inevitable, some Salon participants felt that, like in so many other ‘mobiles for xxxx’ areas, we were long on enthusiasm and short on evidence and successful examples. Are we just too early in the game, as with so much of ICT4D? Emerging research on youth demand for mobile financial services may help answer some of those questions, but many other questions remain.

What do we mean by youth financial inclusion?

The Salon started with a quick overview of the terms “financial inclusion” and ‘youth.’ One lead discussant emphasized that the idea of ‘youth’ is context specific. According to the UN, “youth” are people between 15 and 24 years old, though in many countries this can extend to age 30 or 35. Segmentation within this wide age range is important when designing programs because of varying needs, demands, and concerns within age subsets. Using a gender lens is also critical, because young women and young men have different needs, concerns, barriers, interests and experiences. Cultural norms about girls’ and young women’s access to and use of assets and resources, financial services, and mobiles also come into play and need to be well-understood. When discussing youth financial inclusion, it’s useful to talk about the age ranges of 15-17 and 18-24, because in most countries 18 is the legal age at which youth can enter into a formal financial system, sign contracts, and purchase a SIM card in their own name. Program design, challenges faced, and workable business models may look quite different for these two age groups.

The term ‘youth financial services’ includes a full range of services (credit, savings, insurance, money transfer and payments) that help youth build assets. In other words, financial services go far beyond mobile money transfers. Most youth in developing nations are engaged in some kind of livelihood or education, and access to financial services can help them achieve goals in both arenas. It is important to reach youth with financial education when they are adolescents, as they are more inclined to form good habits if they are engaged early on. Availability of services at specific transition points in youth’s lifecycles when they are making serious decisions is another key to establishing good long-term financial habits. It can be difficult, however, to convince banking institutions to develop a menu of financial services for youth because few successful business models exist for youth-focused financial products and services. Savings, account balances and demand for credit tend to be lower among youth, so serving the youth market profitably can be difficult. Strategic rationales and successful business cases around expanded access to youth financial services are needed.

Emerging guidelines for good practice in design and implementation of youth-inclusive financial services being developed by Making Cents include:

  • Involve youth in market research and product development
  • Develop products and services that represent the diversity of youth
  • Ensure youth have safe and supportive spaces
  • Provide or link youth with complementary non-financial services
  • Focus on core competencies and collaborate with youth organizations to ensure holistic programs
  • Involve communities to reinforce and enhance the effectiveness of programming
  • Establish a strategic rational and ensure institutional readiness for serving youth

Mobiles and youth financial inclusion

Many have high hopes around the role of mobile phones in enhancing and expanding youth financial services. Mobiles may allow financial institutions to lower costs for financial products and thus enable new and profitable business models. In addition to providing direct services, mobiles might be able to improve the reach and impact of financial education aimed at youth, and encourage particular behaviors and habit formation. For example, SMS reminders are being used to ‘nudge’ youth towards particular actions related to savings and smarter purchases.

A report called “Beyond the Buzz” however, highlight some of the major challenges when it comes to the role of mobile and financial inclusion for the under 18 population. As explained by one lead discussant (also one of the report’s authors), most youth surveyed in Sub Saharan Africa believed mobile money would be far more important for financial inclusion in the future than SMS. Non-profit organization practitioners and financial institutions surveyed for the report expressed strong belief in the potential of mobile money and other mobile services for broadening youth financial inclusion.

Enthusiasm is quite high, though there has been little success thus far, and the evidence on the ground is not very encouraging. Even though most people surveyed felt that mobile money was the future and would change everything, mobiles are actually being used far more commonly for financial education (SMS and nudges) than for providing youth access to financial services.

So what are the obstacles?

Some of the challenges that prevent mobile financial services from taking off include:

  • Age restrictions and regulations. In most countries, a young person cannot obtain an identity card until the age of 18, meaning access to a bank account, a SIM and/or mobile money is restricted. Many young people get around this obstacle by borrowing a handset or asking a parent or guardian for support. When phones do not belong to youth, however, SMS ‘nudges’ for financial education may not reach them. In addition, the lack of a private handset may discourage youth from using mobile to manage their money due to the potential loss of privacy and control over their money. Children under the age of 18 are a protected group, and many countries have regulations around collecting information about or marketing to this population. Child protection policies and legal regulations are a positive thing, however, they can also create barriers to financial education and financial services for under 18s.
  • Lack of data. One discussant noted that age-disaggregated data from mPesa’s mobile money service would probably show that older youth (ages 18-30) are the majority of the mobile money users. The lack of data on youth, however, makes it difficult for non-profit organizations to develop targeted and demand-led financial products and services. Mobile Network Operators (MNOs) have data, yet their data are not easy to access. One Salon discussant told of a project where it took over two and a half years to obtain legal permission from an MNO to access youth data for an RCT on the impact of SMS on youth savings.
  • Industry barriers. Successful and sustainable business models for youth financial services are few and far between. The likelihood of low financial returns from youth make most banks uninterested in approaching the youth ‘base of the pyramid’ market. Institutions that make money from youth financial services are most likely making it from 24 and 25 year olds, not under 18s. Explaining the potential benefits of a long-term business model (that you may need to take a loss earlier on to gain from this segment later) to financial institutions is difficult. In addition, mobile operators are not fully empowered to launch mobile financial services on their own, even if they wanted to, because of government regulations (in some cases, added one Salon participant, because the banking industry actively lobbies government to avoid losing business to MNOs).

Long on enthusiasm and short on examples?

Considering all the obstacles, why are hopes so high when it comes to mobiles and youth financial inclusion? Some consider that MNOs have a fundamental advantage over banks in countries where the majority of people have access to a mobile phone yet have never used a bank or formal financial service. In many parts of the world, banking systems are unavailable and/or inefficient, and people do not trust formal systems or large bureaucracies. When it comes to mobile, however, use and availability of handsets, widespread recognition of mobile operator brands and services, and familiarity with the notion of transferring airtime mean that mobile money is a fairly easy idea for people to grasp and thus it may be easier to generate trust in mobile as a means to access financial services.

The impact of mobile money and mobiles on financial inclusion is difficult to evaluate rigorously, however, noted one Salon participant. The volume of money is very small, so we should have very low expectations in that regard. If 20% of a target population uses a financial service or product, we should be excited because we see an individual having more control over and information on their own financial transactions. This enables them to make better decisions over their finances. Mobile financial services are likely doing more good than harm, even if a large, broad-based impact study is not available. Another Salon participant pointed out, however, that market research to inform good product and service offerings is very much lacking, and a concerted effort is needed to document and research this area.

A large study is being conducted with youth ages 15-19 and 20-24 on youth demand for mobile money and financial services in several African and Asian countries as part of the Financial Inclusion Insights program, said one lead discussant, and data will be available to the public. The majority of youth surveyed for the study said that they did not use a bank because they did not have enough money to do so. In five years, according to the discussant, mobile financial products will be accessible in a wide range of countries and the number of youth using them is increasing. Research shows that urban youth tend to adopt these products more often than older people or rural populations, and there is a male-female gap, where more males are accessing and using them. In general, younger populations have been positive about mobile financial products and services.

An inevitable future?

Despite the dearth of successful business models, evidence, and large-scale sustainable examples, some Salon participants felt that we are entering a new era where financial products and services will be widely available through the mobile phone. As one person explained, it’s a question of moving with the times or becoming obsolete. In Southern African countries, she said, the move is towards rolling out products and services that provide holistic financial inclusion — credit, savings and insurance. In addition, municipal and utility bill paying is getting people accustomed to mobile financial services via MNOs. Banks who are running at a low level of innovation will lose out if they are not capable of providing these kinds of time-saving services through mobile phones.

So what should organizations be doing to prepare youth to widely access and use mobile financial services? Should financial education programs include content about mobile financial services, offerings and fees, and potential risks and benefits for youth of using them? Might mobile gaming be a way of getting around some of the barriers for under 18s, as one Salon participant suggested? In this case, children could practice important concepts around savings and loans, types of bank accounts, fee structures for banking, etc., without assuming any real risk.

Some broader questions linger around mobile financial services for youth as well: What impact does (or will) mobile financial services have on people’s lives and wellbeing? Will they impact how youth invest and manage their money? Will they improve redistribution of resources to households? Will they end up pulling a large segment of the population into unsustainable systems and backfire?  So far there’s no clear answer, but watch this space.

***

A list of resources, links, projects, organizations and research on the topic is here. Please add anything that’s missing!

Thanks to participants and lead discussants for the great discussions and to Population Council for hosting us at their offices for this Salon. Thanks also to Peter Goldstein for suggesting the topic and to Somto Fab-Ukozor for support with notes and the summary. Salons are held under Chatham House Rule, therefore no attribution has been made in this post. If you’d like to attend future Salons, sign up here!

Read Full Post »

Earlier this month I attended the African Evaluators’ Conference (AfrEA) in Cameroon as part of the Technology and Evaluation stream organized by Pact with financial support from The Rockefeller Foundation’s Evaluation Office and The MasterCard Foundation.

A first post about ICTs and M&E at the Afrea Conference went into some of the deliberations around using or not using ICTs and how we can learn and share more as institutions and evaluators. I’ve written previously about barriers and challenges with using ICTs in M&E of international development programs (see the list of posts at the bottom of this one). Many of these same conversations came up at AfrEA, so I won’t write about these again here. What I did want to capture and share were a few interesting design and implementation thoughts from the various ICT and M&E sessions. Here goes:

1) Asking questions via ICT may lead to more honest answers. Some populations are still not familiar with smart phones and tablets and this makes some people shy and quiet, yet it makes others more curious and animated to participate. Some people worry that mobiles, laptops and tablet create distance between the enumerator and the person participating in a survey. On the other hand, I’m hearing more and more examples of cases where using ICTs for surveying actually allow for a greater sense of personal privacy and more honest answers. I first heard about this several years ago with relation to children and youth in the US and Canada seeking psychological or reproductive health counseling. They seemed to feel more comfortable asking questions about sensitive issues via online chats (as opposed to asking a counselor or doctor face-to-face) because they felt anonymous. This same is true for telephone inquiries.

In the case of evaluations, someone suggested that rather than a mobile or tablet creating distance, a device can actually create an opportunity for privacy. For example, if a sensitive question comes up in a survey, an enumerator can hand the person being interviewed the mobile phone and look away when they provide their answer and hit enter, in the same way that waiters in some countries will swipe your ATM card and politely look away while you enter your PIN. Key is building people’s trust in these methods so they can be sure they are secure.

At a Salon on Feb 28, I heard about mobile polling being used to ask men in the Democratic Republic of Congo about sexual assault against men. There was a higher recorded affirmative rate when the question was answered via a mobile survey than when the question had been asked in other settings or though other means. This of course makes sense, considering that often when a reporter or surveyor comes around asking whether men have been victims of rape, no one wants to say publicly. It’s impossible to know in a situation of violence if a perpetrator might be standing around in the crowd watching someone getting interviewed, and clearly shame and stigma also prevent people from answering openly.

Another example at the AfrEA Tech Salon, was a comparison study done by an organization in a slum area in Accra. Five enumerators who spoke local languages conducted Water, Sanitation and Hygiene (WASH) surveys by mobile phone using Open Data Kit (an open source survey application) and the responses were compared with the same survey done on paper.  When people were asked in person by enumerators if they defecated outdoors, affirmative answers were very low. When people were asked the same question via a voice-based mobile phone survey, 26% of respondents reported open defecation.

2) Risk of collecting GPS coordinates. We had a short discussion on the plusses and minuses of using GPS and collecting geolocation data in monitoring and evaluation. One issue that came up was safety for enumerators who carry GPS devices. Some people highlighted that GPS devices can put staff/enumerators at risk of abuse from organized crime bands, military groups, or government authorities, especially in areas with high levels of conflict and violence. This makes me think that if geographic information is needed in these cases, it might be good to use a mobile phone application that collects GPS rather than a fancy smart phone or an actual GPS unit (for example, one could try out PoiMapper, which works on feature phones).

In addition, evaluators emphasized that we need to think through whether GPS data is really necessary at household level. It is tempting to always collect all the information that we possibly can, but we can never truly assure anyone that their information will not be de-anonymized somehow in the near or distant future, and in extremely high risk areas, this can be a huge risk. Many organizations do not have high-level security for their data, so it may be better to collect community or district level data than household locations. Some evaluators said they use ‘tricks’ to anonymize the geographical data, like pinpointing location a few miles off, but others felt this was not nearly enough to guarantee anonymity.

3) Devices can create unforeseen operational challenges at the micro-level. When doing a mobile survey by phone and asking people to press a number to select a particular answer to a question, one organization working in rural Ghana to collect feedback about government performance found that some phones were set to lock when a call was answered. People were pressing buttons to respond to phone surveys (press 1 for….), but their answers did not register because phones were locked, or answers registered incorrectly because the person was entering their PIN to unlock the phone. Others noted that when planning for training of enumerators or community members who will use their own devices for data collection, we cannot forget the fact that every model of phone is slightly different. This adds quite a lot of time to the training as each different model of phone needs to be explained to trainees. (There are a huge number of other challenges related to devices, but these were two that I had not thought of before.)

4) Motivation in the case of poor capacity to respond. An organization interested in tracking violence in a highly volatile area wanted to take reports of violence, but did not have a way to ensure that there would be a response from an INGO, humanitarian organization or government authority if/when violence was reported. This is a known issue — the difficulties of encouraging reporting if responsiveness is low. To keep people engaged this organization thanks people immediately for reporting and then sends peace messages and encouragement 2-3 times per week. Participants in the program have appreciated these ongoing messages and participation has continued to be steady, regardless of the fact that immediate help has not been provided as a result of reporting.

5) Mirroring physical processes with tech. One way to help digital tools gain more acceptance and to make them more user-friendly is to design them to mirror paper processes or other physical processes that people are already familiar with. For example, one organization shared their design process for a mobile application for village savings and loan (VSL) groups. Because security is a big concern among VSL members, the groups typically keep cash in a box with 3 padlocks. Three elected members must be present and agree to open and remove money from the box in order to conduct any transaction. To mimic this, the VSL mobile application requires 3 PINs to access mobile money or make transactions, and what’s more, the app sends everyone in the VSL Group an SMS notification if the 3 people with the PINs carry out a transaction, meaning the mobile app is even more secure than the original physical lock-box, because everyone knows what is happening all the time with the money.

****

As I mentioned in part 1 of this post, some new resources and forthcoming documentation may help to further set the stage for better learning and application of ICTs in the M&E process. Pact has just released their Mobile Technology Toolkit, and Michael Bamberger and I are finishing up a paper on ICT-enabled M&E that might help provide a starting point and possible framework to move things forward.

Here is the list of toolkits, blog posts and other links that we compiled for AfrEA – please add any that are missing!

Previous posts on ICTs and M&E on this blog:

Read Full Post »

I attended the African Evaluators’ Conference (AfrEA) in Cameroon last week as part of the Technology and Evaluation strand organized by Pact with financial support from The Rockefeller Foundation’s Evaluation Office and The MasterCard Foundation. The strand was a fantastic opportunity for learning, sharing and understanding more about the context, possibilities and realities of using ICTs in monitoring and evaluation (M&E). We heard from a variety of evaluators, development practitioners, researchers, tool-developers, donors, and private sector and government folks. Judging by the well-attended sessions, there is a huge amount of interest in ICTs and M&E.

Rather than repeat what’s I’ve written in other posts (see links at the bottom), I’ll focus here on some of the more relevant, interesting, and/or new information from the AfrEA discussions. This first post will go into institutional issues and the ‘field’ of ICTs and M&E. A second post will talk about design and operational tips I learned /was reminded of at AfrEA.

1) We tend to get stuck on data collection –Like other areas (I’m looking at you, Open Data) conversations tend to revolve around collecting data. We need to get beyond that and think more about why we are collecting data and what we are going to do with it (and do we really need all this data?). The evaluation field also needs to explore all the other ways it could be using ICTs for M&E, going beyond mobile phones and surveys. Collecting data is clearly a necessary part of M&E, but those data still need to be analyzed. As a participant from a data visualization firm said, there are so many ways you can use ICTs – they help you make sense of things, you can tag sentiment, you can visualize data and make data-based decisions. Others mentioned that ICTs can help us to share data with various stakeholders, improve sampling in RCTs (Randomized Control Trials), conduct quality checks on massive data sets, and manage staff who are working on data collection. Using big data, we can do analyses we never could have imagined before. We can open and share our data, and stop collecting the same data from the same people multiple times. We can use ICTs to share back what we’ve learned with evaluation stakeholders, governments, the public, and donors. The range of uses of ICTs is huge, yet the discussion tends to get stuck on mobile surveys and data collection, and we need to start thinking beyond that.

2) ICTs are changing how programs are implemented and how M&E is done — When a program already uses ICTs, data collection can be built in through the digital device itself (e.g., tracking user behavior, cookies, and via tests and quizzes), as one evaluator working on tech and education programs noted. As more programs integrate digital tools, it may become easier to collect monitoring and evaluation data with less effort. Along those lines, an evaluator looking at a large-scale mobile-based agricultural information system asked about approaches to conducting M&E that do not rely on enumerators and traditional M&E approaches. In his program, because the farmers who signed up for the mobile information service do not live in the same geographical community, traditional M&E approaches do not seem plausible and ICT-based approaches look like a logical answer. There is little documentation within the international development evaluation community, however, on how an evaluator might design an evaluation in this type of a situation. (I am guessing there may be some insights from market research and possibly from the transparency and accountability sectors, and among people working on “feedback loops”).

3) Moving beyond one-off efforts — Some people noted that mobile data gathering is still done mostly at the project level. Efforts tend to be short-term and one-off. The data collected is not well-integrated into management information systems or national level processes. (Here we may reference the infamous map of mHealth pilots in Uganda, and note the possibility of ICT-enabled M&E in other sectors going this same route). Numerous small pilots may be problematic if the goal is to institutionalize mobile data gathering into M&E at the wider level and do a better job of supporting and strengthening large-scale systems.

4) Sometimes ICTs are not the answer, even if you want them to be – One presenter (who considered himself a tech enthusiast) went into careful detail about his organization’s process of deciding not to use tablets for a complex evaluation across 4 countries with multiple indicators. In the end, the evaluation itself was too complex, and the team was not able to find the right tool for the job. The organization looked at simple, mid-range and highly complex applications and tools and after testing them all, opted out. Each possible tool presented a set of challenges that meant the tool was not a vast improvement over paper-based data collection, and the up-front costs and training were too expensive and lengthy to make the switch to digital tools worthwhile. In addition, the team felt that face-to-face dynamics in the community and having access to notes and written observations in the margins of a paper survey would enable them to conduct a better evaluation. Some tablets are beginning to enable more interactivity and better design for surveys, but not yet in a way that made them a viable option for this evaluation. I liked how the organization went through a very thorough and in-depth process to make this decision.

Other colleagues also commented that the tech tools are still not quite ‘there’ yet for M&E. Even top of the line business solutions are generally found to be somewhat clunky. Million dollar models are not relevant for environments that development evaluators are working in; in addition to their high cost, they often have too many features or require too much training. There are some excellent mid-range tools that are designed for the environment, but many lack vital features such as availability in multiple languages. Simple tools that are more easily accessible and understandable without a lot of training are not sophisticated enough to conduct a large-scale data collection exercise. One person I talked with suggested that the private sector will eventually develop appropriate tools, and the not-for-profit sector will then adopt them. She felt that those of us who are interested in ICTs in M&E are slightly ahead of the curve and need to wait a few years until the tools are more widespread and common. Many people attending the Tech and M&E sessions at AfrEA made the point that use of ICTs in M&E would get easier and cheaper as the field develops, tools get more advanced/appropriate/user-friendly and widely tested, and networks/ platforms/ infrastructure improves in less-connected rural areas.

5) Need for documentation, evaluation and training on use of ICTs in M&E – Some evaluators felt that ICTs are only suitable for routine data collection as part of an ongoing program, but not good for large-scale evaluations. Others pointed out that the notions of ‘ICT for M&E’ and ‘mobile data collection/mobile surveys’ are often used interchangeably, and evaluation practitioners need to look at the multiple ways that ICTs can be used in the wider field of M&E. ICTs are not just useful for moving from paper surveys to mobile data gathering. An evaluator working on a number of RCTs mentioned that his group relies on ICTs for improving samples, reducing bias, and automatically checking data quality.

There was general agreement that M&E practitioners need resources, opportunities for more discussion, and capacity strengthening on the multiple ways that ICTs may be able to support M&E. One evaluator noted that civil society organizations have a tendency to rush into things, hit a brick wall, and then cross their arms and say, “well, this doesn’t work” (in this case, ICTs for M&E). With training and capacity, and as more experience and documentation is gained, he considered that ICTs could have a huge role in making M&E more efficient and effective.

One evaluator, however, questioned whether having better, cheaper, higher quality data is actually leading to better decisions and outcomes. Another evaluator asked for more evidence of what works, when, with whom and under what circumstances so that evaluators could make better decisions around use of ICTs in M&E. Some felt that a decision tree or list of considerations or key questions to think through when integrating ICTs into M&E would be helpful for practitioners. In general, it was agreed that ICTs can help overcome some of our old challenges, but that they inevitably bring new challenges. Rather than shy away from using ICTs, we should try to understand these new challenges and find ways to overcome/work around them. Though the mHealth field has done quite a bit of useful research, and documentation on digital data collection is growing, use of ICTs is still relatively unexplored in the wider evaluation space.

6) There is no simple answer. One of my takeaways from all the sessions was that many M&E specialists are carefully considering options, and thinking quite a lot about which ICTs for what, whom, when and where rather than deciding from the start that ICTs are ‘good and beneficial’ or ‘bad and not worth considering.’ This is really encouraging, and to be expected of a thoughtful group like this. I hope to participate in more discussions of this nature that dig into the nuances of introducing ICTs into M&E.

Some new resources and forthcoming documentation may help to further set the stage for better learning and application of ICTs in the M&E process. Pact has just released their Mobile Technology Toolkit, and Michael Bamberger and I are finishing up a paper on ICT-enabled M&E that might help provide a starting point and possible framework to move things forward. The “field” of ICTs in M&E is quite broad, however, and there are many ways to slice the cake. Here is the list of toolkits, blog posts and other links that we compiled for AfrEA – please add any that you think are missing!

(Part 2 of this post)

Previous posts on ICTs and M&E:

Read Full Post »

Older Posts »

Follow

Get every new post delivered to your Inbox.

Join 800 other followers