Feeds:
Posts
Comments

Archive for the ‘ICT4D’ Category

Screen Shot 2013-10-11 at 7.24.48 AMA paper that Keshet Bachan and I authored for Unicef is now available for your reading pleasure!

Here’s a  summary of what we talk about in the paper:

Social, cultural, economic and political traditions and systems that prevent girls, especially the most marginalized, from fully achieving their rights present a formidable challenge to development organizations. The integration of new Information and Communication Technologies (ICTs) to the Communication for Development (C4D) toolbox offers an additional means for challenging unequal power relations and increasing participation of marginalized girls in social
transformation.

We examine ways that ICTs can strengthen C4D programming by:

  • enhancing girls’ connections, engagement and agency;
  • helping girls access knowledge; and
  • supporting improved governance and service delivery efforts.

We reflect and build on the views of adolescent girls from 13 developing countries who participated in a unique discussion for this paper, and we then provide recommendations to support the integration of ICTs in C4D work with marginalized adolescent girls, including:

  • Girls as active participants in program design. Practitioners should understand local context and ensure that programs use communication channels that are accessible to girls. This will often require multi-channel and multiple platform approaches that reach more marginalized girls who may not have access to or use of ICTs. Programs should be community driven, and real-time feedback from girls should be incorporated to adjust programs to their needs and preferences. Mentoring is a key component of programming with girls, and holistic programs designed together with girls tend towards being more successful.
  • Privacy and protection. Every program should conduct a thorough risk analysis of proposed approaches to ensure that girls are not placed at risk by participating, sharing and consuming information, or publicly holding others to account. Girls should also be supported to make their own informed choices about their online presence and use of ICT devices and platforms. A broader set of stakeholders should be engaged and influenced to help mitigate systemic and structural risks to girls.
  • Research and documentation. The evidence base for use of ICTs in C4D programming with marginalized adolescent girls is quite scarce. Better documentation would improve understanding of what programs are the most effective, and what the real added value of ICTs are in these efforts.
  • Capacity building. Because the integration of ICTs into C4D work is a relatively new area that lacks a consistent methodological framework, organizations should support a comprehensive training process for staff to cover areas such as program design, effective use of new ICT tools in combination with existing tools and methods, and close attention to privacy and risk mitigation.
  • Policy. Programs should use free and open source software. In addition, child protection policies, measures and guidelines should be updated to reflect changes in technology, platforms and information sharing.

The paper was first shared at the 12th Inter-Agency Roundtable on Communication for Development in November 2011. It was then reviewed and updated in August 2012, and released in August 2013 under the title “Integrating Information and Communication Technologies into Communication for Development Strategies to Support and Empower Marginalized Adolescent Girls.”

Download it here!

Read Full Post »

Screen Shot 2013-09-13 at 5.09.30 PMYouth make up 17 percent of the world’s population and 40 percent of the world’s unemployed, according to the International Labor Organization. A number of factors combine to make sustainable, decent employment an enormous challenge for youth the world over, including low levels of education and technical skills, slow job growth, lack of information about available jobs, and difficulties accessing financial capital to start small enterprises. Decent jobs are especially difficult to find for rural youth, girls and women, and youth with disabilities.

In addition to the growth in youth unemployment, access to and use of mobile technologies (e.g., mobile phones, tablets, eReaders, radio, portable media players, SD cards) among youth worldwide is also expanding. This has created excitement about the potential of mobile devices to catalyze new approaches that address some of the constraints keeping youth from finding and sustaining decent livelihoods. Documentation and evidence of impact in the broad field of mobile technology and youth workforce development (mYWD) is lacking, however, meaning that it has been difficult to identify where mobile technology and youth workforce development initiatives overlap and where mobile may have the greatest added value.

After a year of hard work, last week we launched the mEducation Alliance’s Mobiles for Youth Workforce Development (mYWD) Landscape Review, an effort of the mEducation Alliance, The MasterCard Foundation, and USAID. The review maps out who is doing what and where, and to the extent possible, discusses evidence of what is working. The body of the report answers questions such as:

  • What organizations and programs are using mobiles to help overcome the barriers to employment for youth?
  • What type of programming has been implemented and how?
  • Where do prime opportunities exist for integrating mobile devices into youth workforce development programs?
  • What are relevant considerations related to gender and disability in mYWD programming?
  • What factors facilitate or hinder mYWD in specific contexts?
  • Are there any research findings that show the impact of mobiles on youth workforce development?

In addition, the annexes provide information on 80 initiatives and over 275 publicly available documents describing efforts that use mobile technology to support youth workforce development programming in five key areas:

  • Workforce education and training, including basic education, technical and vocational education and training (TVET), job skills training, apprenticeships, and life skills training (in and out of the classroom).
  • Employment services, including on-going job referral services that bring employers and workers together through job postings, job fairs, job shadowing, job placement, resume preparation, and coaching.
  • Entrepreneurship and enterprise development, including support programs for self-employment and business development, such as entrepreneurship training, mentoring, and financial services for loans and capital.
  • Demand-side policies and programs, including broad-based economic growth programs like national youth employment policies, value chain development, public works programs, wage subsidies, minimum wages, and tax breaks for employers (JBS International, 2013).
  • Addressing social norms, including programs that support effective participation of excluded groups, non-traditional skills training, safe training and employment spaces for excluded youth, and broader awareness campaigns.

There is an enormous amount of activity in mYWD, from small-scale, market-based start-up applications to mobile innovation hubs for youth entrepreneurs. The landscape review offers a summary of how mobile devices are used in the above five areas, draws out relevant lessons from the available literature and existing evidence base, offers advice from practitioners working in the field of mYWD, discusses the issue of scale and sustainability of mYWD programs, and offers a number of recommendations for furthering the field, including:

  • Creating a mYWD framework to aid in advancing the field
  • Further developing the evidence base for mYWD
  • Improving our understanding of what scale means
  • Focusing on gender and youth with disability
  • Improving knowledge sharing and collaboration
  • Building the mYWD evidence base through research and impact evaluation

Download the mYWD landscape review at this link!

If the topic is of interest, you can also join the mYWD working group by signing up here.

Read Full Post »

According to the latest GSMA statistics, nearly 50% of people own a mobile phone in the developing world and almost 70% have access to mobile phones. With mobile access increasing daily, opportunities to use mobiles in development initiatives continue to grow and expand. The area of Mobiles for Development (M4D) has attracted investment from all sides, including mobile operators, entrepreneurs, investors and international development agencies – all working to generate social impact and improve wellbeing at the base of the pyramid. However, efforts to scale M4D initiatives and make them sustainable have largely failed.

Our July 25th NYC Technology Salon examined the topic of Scaling M4D. Lead discussants Corina Gardner from the GSMA’s Mobile Development Intelligence (MDI) unit and Sean McDonald from FrontlineSMS joined us to kick off the conversation, which was hosted at the Rockefeller Foundation.

Screen Shot 2013-08-14 at 10.52.13 AMThe Salon started off with key points from the MDI report “Scaling Mobile for Development: A developing world opportunity,” which highlights the issue of sustainable and scaled impact as the central challenge (and opportunity) in M4D over the next five years. Because the GSMA is commercially focused (it is made up of telecommunication industry members), business models that can achieve both revenue goals and added value to customers are a core concern. GSMA is interested in finding M4D business models that convince industry to re-invest and replicate. However not many of these examples exist.

Business models at the base of the pyramid (BOP) tend to be different than what the industry is used to. If scale is defined as the number of people reached with a service, and the population being reached has little money, then the only clear business model is via a huge customer base. Given that international development agencies also want to achieve scale with development programs, there is a good potential overlap in M4D. In order to achieve good impact, it’s critical to think through what BOP users want and need, and what offers real value to them for their limited resources.

Innovative vehicles are needed for investing in M4D. Currently, M4D financing tends to take two distinct paths: International Development funding and Venture Capital (VC) funding. Hiccups occur because the two operate very differently and do not always work well together. International development funds and processes do not move as quickly as technology-based funds. There is low tolerance for uncertainty and a desire for initial proof of potential impact, adoption and uptake. On the VC side, there is the desire for a light overhead structure modeled after Silicon Valley; however in African countries, for example, there is little existing infrastructure, meaning a heavier structure and a slower process. In addition, the exit strategy may not be clear. A worst-case scenario is when one of the two types of financing bodies is interested in investing, yet both walk away when they see the other at the table.

Though very few examples of M4D at scale exist, some elements brought up during the Salon that need to be considered include:

User-centric design. It is critical to understand the community and the end user’s needs, demands, and payment capacity. Both the private sector and international development agencies have existing approaches to developing M4D initiatives that focus on understanding local context and consultation and engagement with users, but the two sectors use different language to describe these approaches and they often talk past each other without connecting on their commonalities. According to one discussant, the best and most user friendly design is that with the lowest barrier to access, the simplest technology, the cleanest interface and configurability, so that people can build in more complexity if needed. These types of design will also tend to be the most replicable, an important element of scale. Iterative design and getting prototypes in front of users is needed to get their feedback, and this can be a challenge in M4D programs if they are being done within typical international development cycles of planning and funding.

User data. Users at the base of the pyramid are both financially poor and “data poor” and companies cannot create products for users that they know nothing about. Mobile can help gather data on user behaviors. This data can be used to inform business models, create products and services of value for BOP users, and to create revenue streams. One key question is that of how the data can be better used to benefit the BOP more broadly.

Understanding what ‘scale’ means for different parties. For mobile operators, scale is important because it is linked to numbers, volume and revenue. However this is not the element that matters for those working in international development, where impact may be a more important measure of success. Uptake of an M4D service may be due to advertising, rather than because it has a measurable impact on the life of a user. The difference needs to be understood and better analyzed and documented before success, scale, or impact is claimed. One measure of success is improved and sustained functioning of broader systems — and mobile may only be one small piece of a well-functioning development program, information ecosystem, or service delivery effort. As one discussant noted, “I don’t care if someone uses mobile banking or branch banking, so long as they are banking.” The mobile device may not be the central piece; it may be an additional access point for people who were formerly left out of these systems. In addition, “reaching” people is different than “influencing” people, and the latter will likely have more of an impact. Trust is critical in these efforts to influence, and often that takes more than a mobile connection.

Infrastructure.  The case for improved networks, coverage, and other infrastructure (electricity, for example) needs to be made to operators and government. The urban-rural divide when it comes to infrastructure is a global issue, not just one in so-called ‘developing economies.’ For example, using 4G and a credit card, someone can order a product on Amazon from the DRC, however Amazon will not be able to deliver that product. Similarly, someone can report poor government services via a mobile phone, but until infrastructure and governance improves, there may be no response. Poor infrastructure in rural areas is an issue globally.

Payment. Operators incorrectly give away free SMS to NGOs, said one discussant. Instead, having to pay a small amount (either as an NGO or an end user) means that much more care is taken in terms of what is communicated. “If it costs 5 cents to send a message, you will not spam people.” This is also critical for building in sustainability, and where the best ROI tends to be found in technology influenced programming. More thought and research is needed regarding payment and sustainable, scalable models.

Due diligence. A challenge in the M4D space is the high incidence of people seeing a problem, thinking no one has addressed it, and jumping in to build their own solution. This wastes money and time and creates churn. It is important to do research, layer, and build from other people’s ideas and existing solutions. One problem with the idea of due diligence, according to a participant, is that it means different things to different people. In technology it means “you have a problem, what is the cheapest and most robust solution,” but in the field of international development, context discovery takes a very long time and requires multidisciplinary knowledge and awareness that goes far beyond technology. There is also a need to consider whether technology (as opposed to non-digital efforts) is the most viable solution for the information and communication situation. ‘Horizontal due diligence’ (looking at partnerships) and due diligence with regard to maximizing systems are also needed.

Monitoring and Evaluation (M&E). M&E is currently sub-par on most M4D initiatives, said one participant. Organizations are often doing their own M&E rather than having a third party conduct external M&E.  There is a lack of comparative data on M4D programs also, and often M&E is attempted at the end of a project rather than built in from the start. A greater presence of academia is needed in M4D work, it was noted, and we also need more qualitative data, as currently the emphasis is on the quantitative data that are collected more easily via mobiles. One benefit in M4D programs is the ability to digitize and intelligently store data from the very start. This is the way to show scale and impact, said another participant. However data need to be well-used and refined, and available to the right person or people at the right time. Greater respect and understanding of privacy and ethical issues along with helping people to understand and steward their users’ data are also critically important and need more attention.

Salons function under Chatham House Rule, thus no attribution has been made. Sign up here to join the Technology Salon mailing list to receive invitations for future events in NYC, DC, San Francisco, London and Nairobi!

Read Full Post »

from chaos to haute couture...

from chaos to haute couture…

I took my 16-year-old (a huge music fan) to the Met on Saturday to see the Punk: Chaos to Couture exhibit. I was a little skeptical, having been pretty into punk rock as a teenager.

It was really bizarre to be at The Met, looking at how punk rock influenced high fashion. In fact, it was kind of ridiculous. (Hello, $100 designer “punk rock” shirts in the Museum Shop.) Everyone kept getting in trouble for photographing things (which of course only made me want to photograph them more). My daughter kept admonishing me to stop.

I would have preferred an exhibit about punk rock over one on high fashion, but it was cool that I kept overhearing mothers around my age explaining to their daughters “yes, back when I was a teenager….” or “I used to wear this kind of thing back when…” Of course they were not talking about high fashion, but about the real live stuff we used to get from the thrift shops and modify into something new. In my home town we were normally about 10 years behind the times, and we didn’t discover punk rock till the 80s, but oh well. Back then we didn’t have cable or the Internet, and punk rock was not available at the mall. We had to find inspiration wherever we could.

46909_10151752486462284_666195068_nThe background information about the Chaos to Couture exhibit explained that the difference between British punk and American punk was that Brit punk was a sociopolitical reaction of the working class and US punk was more an intellectual-artistic movement. I have to say, though, that in Indiana in the 1980s, we were rebelling against the boredom and status quo of life in general. We weren’t politically engaged, intellectual, or particularly artistic; we just felt like misfits and knew something was not quite right. We didn’t want to be like the people around us.

The Met exhibit credits the punk DIY attitude for spawning some of the current approaches in tech and social media today. (DIY is wonderfully chronicled, by the way, in the excellent book “Our Band Could Be Your Life” which covers the 80s DIY music movement in the US, including chapters on some of my favorites: The Butthole Surfers, Black Flag, The Minutemen, and Sonic Youth).

A good friend of mine and I semi-jokingly talk about wanting to do PunkICT4D. We’ve mused about starting the #ICT4Anarchy hashtag based on the definition below from Noam Chomsky. (We’ll be exploring some of this in December at ICTD2013 during a panel with a high brow, academic, not very punk sounding title: “Appropriating ICTs for Developing Critical Consciousness and Structural Social Change.”)

[Noam says] Well, anarchism is, in my view, basically a kind of tendency in human thought which shows up in different forms in different circumstances, and has some leading characteristics.  Primarily it is a tendency that is suspicious and skeptical of domination, authority, and hierarchy.  It seeks structures of hierarchy and domination in human life over the whole range, extending from, say, patriarchal families to, say, imperial systems, and it asks whether those systems are justified.  It assumes that the burden of proof for anyone in a position of power and authority lies on them.  Their authority is not self-justifying.  They have to give a reason for it, a justification.  And if they can’t justify that authority and power and control, which is the usual case, then the authority ought to be dismantled and replaced by something more free and just.  And, as I understand it, anarchy is just that tendency.  It takes different forms at different times….

In doing a little reading on the exhibit at the Met, I found this rather blind statement (my bold).

In the 1970s, Punk was so much more than a fashion statement. In Britain, it was a reaction to sky-high unemployment, to the Thatcher administration’s closing of the mines, and to the pervasive feeling of hopelessness. Andrew Bolton, the British curator of the show, talked about how that political tinderbox could never be recreated today, although the fashions could be referenced and reworked.

On the one hand, duh. We all know that punk became another watered down, mass-produced, corporate-sponsored commodity. On the other hand, no. Punk’s not dead. The best part of the exhibit was this, scrawled on one of the walls:

Courtesy of @umairh because I was being watched by a museum guard and couldn't get a photo.

Courtesy of @umairh’s Twitter feed because the museum guards were watching, and I couldn’t get any more photos.

Maybe I’m a throwback, but it seems punk’s still hugely relevant.
.
PD: Chomsky on Celebrity and Punk Rock, via Christopher Neu.
.

Read Full Post »

Our June 20 Salon in New York City tackled the topic of digital jobs for African youth. Lead discussants were Lauren Dawes, who leads the GSMA’s Mobiles for Employment team, and Lillian Chege from the Rockefeller Foundation’s Digital Jobs Africa program. The GSMA will release a study on Mobiles for Work in July, and Rockefeller has recently announced a 7-year, multi-million dollar commitment to creating digital jobs in six African countries.

The wealth of experience in the room led to lively discussions and debates around roles and responsibilities in this area. The stagnant global economy is a major underlying problem when it comes to youth employment, and jobs cannot be created out of thin air. Salon participants shared how they are trying to work around this by identifying areas with potential for youth, preparing youth for these opportunities, and seeking to match youth skills with private sector demand. Alternatively, some Salon participants focus on helping youth enter into different forms of entrepreneurship.

What do youth want?

When surveyed for a previous GSMA study on Mobile Learning, young people indicated more interest in using mobile devices for finding a job than for learning math or English. Most youth prioritized work skills to get jobs. So the GSMA conducted a second study (forthcoming) with youth in Spain, Ghana, Indonesia and Bangladesh to identify where mobile devices could help with youth employment. The study’s preliminary findings indicate that youth want support for learning and training; finding a job (connecting to employers, knowing what to say to them, understanding the process of getting a job); and obtaining skills and capital to start their own businesses. Surveyed youth identified interest in manufacturing, catering, teaching, and the ICT and mobile sectors, including sales, selling mobile phones and mobile accessories, and jobs in the mobile industry.

Do youth have a sense of what is possible?

Listening to youth is very valuable, but some Salon participants felt that youth might only be aware of what they see around them. How can we help youth discover new areas and expand their horizons, they asked. Might there be jobs and possibilities that youth are well suited for but do not know about? The fall back position of “start my own business” is another example of what  youth see around them in poor economies where there are no formal jobs. Youth’s ideas will likely be very experience-based. One Salon participant told of an innovation contest, where youth in Kenya submitted new and creative ideas, whereas those from some other countries submitted ideas that closely mirrored NGO programs commonly seen in their communities. Stimulating youth to think bigger and exposing them to new opportunities and ideas is an important part of youth development and youth employment programs.

Soft skills for formal jobs

As the GSMA study noted, a big challenge for youth is understanding the job seeking process and gaining the skills needed to find a job, communicate with employers, and then keep a job. Many youth do not know how to manage an interview, or how to retain connections. Placing someone who has never experienced a formal setting into a formal job, even at an entry-level, creates a whole set of issues. In some cases these may be more basic, like personal hygiene, arriving to work on time, or simply knowing how to navigate a formal work environment. New kinds of hierarchies may need to be learned. For example, in some contexts males have never had to work with or report to females. On top of these situations, there may be additional, deeper challenges. In one employment program, a Salon participant noted, 8 of the 10 girls recruited were survivors of rape. Once youth land a job, an entire family is relying on them and their income, and this generates a great deal of stress. The traditional education system does a very poor job of helping youth gain soft skills, As one participate noted, it still aims to prepare youth for an industrial economy yet today’s world requires completely different skills to succeed.

Skills for entrepreneurship

The state of the economy is such that many youth will not find formal employment and are considering starting their own businesses. In the GSMA study, youth identified a desire for capital and support in this area. A Salon participant outlined 3 kinds of entrepreneurship: high impact/high growth (Silicon valley style); lifestyle entrepreneurship (small and medium enterprises, family businesses); survival entrepreneurship (low-skilled, informal businesses). Each of these is quite different, and adequate risk analysis and targeted support and skills training need to be developed for each according to the context. Most youth in developing countries will not work in Silicon Valley. They will instead need to develop skills for lifestyle and survival entrepreneurship. Soft skills as well as technical know-how are critical for entrepreneurship, and many investments are unsuccessful because these skills are not strong among youth. Generational gaps also make it difficult for older people to mentor younger people, because things are moving from print to digital and relationships are also changing. Innovation hubs are aiming to fill this gap and provide youth with a relevant space to learn the hard and soft skills required for high impact, high growth entrepreneurship in the tech sector.

What about young women?

It was noted that most of the existing innovation hubs are very male-focused. For example, only 16% of the iHub Nairobi’s users are female. More needs to be done to bring women into these spaces, yet it can be challenging in many contexts where girls do not complete secondary school. Female role models and mentors are scarce in these new fields and in leadership positions within companies. Mentorship is key for young women, who tend to doubt themselves, to be apologetic about their ideas, and who are often shy about speaking up. Some organizations are using Skype, Google hangouts, Facebook, and Twitter chats to reach and mentor young women. Girls from poorer communities, however, may not have access to these programs and may not see themselves and their personal experiences reflected in female role models from the upper classes. In addition, though mentoring is high touch and very powerful, in its current form it is time-consuming and not feasible for reaching everyone who needs it. The challenge is offering these kinds of support at scale.

The employment ecosystem

Some participants noted that creating one job at a large company can stimulate additional, related jobs (e.g., cleaners, nannies and cooks who serve employees at lunchtime). Others felt that the trickle-down effect is overestimated. An entire ecosystem conducive to youth employment is needed. This is not a simple thing to create, and it takes quite a long time. The role of government in creating the infrastructure for jobs and a digital economy cannot be underestimated. One participant pointed out that both “bottom up” development of the labor market and “top down” development of labor infrastructure and capital are needed. This will vary from country to country, and research should be conducted to understand the right entry points for each context. All these sectors need to work together to match the economic context, the demand, and the supply sides. The private sector cannot create jobs on its own, as one discussant commented. Jobs are created because of consumer demand and need. The private sector can, however, get better at identifying which jobs are on the horizon, and it can work with education, training, and non-profit partners to ensure that youth are prepared for these jobs.

Comprehensive programs are needed

When we train youth for non-existent jobs, we create expectations, said one Salon participant, citing an ILO study that reported 40% of job programs had negative impacts on youth. In addition, programs cannot only look at one side of the issue. Youth employment programs should not be just hard skills, just soft skills, or just mentorship. Rather they need to be comprehensive. The issue of supply-demand balance is rampant across development programs, noted another participant. We train women to go to a clinic, and they go, but there is no midwife. The need for a holistic perspective is something that has been learned the hard way, and this learning needs to transfer into youth employment programs. Impact sourcing is a newer concept where socially responsible businesses are encouraged to hire youth from less privileged communities for lower end jobs, for example, at call centers. The Rockefeller Foundation is working in partnership with the private sector and institutes such as Digital Divide Data to train and place youth in these types of jobs and will expand to sectors outside of the business process outsourcing (BPO) field in their new Digital Jobs Africa program. In some cases, 100% of participating youth have been placed into formal economy jobs. The program is also looking at other high growth sectors (such as agriculture, manufacturing, and the hospitality industry) where digital jobs are growing. The Foundation collaborates with governments to support creation of an enabling environment that will allow these efforts to achieve scale.

Scale and speed are imperative

While scale is one factor, time is the other, according to one participant. Hubs and ground-up entrepreneurship can move the ball down the field, but this will take time. A grand and widespread effort is needed. In part, this can be boosted by identifying and building on existing infrastructure. Libraries can serve as information hubs for job seekers, financial literacy, digital spaces and places to find support for job training and seeking. Telecenters are also playing a role in helping youth access information and build digital and life skills. More needs to be done with schools as well. The need is too great not to scale, said one discussant, it’s imperative! We need to unlock existing funding within government as well. Governments can  be a source of demand, as they also have digital needs and digital jobs. In Kenya, for example, the government is digitalizing the records for the country’s largest hospital, and this is work that youth are doing. As new hospitals are built in rural areas, now they will have access to patient records across the health system. Similar efforts can be found and youth can be trained for these kinds of jobs.

What about rural youth?

While the possibilities are exciting, much of the work is anchored in urban and semi-urban areas, including the digital jobs programs and the innovation hubs. Participants asked whether it is possible to extend services out to rural areas to cast a wider net. The latest “big thing” was also brought up – can Google’s new wifi balloons solve some of the issue with connectivity, and will that be enough to bring some of these benefits to rural populations?

Thanks to our great lead discussants, Lauren and Lillian, and to Melissa Beuoy at FHI-360’s New York City office for graciously hosting us and providing a fantastic breakfast spread!

Don’t miss our July 10 Salon on the realities of ICT access for youth in Indonesia, Sweden, Sierra Leone and Uganda. We’ll be joined by 6 youth who are visiting New York City for a UN Take Over to support girls’ education, in honor of of Malala Yousafzai.

Sign up to receive alerts on future events at Technology Salon.

Salons are in-person only events held in Washington DC, New York, San Francisco, Nairobi and London. We hold to Chatham House Rule, thus no attribution has been made in the above summary post.

Read Full Post »

Verone Mankou of VMK with Senam Beheton of EtriLabs, who organized Verone's US trip.

Verone Mankou of VMK with Senam Beheton of EtriLabs, who organized Verone’s US trip.

We switched things up a little for our May 21 Technology Salon and had an evening event with Verone Mankou, the head of VMK, a company in Congo Brazzaville that designs and produces the Way-C Tablet and the Elikia smart phone. The event was graciously hosted by ThoughtWorks, and Verone’s US trip was organized by Senam Beheton of EtriLabs.

Verone told his story of starting the first African company to make mobile devices. In 2006, he said, the cheapest computer in Congo cost $1000 USD, and the cheapest Internet package was priced around $1000 per month. Verone worked in the tech industry and wondered why there was no computer or Internet that could be reasonably accessed by people in Congo. Everyone laughed and said he was young, fresh out of school, and that within 2 years he would understand the business and stop dreaming.

Verone persisted with his idea that computers and the Internet were not just for people in offices with suits. Everyone wanted to access Internet, he believed, but they just didn’t have the money. So in 2006, he started working on ideas for a laptop. After 6 months he concluded that it was impossible. To create a laptop you need a lot of money for research and development, and, unfortunately, his bank account only contained about $100 USD. He had no contacts with suppliers. Verone had a big dream but problems executing it, so he put the laptop project on hold.

In June 2007, a friend told him to hurry up and turn on the news. Steve Jobs was presenting the iPhone. “This is what I want to do,” Verone thought. “Make a big iPhone.” He felt keyboards were a deterrent for most people who were new to a computer, and that “a big iPhone” would be a solution. He started working on the idea of a tablet. It was difficult to find any suppliers on the African continent – no CPU factory, no battery factory. He could not find hardware engineers because in Congo there is no engineering high school. He realized he needed to go outside, to Asia. He made a first trip to China in 2007 and learned many things. By 2009 he had a plan, an Android system, and a finished project.

The next problem, however, was that he had no money for mass production. “In Congo we don’t have venture capitalists. Also as a youth, you cannot get any money. You will have a bad experience if you go to the bank to ask. People will tell you to start a hotel and not to waste your money on something different.” Verone did not go quiet when he could not find capital, however. He kept looking.

Meanwhile, Steve Jobs presented a new device: a big iPhone – otherwise known as the iPad. Verone was disappointed that Jobs had moved more quickly than he could with his tablet launch. On the other hand, everyone suddenly understood Verone’s project.

His miracle came a few months later when a minister from Congo was on a plane from Brazzaville to Singapore and came across a magazine article talking about a boy in Congo making a tablet. The minister could not believe someone in his country was doing this and he did not know about it. He contacted Verone and asked how he could help. Verone asked for $200k USD and gave the minister a prototype. Within 2 hours, the minister secured the funding and Verone was able to begin manufacturing.

He had enough funds to do a mass prototype of 1000 tablets and imagined that he could sell them in 3 months if they were marketed well. There was a buzz around the tablets, however, and they sold out in 1 week and he increased production to 10,000. Compared to the cost of an iPad in Congo (around $1500), Verone’s tablet was going for $200-300. He set his sights on making a good quality, low-cost smart phone.

Good quality is key for Verone. “Why do Samsung and Nokia come to Africa and think Africans need cheap, low quality devices?” As an African, Verone felt uniquely placed to create something for the continent – something cheap but good quality. He did this by eliminating unnecessary features and keeping only the necessary elements.

Next he needed to ensure that there was good content and an opportunity for monetization. Africans needed applications and content for their own purposes and context, he felt. Not maps of pharmacies in New York City. However most Africans do not have credit cards, so another way to pay for content and applications was needed. VMK created a marketplace for Africans that used scratch cards for payment, since everyone understands how scratch cards work.

VMK launched their smart phone in December of last year and  plans to sell 50K units in Congo Brazzaville. The company is also working on a cheaper phone with lower capacity that should run about $50 USD. In addition, they are working on identifying content partners and launching an “updateable school book” that would be accessible also at around $50 USD, so that students and teachers are not using outdated text books, which stunt the development of African children’s minds.  Verone’s vision is to give people access to good quality technology at a good price.

How will VMK compete with Chinese products as prices continue to go down over the next 10 years? “We will learn fast,” Verone says. “We will not sit while others advance.” He believes that expanding to African countries and developing the industry there will be good for the continent, good for developers and good for business. It’s not yet possible to do mass production in Africa because of poor education and lack of / high cost of Internet. People still cannot easily access relevant and updated information. But Internet is getting cheaper, access is improving and things are changing. People are starting to understand the importance of education. VMK currently has teams working in China and India, but they hope to move these functions to Africa as soon as possible. VMK plans to train staff up, offer internships and to get African youth skilled up in order to do this work.

The important thing is not to sit still, Verone says. “We can’t just keep waiting for things to change. We need to change them ourselves.”

Read Full Post »

At Catholic Relief Services’ annual ICT4D meeting in March 2013, I worked with Jill Hannon from Rockefeller Foundation’s Evaluation Office to organize 3 sessions on the use of ICT for Monitoring and Evaluation (ICTME). The sessions covered the benefits (known and perceived) of using ICTs for M&E, the challenges and barriers organizations face when doing so, and some lessons and advice on how to integrate ICTs into the M&E process.

Our lead discussants in the three sessions included: Stella Luk (Dimagi), Guy Sharrack (CRS), Mike Matarasso (CRS), David McAfee (HNI/Datawinners), Mark Boots (Votomobile), and Teressa Trusty (USAID’s IDEA/Mobile Solutions). In addition, we drew from the experiences and expertise of some 60 people who attended our two round table sessions.

Benefits of integrating ICTs into the M&E process

Some of the potential benefits of integrating ICTs mentioned by the various discussants and participants in the sessions included:

  • More rigorous, higher quality data collection and more complete data
  • Reduction in required resources (time, human, money) to collect, aggregate and analyze data
  • Reduced complexity if data systems are simplified; thus increased productivity and efficiency
  • Combined information sources and types and integration of free form, qualitative data with quantitative data
  • Broader general feedback from a wider public via ICT tools like SMS; inclusion of new voices in the feedback process, elimination of the middleman to empower communities
  • Better cross-sections of information, information comparisons; better coordination and cross-comparing if standard, open formats are used
  • Trend-spotting with visualization tools
  • Greater data transparency and data visibility, easier data auditing
  • Real-time or near real-time feedback “up the chain” that enables quicker decision-making, adaptive management, improved allocation of limited resources based on real-time data, quicker communication of decisions/changes back to field-level staff, faster response to donors and better learning
  • Real-time feedback “down the ladder” that allows for direct citizen/beneficiary feedback, and complementing of formal M&E with other social monitoring approaches
  • Scale, greater data security and archiving, and less environmental impact
  • Better user experience for staff as well as skill enhancement and job marketability and competitiveness of staff who use the system

Barriers and challenges of integrating ICTs into M&E processes

A number of challenges and barriers were also identified, including:

  • A lack of organizational capacity to decide when to use ICTs in M&E, for what, and why, and deciding on the right ICT (if any) for the situation. Organizations may find it difficult to get beyond collecting the data to better use of data for decision-making and coordination. There is often low staff capacity, low uptake of ICT tools and resistance to change.
  • A tendency to focus on surveys and less attention to other types of M&E input, such as qualitative input. Scaling analysis of large-scale qualitative feedback is also a challenge: “How do you scale qualitative feedback to 10,000 people or more? People can give their feedback in a number of languages by voice. How do you mine that data?”
  • The temptation to offload excessive data collection to frontline staff without carefully selecting what data is actually going to be used and useful for them or for other decision-makers.
  • M&E is often tacked on at the end of a proposal design. The same is true for ICT. Both ICT and M&E need to be considered and “baked in” to a process from the very beginning.
  • ICT-based M&E systems have missed the ball on sharing data back. “Clinics in Ghana collect a lot of information that gets aggregated and moved up the chain. What doesn’t happen is sharing that information back with the clinic staff so that they can see what is happening in their own clinic and why. We need to do a better job of giving information back to people and closing the loop.” This step is also important for accountability back to communities. On the whole, we need to be less extractive.
  • Available tools are not always exactly right, and no tool seems to provide everything an organization needs, making it difficult to choose the right tool. There are too many solutions, many of which are duplicative, and often the feature sets and the usability of these tools are both poor. There are issues with sustainability and ongoing maintenance and development of M&E platforms.
  • Common definitions for data types and standards for data formatting are needed. The lack of interoperability among ICT solutions also causes challenges. As a field, we don’t do enough linking of systems together to see a bigger picture of which programs are doing what, where and who they are impacting and how.
  • Security and privacy are not adequately addressed. Many organizations or technology providers are unaware of the ethical implications of collecting data via new tools and channels. Many organizations are unclear about the ethical standards for research versus information that is offered up by different constituents or “beneficiaries” (eg., information provided by people participating in programs that use SMS or collect information through SMS-based surveys) versus monitoring and evaluation information. It is also unclear what the rules are for information collected by private companies, who this information can be shared with and what privacy laws mean for ICT-enabled M&E and other types of data collection. If there are too many barriers to collecting information, however, the amount of information collected will be reduced. A balance needs to be found. The information that telecommunications companies hold is something to think about when considering privacy and consent issues, especially in situations of higher vulnerability and risk. (UNOCHA has recently released a report that may be useful.)
  • Not enough is understood about motivation and incentive for staff or community members to participate or share data. “Where does my information go? Do I see the results? Why should I participate? Is anyone responding to my input?” In addition, the common issues of cost, access, capacity, language, literacy, cultural barriers are very much present in attempts to collect information directly from community members. Another question is that of inclusion: Does ICT-enabled data collection or surveying leave certain groups out? (See this study on intrinsic vs extrinsic motivation for feedback.)
  • Donors often push or dictate the use of ICT when it’s perhaps not the most useful for the situation. In addition there is normally not enough time during proposal process for organizations to work on buy-in and good design of an ICT-enabled M&E system. There is often a demand from the top for excessive data collection without an understanding of the effort required to collect it, and time/resource trade-offs for excessive data collection when it leads to less time spent on program implementation. “People making decisions in the capital want to add all these new questions and information and that can be a challenge… What data are valuable to collect? Who will respond to them? Who will use them as the project goes forward?”
  • There seems to be a focus on top-down, externally created solutions rather than building on local systems and strengths or supporting local organizations or small businesses to strengthen their ICTME capacities. “Can strengthening local capacity be an objective in its own right? Are donors encouraging agencies to develop vertical ICTME solutions without strengthening local systems and partners?”
  • Results-based, data-based focus can bias the countable, leave out complex development processes with more difficult to count/measure impacts.

Lessons and good practice for integrating ICTs into M&E processes

ICT is not a silver bullet – it presents its own set of challenges. But a number of good practices surfaced:

  • The use of ICTs for M&E is not just a technology issue, it’s a people and processes issue too, and it is important to manage the change carefully. It’s also important to keep an open mind that ICT4D to support M&E might not always be the best use of scarce resources – there may be more pressing priorities for a project. Getting influential people on your side to support the cause and help leverage funding and support is critical. It’s also important to communicate goals and objectives clearly, and provide incentives to make sure ICTs are successfully adopted. The trick is keeping up with technology advances to improve the system, but also keeping your eye on the ball.
  • When designing an ICTME effort, clarity of purpose and a holistic picture of the project M&E system are needed in order to review options for where ICT4D can best fit. Don’t start with the technology. Start with the M&E purpose and goals and focus on the business need, not the gadgets. Have a detailed understanding of M&E data requirements and data flows as a first step. Follow those with iterative discussions with ICT staff to specify the ICT4D solution requirements.
  • Select an important but modest project to start with and pilot in one location – get it right and work out the glitches before expanding to a second tier of pilots or expanding widely. Have a fully functional model to share for broad buy-in and collect some hard data during the pilot to convince people of adoption. The first ICT initiative will be the most important.  If it is successful, use of ICTs will likely spread throughout an organization.  If the first initiative fails, it can significantly push back the adoption of ICTs in general. For this reason, it’s important to use your best people for the first effort. Teamwork and/or new skill sets may be required to improve ICT-enabled M&E. The “ICT4D 2.0 Manifesto” talks about a tribrid set of skills needed for ICT-enabled programs.
  • Don’t underestimate the need for staff training and ongoing technical assistance to ensure a positive user experience, particularly when starting out. Agencies need to find the right balance between being able to provide support for a limited number of ICT solutions versus the need to support ongoing local innovation.  It’s also important to ask for help when needed.  The most successful M&E projects are led by competent managers who seek out resources both inside and outside their organizations.
  • Good ICT-enabled M&E comes from a partnership between program, M&E and ICT staff, technical support internal and external to the organization. Having a solid training curriculum and a good help desk are important. In addition, in-built capacity for original architecture design and to maintain and adjust the system is a good idea. A lead business owner and manager for the system need to be in place as well as global and local level pioneers and strong leadership (with budget!) to do testing and piloting. At the local level, it is important to have an energetic and savvy local M&E pioneer who has a high level of patience and understands technology.
  • At the community level, a key piece is understanding who you need to hear from for effective M&E and ensuring that ICT tools are accessible to all. It’s also critical to understand who you are ignoring or not reaching with any tool or process. Are women and children left out? What about income level? Those who are not literate?
  • Organizations should also take care that they are not replacing or obliterating existing human responsibilities for evaluation. For example, at community level in Ghana, Assembly Members have the current responsibility for representing citizen concerns. An ICT-enabled feedback loop might undermine this responsibility if it seeks direct-from-citizen evaluation input.  The issue of trust and the human-human link also need consideration. ICT cannot and should not be a replacement for everything. New ICT tools can increase the number of people and factors evaluated; not just increase efficiency of existing evaluations.
  • Along the same lines, it’s important not to duplicate existing information systems, create parallel systems or fragment the government’s own systems. Organizations should be strengthening local government systems and working with government to use the information to inform policy and help with decision-making and implementation of programs.
  • implementors need to think about the direction of information flow. “Is it valuable to share results “upward” and “downward”? It is possible to integrate local decision-making into a system.” Systems can be created that allow for immediate local-level decision-making based on survey input. Key survey questions can be linked to indicators that allow for immediate discussion and solutions to improve service provision.
  • Also, the potential political and social implications of greater openness in information flows needs to be considered. Will local, regional and national government embrace the openness and transparency that ICTs offer? Are donors and NGOs potentially putting people at risk?
  • For best results, pick a feasible and limited number of quality indicators and think through how frontline workers will be motivated to collect the data. Excessive data collection will interfere with or impede service delivery. Make sure managers are capable of handling and analyzing data that comes in and reacting to it, or there is no point in collecting it. It’s important to not only think about what data you want, but how this data will be used. Real-time data collected needs to be actionable. Be sure that those submitting data understand what data they have submitted and can verify its accuracy. Mobile data collection needs to be integrated into real processes and feedback loops. People will only submit information or reports if they see that someone cares about those reports and does something about them.
  • Collecting data through mobile technology may change the behavior being monitored or tracked. One participant commented that when his organization implemented an ICT-based system to track staff performance, people started doing unnecessary activities so that they could tick off the system boxes rather than doing what they knew should be done for better program impact.
  • At the practical level, tips include having robust options for connectivity and power solutions, testing the technology in the field with a real situation, securing reduced costs with vendors for bulk purchasing and master agreements, using standard vendor tools instead of custom building. It’s good to keep the system simple, efficient and effective as possible and to avoid redundancy or the addition of features things that don’t truly offer more functionality.

Thanks to all our participants and lead discussants at the sessions!

Useful information and guides on ICTME:

Mobile-based technology for monitoring and evaluation: A reference guide for project managers, M&E specialists, researchers, donors

3 Reports on mobile data collection

Other posts on ICTs for M&E:

12 tips on using ICTs for social monitoring and accountability

11 points on strengthening local capacity to use new ICTs for M&E

10 tips on using new ICTs for qualitative M&E

Using participatory video for M&E

ICTs and M&E at the South Asia Evaluators’ Conclave

Read Full Post »

CISCO is looking for stories about how people and organizations have used network services (mobile video and gaming, video conferencing, SMS, and social networking) to achieve different social or personal goals. The idea is to find stories not only about how technology developers are inventing things, but also about how different tools are enabling a range of things to happen and helping people to resolve challenges and achieve progress in their communities.

The application process is quite simple – just answer 5 questions through a form on the website to formulate the story. You can also download a form, fill it out, and then cut/paste into the form online if you are on slow internet. Contest and story submission information is here.

According to CISCO, by posting a story on how you’ve developed solutions, or used these services, you will be an inspiration to others and CISCO will help you promote your work through their social media channels thereby increasing your visibility. They hope that the stories help generate more conversation around the impact of Internet services.

They also hope the stories can help answer some questions around the benefits of increased connectivity. For example:

  • How will growth in Internet access impact global economies?
  • How can more communities and businesses take advantage of the significant growth in mobile services?
  • What new opportunities can be created for those least connected?
  • Why are there regional variations in adoption rates of certain networking services?

I know a lot of smaller local organizations – especially some great youth-led organizations – are doing some fantastic things, and a prize like this could help these organizations get to the next level. More information here.

The more academic folks out there may not want to submit stories, but you might be interested in the Virtual Network Indexing Forecast.

Read Full Post »

The March NYC Technology Salon offered an opportunity to discuss how mobile technology can transform workforce development and to hear how mobile is improving the reach and impact of existing initiatives working with girls and young women. Attendees also raised some of the acute, practical challenges and the deeper underlying issues that need to be overcome in order for girls and women to access and use mobile devices and to participate in workforce development programs and the labor market.

Conversation kicked off with comments from Kris Wiig (Samasource), Nancy Taggart (Education Development Center)  and Trina Das Gupta (former head of mWomen). The Salon was part of the Mobiles for Education Mobiles and Youth Workforce Development (mYWD) Working Group Learning Series, an initiative created in partnership with the MasterCard Foundation and USAID. The Salon was hosted at the offices of the Clinton Global Initiative.

The benefits of mobile vs stationary ICT for youth workforce development programs

Mobile holds a number of benefits over stationary ICT, including the feature of reaching people where they are because of the ubiquity of hand-held devices. Mobile is being used as both a primary tool in workforce development programming and as a complementary tool to enhance or reinforce content and interaction happening via other means such as web, face-to-face, and radio.

Reaching girls and women. Mobile can reach girls and young women with services and information they cannot normally get, helping them access the opportunities, skills, and information they need to better position them for work. Mobile job matching allows girls and young women to seek jobs without leaving the home. Micro-tasking (breaking up jobs into tiny tasks that can be done by a number of individuals, eg.,  via a mobile phone) offers a way for girls and young women from slum areas, those not able to work outside of the home, and those pulled out of difficult situations like sexual exploitation; to access entry-level work and gain experience that can help them quickly move to better jobs. Some 75% of women doing microtasking with Samasource move on to better jobs within 6 months, for example.

Getting geographically relevant information out to youth. Mobile can help spread information about opportunities to formerly unreached locations. In many places, jobs and scholarships exist, but they are promoted in places where youth do not see them. Mobile social networks can reach youth and connect them, based on their profiles and skill sets, to opportunities in their own geographical area, helping change the idea that youth have to move to the city in order to find work.

Strengthening soft and hard skills. Using mobile applications, gaming and quizzes, youth can work through career pathfinders in a fun way, find out what they like and what they are good at, and begin learning how to plan a career and what types of courses or preparation they need to achieve goals. They can also learn about savings and create savings plans for items they want to purchase, meanwhile making commitments to give up habits like smoking in order to put their limited resources towards other goals. Applications that reinforce basic literacy and numeracy, such as EDC’s Stepping Stone, help girls and young women strengthen the skills they need to move to a higher level of training or to access additional mobile-based information or engage in communications that help improve their livelihoods.

Lowering barriers to entry. Mobile offers a lower barrier to entry than more traditional ICTs. Mobile web has made it easier for many people to get online, especially in rural areas where people often have to be transported to centralized places in order to access desktop computers and broadband. Mobiles also require less electricity than desktop computers, a big plus in rural areas. One participant noted that an iPad costs only $400 vs a desktop that costs much more and requires more expertise and resources to set up and maintain. Tools available today make it easier for non-experts to create mobile applications. The challenge is getting over inertia and allowing kids to play and experiment.

Designing mobile workforce development programs with and for girls and young women

Even with all these benefits, however, mobile may not always be the best tool because access to information and content delivery does not resolve deeper gender-related issues. Salon attendees offered some insights on ways to make mYWD programs more inclusive of and adapted to the needs of girls and women.

Addressing underlying gender issues. Girls and young women may find a scholarship or a job via mobile but for various reasons, such as controlled mobility or cultural or resource restrictions, they may not be able to take advantage of it. When working with girls and women, underlying issues are central, for example, past trauma, self-esteem, self-doubt and the question “will I ever be good enough.” Organizations can talk this through with girls and women via a mobile phone or online chat, but in truth it’s a much a deeper issue than a cellphone can solve. Corollary and holistic programs are needed to respond to these broader issues in order to have real, in-depth and lasting impact.

Making mYWD programs accessible to girls and young womenWorkforce development programs need to be designed in ways that fit the lives of the girls and women they aim to support. For example,  training needs to happen at a time when women are more able to participate, such as after breakfast and before lunch when the children are at school and the husband is not back yet. Child care may need to be provided. It’s also critical to understand the dynamics of husbands and mothers-in-law who often want to know what young women are doing at all times. Some women may be happy to conceal the fact that they are participating in training, but programs should help women and girls gauge their potential risks. Another strategy is working with husbands and men to generate buy-in so that girls and women can participate in different labor market-related activities. In some cases negative reactions from fathers and husbands deter girls and women from participating or cause them to drop out. Eg.: “I make more money and my husband takes it and he drinks more, and then he beats me more.” The many precise cultural and social issues around gender and mobile require more research. Talking with girls and young women about these barriers and ensuring programs take them into account is an important part of the design process.

Remembering that women and girls are often the last to own phones. GSMA research found that there is indeed a mobile gender gap. Though there may be a high level of mobile penetration at the household level, often it’s the husband, then the first-born son who get a phone, and only afterward that perhaps a daughter or a wife get one — and this scenario is in wealthier households where there are multiple devices. For most families in emerging economies, there is only one or possibly two phones per household, and women and girls only have access to the phone when the man of the house gives it to them. This does vary from country to country, but overall, women are less active and with less access to mobile devices. This is a critical gap if organizations wish to involve girls and young women in mobile-based programs. Knowing the audience, population and context and designing information and communication strategies and workforce development programs that use a variety of channels (traditional and new media as well as face-to-face) to reach girls and women can help avoid marginalizing or not reaching those without mobile access.

Finding the incentive base for men. In many emerging markets, work needs to be done to discover what might incentivize men to allow girls and women to access mobile phones and/or to participate in workforce development activities. Sometimes it is money, but not always. Men may not want women and daughters working or earning money. In Afghanistan, for example, the CEO of the mobile network operator would sit with the men in the households and discuss the idea of women and girls having mobile phones. As part of one program that trained women for work, transportation services were set up just for women. It is important to meet people where they are in terms of cultural barriers and not try to shift things too quickly or all at once or there can be serious backlash.

Encouraging girls and young women to enter high growth sectors. Age-old gender frameworks are still at play and many girls and young women are not interested in entering certain high growth sectors, such as technology. This is a worldwide hurdle in terms of positioning girls and young women for the new jobs being created in these sectors, not just something that happens in ‘developing’ countries. Some programs are reaching out specifically to girls and young women to teach them to code and to break down the idea that only boys and men are smart enough to do it. Encouraging girls and women to see the world by accessing Internet via the mobile web and connecting with other girls and women this way can also be hugely transformative. Communication and marketing can play a role in helping girls and women see the world as it could be, if there were gender parity, and planting a seed that helps girls and young women see the possibilities of their own impact in the world. Enabling girls and young women to create, not just consume content, can change the status quo.

Mobile as a complementary tool, not a replacement.  Mobile can resolve some information and communication aspects, however, in the case of girls and young women, resource-intensive services are often the most needed and the most important, and these cannot always be done via a device. Mentoring and networking, for example, have shown to be highly valued by girls and women. These need to be more than a quick check-in however; they should be strong, active and consistent relationships of support. Some organizations are doing interesting work with mentoring but even with the added benefits of mobile technology, efficient and cost-effective ways to support quality mentoring at scale have not been fully worked out yet.

Data and research

There is a dearth of data around how girls and women use mobiles. Research has been done in some contexts with women at the base of the pyramid, but in many cases it’s difficult to apply conclusions across contexts. Evidence on what works, what is sustainable, and what can effectively scale is missing.

Understanding the meaning of mobile for girls and women. There is a need for more research on women’s ownership and use of devices, and a better understanding of what these devices mean to girls and women in their daily lives, in their family dynamics and with regard to their purchasing habits. In one country, 40% of women interviewed said they didn’t like text messaging, but this may not carry over to other countries or to girls and younger women. Women in one survey in Uganda said they didn’t like borrowing a phone because it meant they would owe a favor to the woman they borrowed it from — this breaks with assumptions that mobiles are freely shared in communities and everyone can access them. In Papua New Guinea, women surveyed in a micro-tasking project said that what they most liked about having mobile access was not the work opportunity, it was being able to call and arrange dinner time with their husband so they would not be beaten if he came home early and it was not ready.

Gaps in gender and age disaggregated data. The huge gap in gender and age disaggregated data on mobile ownership and use is a huge impediment in terms of going to scale. Donor organizations and governments often ask, “Where is the data that shows me this works?” Using mobile for different programs is a big shift for most countries and organizations. It requires behavior change and large investments, and so decision-makers logically want to know if it works. Some organizations avoid working with government as it can slow down processes. Others argue that government buy-in and support are vital to achieving scale and sustainability and that government plays an important role in reducing tariffs and establishing regulations that favor mobile for development initiatives.

One discussant recommended: “Do your baseline. Track your data. Share your data. Share your failures. Collect gender and age disaggregated data.” Large research firms are starting to set up these data but they are for the most part proprietary and are not available to those working in development. Organizations like CGI could use their influence to encourage firms and companies to share some parts of their data. Going beyond micro-level pairing of people with jobs to the use of mobile data at scale to look at development trends could be hugely beneficial.

In summary, more needs to be done to better understand the intersecting areas of gender, mobile technology, and youth workforce development programming. Further reading and resources compiled to complement the Salon are available here.

The Technology Salon methodology was used for the session, including Chatham House Rule, therefore no attribution has been made in this summary post. Sign up here to receive notifications about upcoming Salons in New York, Nairobi, San Francisco, London and Washington, DC. 

Visit the Mobiles and Youth Workforce Development Working Group page and sign up to receive information on mYWD Learning Series Events and the upcoming mYWD Landscape Review, due out in July 2013.

Read Full Post »

At the Community of Evaluators’ Evaluation Conclave last week, Jill Hannon from Rockefeller Foundation’s Evaluation Office and I organized a session on ICTs for Monitoring and Evaluation (M&E) as part of our efforts to learn what different organizations are doing in this area and better understand some of the challenges. We’ll do a couple of similar sessions at the Catholic Relief Services ICT4D Conference in Accra next week, and then we’ll consolidate what we’ve been learning.

Key points raised at this session covered experiences with ICTs in M&E and with ICT4D more generally, including:

ICTs have their advantages, including ease of data collection (especially as compared to carrying around paper forms); ability to collect and convey information from a large and diversely spread population through solutions like SMS; real-time or quick processing of information and ease of feedback; improved decision-making; and administration of large programs and funding flows from the central to the local level.

Capacity is lacking in the use of ICTs for M&E. In the past, the benefits of ICTs had to be sold. Now, the benefits seem to be clear, but there is not enough rigor in the process of selecting and using ICTs. Many organizations would like to use ICT but do not know how or whom to approach to learn. A key struggle is tailoring ICTs to suit M&E needs and goals and ensuring that the tools selected are the right ones for the job and the user. Organizations have a hard time deciding whether it is appropriate to use ICTs, and once they decide, they have trouble determining which solutions are right for their particular goals. People commonly start with the technology, rather than considering what problem they want the technology to help resolve. Often the person developing the M&E framework does not understand ICT, and the person developing the ICT does not understand M&E. There is need to further develop the capacities of M&E professionals who are using ICT systems. Many ICT solutions exist but organizations don’t know what questions to ask about them, and there is not enough information available in an easily understandable format to help them make decisions.

Mindsets can derail ICT-related efforts. Threats and fears around transparency can create resistance among employees to adopt new ICT tools for M&E. In some cases, lack of political makes it difficult to bring about institutional change. Earlier experiences of failure when using ICTs (eg, stolen or broken PCs or PDAs) can also ruin the appetite for trying ICTs again. One complaint was that some government employees nearing retirement age will participate in training as a perk or to collect per diem, yet be uninterested in actually learning any new ICT skills. This can take away opportunities from younger staff who may have a real interest in learning and implementing new approaches.

Privacy needs further study and care. It is not clear whether those who provide information through Internet, SMS, etc., understand how it is going to be used and organizations often do not do a good job of explaining. Lack of knowledge and trust in the privacy of their responses can affect willingness or correctness of responses. More effort needs to be made to guarantee privacy and build trust. Technological solutions to privacy such as data encryption can be implemented, but human behavior is likely the bigger challenge. Paper surveys with sensitive information often get piled up in a room where anyone could see them. In the same way, people do not take care with keeping data collected via ICTs safe; for example, they often share passwords. Organizations and agencies need to take privacy more seriously.

Internal Review Boards (IRBs) are missing in smaller organizations. Normally an IRB allows a researcher to be sure that a survey is not personal or potentially traumatizing, that data encryption is in place, and that data are sanitized. But these systems are usually not established in small, local organizations — they only exist in large organizations — leaving room for ethics breaches.

Information flows need quite a lot of thought, as unintended consequences may derail a project. One participant told of a community health initiative that helped women track their menstrual cycles to determine when they were pregnant. The women were sent information and reminders through SMS on prenatal care. The program ran into problems because the designers did not take into account that some women would miscarry. Women who had miscarried got reminders after their miscarriage, which was traumatic for them. Another participant gave an example of a program that publicized the mobile number of a staff member at a local NGO that supported women victims of violence so that women who faced violence could call to report it. The owner of the mobile phone was overwhelmed with the number of calls, often at night, and would switch the mobile off, meaning no response was available to the women trying to report violence. The organization therefore moved to IVR (interactive voice response), which resolved the original problem, however, with IVR, there was no response to the women who reported violence.

Research needs to be done prior to embarking on use of ICTs. A participant working with women in rural areas mentioned that her organization planned to use mobile games for an education and awareness campaign. They conducted research first on gender roles and parity and found that actually women had no command over phones. Husbands or sons owned them and women had access to them only when the men were around, so they did not proceed with the mobile games aspect of the project.

Literacy is an issue that can be overcome. Literacy is a concern, however there are many creative solutions to overcome literacy challenges, such as the use of symbols. A programme in an urban slum used symbols on hand-held devices for a poverty and infrastructure mapping exercise. In Nepal, an organization tried using SMS weather reports, but most people did not have mobiles and could not read SMS. So the organization instead sent an SMS to a couple of farmers in the community who could read, and who would then draw weather symbols on a large billboard. IVR is another commonly used tool in South Asia.

Qualitative data collection using ICTs should not be forgotten. There is often a focus on surveys, and people forget about the power of collecting qualitative data through video, audio, photos, drawings on mobiles and tablets and other such possibilities. A number of tools can be used for participatory monitoring and evaluation processes. For example, baseline data can be collected through video. tagging can be used to help sort content., video and audio files can be linked with text, and change and decision-making can be captured through video vignettes. People can take their own photos to indicate importance or value. Some participatory rural appraisal techniques can be done on a tablet with a big screen. Climate change and other visual data can be captured with tablets or phones or through digital maps. Photographs and GPS are powerful tools for validation and authentication, however care needs to be taken when using maps with those who may not easily orient themselves to an aerial map. One caution is that some of these kinds of initiatives are “boutique” designs that can be quite expensive, making scale difficult. As android devices and tablets become increasingly cheaper and more available, these kinds of solutions may become easier to implement.

Ubiquity and uptake are not the same thing. Even if mobile phones are “everywhere” it does not mean people will use them to do what organizations or evaluators want them to do. This is true for citizen feedback programs, said one participant, especially when there is a lack of response to reports. “It’s not just an issue of literacy or illiteracy, it’s about culture. It’s about not complaining, about not holding authorities accountable due to community pressures. Some people may not feed back because they are aware of the consequences of complaining and this goes beyond simple access and use of technology.” In addition, returning collected data to the community in a format they can understand and use for their own purposes is important. A participant observed that when evaluators go to the community to collect data for baseline, outcome, impact, etc., from a moral standpoint it is exploitative if they do not report the findings back to the community. Communities are not sure of what they get back from the exercise and this undermines the credibility of the feedback mechanism. Unless people see value in participation, they will not be willing to give their information or feedback. However, it’s important to note that responses to citizen or beneficiary feedback can also skew beneficiary feedback. “When people imagine a response will get them something, their feedback will be based on what they expect to get.”

There has not been enough evaluation of ICT-enabled efforts. A participant noted that despite apparent success, there are huge challenges with the use of ICTs in development initiatives: How effective has branchless banking been? How effective is citizen feedback? How are we evaluating the effectiveness of these ICT tools? And what about how these programs impact on different stakeholders? Some may be excited by these projects, whereas others are threatened.

Training and learning opportunities are needed. The session ended, yet the question of where evaluators can obtain additional guidance and support for using ICTs in M&E processes lingered. CLEAR South Asia has produced a guide on mobile data collection, and we’ll be on the lookout for additional resources and training opportunities to share, for example this series of reports on Mobile Data Collection in Africa from the World Wide Web Foundation or this online course Using ICT Tools for Effective Monitoring, Impact Evaluation and Research available through the Development Cafe.

Thanks to Mitesh Thakkar from Fieldata, Sanjay Saxena from Total Synergy Consulting, Syed Ali Asjad Naqvi from the Center for Economic Research in Pakistan (CERP) and Pankaj Chhetri from Equal Access Nepal for participating as lead discussants at the session; Siddhi Mankad from Catalyst Management Services Pvt. Ltd for serving as rapporteur; and Rockefeller Foundation’s Evaluation Office for supporting this effort.

We used the Technology Salon methodology for the session, including Chatham House Rule, therefore no attribution has been made in this summary post.

Other sessions in this series of Salons on ICTs and M&E:

12 tips on using ICTs for social monitoring and accountability

11 points on strengthening local capacity to use new ICTs for M&E

10 tips on using new ICTs for qualitative M&E

In addition, here’s a post on how War Child Uganda is using participatory video for M&E

Read Full Post »

« Newer Posts - Older Posts »