Feeds:
Posts
Comments

Posts Tagged ‘ICT’

Screen Shot 2013-11-23 at 6.14.40 PM

Migration has been a part of the human experience since the dawn of time, and populations have always moved in search of resources and better conditions. Today, unaccompanied children and youth are an integral part of national and global migration patterns, often leaving their place of origin due to violence, conflict, abuse, or other rights violations, or simply to seek better opportunities for themselves.

It is estimated that 33 million (or some 16 percent) of the total migrant population today is younger than age 
20. Child and adolescent migrants make up a significant proportion of the total population of migrants in Africa (28 percent), Asia (21 percent), Oceania (11 percent), Europe (11 percent), and the Americas (10 percent).

The issue of migration is central to the current political debate as well as to the development discussion, especially in conversations about the “post 2015” agenda. Though many organizations are working to improve children’s well-being in their home communities, prevention work with children and youth is not likely to end migration. Civil society organizations, together with children and youth, government, community members, and other stakeholders can help make migration safer and more productive for those young people who do end up on the move.

As the debate around migration rages, access to and use of ICTs is expanding exponentially around the globe. For this reason Plan International USA and the Oak Foundation felt it was an opportune time to take stock of the ways that ICTs are being used in the child and youth migration process.

Our new report, “Modern Mobility: the role of ICTs in child and youth migration” takes a look at:

  • how children and youth are using ICTs to prepare for migration; to guide and facilitate their journey; to keep in touch with families; to connect with opportunities for support and work; and to cope with integration, forced repatriation or continued movement; and
  • how civil society organizations are using ICTs to facilitate and manage their work; to support children and youth on the move; and to communicate and advocate for the rights of child and youth migrants.

In the Modern Mobility paper, we identify and provide examples of three core ways that child and youth migrants are using new ICTs during the different phases of the migration process:

  1. for communicating and connecting with families and friends
  2. for accessing information
  3. for accessing services

We then outline seven areas where we found CSOs are using ICTs in their work with child and youth migrants, and we offer some examples:

Ways that CSOs are using ICTs in their work with child and youth migrants.

Ways that CSOs are using ICTs in their work with child and youth migrants.

Though we were able to identify some major trends in how children and youth themselves use ICTs and how organizations are experimenting with ICTs in programming, we found little information on the impact that ICTs and ICT-enabled programs and services have on migrating children and youth, whether positive or negative. Most CSO practitioners that we talked with said that they had very little awareness of how other organizations or initiatives similar to their own were using ICTs. Most also said they did not know where to find orientation or guidance on good practice in the use of ICTs in child-centered programming, ICTs in protection work (aside from protecting children from online risks), or use of ICTs in work with children and young people at various stages of migration. Most CSO practitioners we spoke with were interested in learning more, sharing experiences, and improving their capacities to use ICTs in their work.

Based on Plan Finland’s “ICT-Enabled Development Guide” (authored by Hannah Beardon), the Modern Mobility report provides CSOs with a checklist to support thinking around the strategic use of ICTs in general.

ICT-enabled development checklist developed by Hannah Beardon for Plan International.

ICT-enabled development checklist developed by Hannah Beardon for Plan International.

We also offer a list of key considerations for practitioners who wish to incorporate new technologies into their work, including core questions to ask about access, age, capacity, conflict, connectivity, cost, disability, economic status, electricity, existing information ecosystems, gender, information literacy, language, literacy, power, protection, privacy, sustainability, and user-involvement.

Our recommendation for taking this area forward is to develop greater awareness and capacity among CSOs regarding the potential uses and risks of ICTs in work with children and youth on the move by:

  1. Establishing an active community of practice on ICTs and children and youth on the move.
  2. Mapping and sharing existing projects and programs.
  3. Creating a guide or toolbox on good practice for ICTs in work with children and youth on the move.
  4. Further providing guidance on how ICTs can help “normal” programs to reach out to and include children and youth on the move.
  5. Further documentation and development of an evidence base.
  6. Sharing and distributing this report for discussion and action.

Download the Modern Mobility report here.

We’d love comments and feedback, and information about examples or documentation/evidence that we did not come across while writing the report!

Read Full Post »

At the November 8th Technology Salon in New York City, we looked at the role of ICTs in communication for development (C4D) initiatives with marginalized adolescent girls. Lead discussants Kerida McDonald and Katarzyna Pawelczyk discussed recent UNICEF reports related to the topic, and John Zoltner spoke about FHI360’s C4D work in practice.

To begin, it was pointed out that C4D is not donor communications or marketing. It is the use of communication approaches and methodologies to achieve influence at various levels —  e.g., family, institutional and policy —  to change behavior and social norms. C4D is one approach that is being used to address the root causes of gender inequality and exclusion.

Screen Shot 2013-10-11 at 7.24.48 AMAs the UNICEF report on ICTs and C4D* notes, girls may face a number of situations that contribute to and/or are caused by their marginalization: early pregnancy, female genital cutting, early marriage, high rates of HIV/AIDS, low levels of education, lack of control over resources. ICTs alone cannot resolve these, because there is a deep and broad set of root causes. However, ICTs can be integrated systematically into the set of C4D tools and approaches that contribute to positive change.

Issues like bandwidth, censorship and electricity need to be considered when integrating ICTs into C4D work, and approaches that fit the context need to be developed. Practitioners should use tools that are in the hands of girls and their communities now, yet be aware of advances in access and new technologies, as these change rapidly.

Key points:

Interactivity is more empowering than one-way messaging:  Many of the ICT solutions being promoted today focus on sending messages out via mobile phones. However C4D approaches aim for interactivity and multi-channel, multi-directional communication, which has proven more empowering.

Content: Traditional media normally goes through a rigorous editorial process and it is possible to infuse it with a gender balance. Social media does not have the same type of filters, and it can easily be used to reinforce stereotypes about girls. This is something to watch and be aware of.

Purpose: It’s common with ICT-related approaches to start with the technology rather than starting with the goals. As one Salon participant asked “What are the results we want to see for ourselves? What are the results that girls want to see? What are the root causes of discrimination and how are we trying to address them? What does success look like for girls? For organizations? Is there a role for ICTs in helping achieve success? If so, what is it?” These questions need to be the starting point, rather than the technology.

Participation: One Salon participant mentioned a 2-year project that is working together with girls to define their needs and their vision of success. The process is one co-design, and it is aimed at understanding what girls want. Many girls expressed a feeling of isolation and desire for connection, and so the project is looking at how ICTs can help them connect. As the process developed, the diversity of needs became very clear and plans have changed dramatically based on input from a range of girls from different contexts. Implementors need to be prepared to change, adapt and respond to what girls say they want and to local realities.

****

Screen Shot 2013-11-23 at 10.41.22 PMA second study commissioned by UNICEF explores how young people use social media. The researchers encountered some challenges in terms of a strong gender approach for the study. Though a gender lens was used for analysis, there is little available data disaggregated by sex. The study does not focus on the most marginalized, because it looks at the use of social media, which normally requires a data connection or Internet access, which the most marginalized youth usually do not have.

The authors of the report found that youth most commonly used the Internet and social media for socializing and communicating with friends. Youth connected less often for schoolwork. One reason for this may be that in the countries/contexts where the research took place, there is no real integration of ICTs into the school system. It was emphasized that the  findings in the report are not comparable or nationally representative, and blanket statements such as “this means x for the whole developing world” should be avoided.

Key points:

Self-reporting biases. Boys tend to have higher levels of confidence and self-report greater ICT proficiency than girls do. This may skew results and make it seem that boys have higher skill levels.

Do girls really have less access? We often hear that girls have less access than boys. The evidence gathered for this particular report found that “yes and no.” In some places, when researchers asked “Do you have access to a mobile,” there was not a huge difference between urban and rural or between boys and girls. When they dug deeper, however, it became more complex. In the case of Zambia, access and ownership were similar for boys and girls, but fewer girls were connecting at all to the Internet as compared to boys. Understanding connectivity and use was quite complicated.

What are girls vs. boys doing online? This is an important factor when thinking about what solutions are applicable to which situation(s). Differences came up here in the study. In Argentina, girls were doing certain activities more frequently, such as chatting and looking for information, but they were not gaming. In Zambia, girls were doing some things less often than boys; for example, fewer girls than boys were looking for health information, although the number was still significant. A notable finding was that both girls and boys were accessing general health information more often than they were accessing sensitive information, such as sexual health or mental health.

What are the risks in the online world? A qualitative portion of the study in Kenya used focus groups with girls and boys, and asked about their uses of social media and experience of risk. Many out-of-school girls aged 15-17 reported that they used social media as a way to meet a potential partner to help them out of their financial situation. They reported riskier behavior, contact with older men, and relationships more often than girls who were in school. Girls in general were more likely to report unpleasant online encounters than boys, for example, request for self-exposure photos.

Hiding social media use. Most of the young people that researchers spoke with in Kenya were hiding social media use from their parents, who disapproved of it. This is an important point to note in C4D efforts that plan on using social media, and program designers will want to take parental attitudes about different media and communication channels into consideration as they design C4D programs.

****

When implementing programs, it is noteworthy how boys and girls tend to use ICT and media tools. Gender issues often manifest themselves right away. “The boys grab the cameras, the boys sit down first at the computers.” If practitioners don’t create special rules and a safe space for girls to participate, girls may be marginalized. In practical ICT and media work, it’s common for boys and girls to take on certain roles. “Some girls like to go on camera, but more often they tend to facilitate what is being done rather than star in it.” The gender gap in ICT access and use, where it exists, is a reflection of the power gaps of society in general.

In the most rural areas, even when people have access, they usually don’t have the resources and skills to use ICTs.  Very simple challenges can affect girls’ ability to participate in projects, for example, oftentimes a project will hold training at times when it’s difficult for girls to attend. Unless someone systematically goes through and applies a gender lens to a program, organizations often don’t notice the challenges girls may face in participating. It’s not enough to do gender training or measure gender once a year; gendered approaches needs to be built into program design.

Long-terms interventions are needed if the goal is to emancipate girls, help them learn better, graduate, postpone pregnancy, and get a job. This cannot be done in a year with a simple project that has only one focus, because girls are dealing with education, healthcare, and a whole series of very entrenched social issues. What’s needed is to follow a cohort of girls and to provide information and support across all these sectors over the long-term.

Key points:

Engaging boys and men: Negative reactions from men are a concern if and when girls and women start to feel more empowered or to access resources. For example, some mobile money and cash transfer programs direct funds to girls and women, and some studies have found that violence against women increases when women start to have more money and more freedom. Another study, however, of a small-scale effort that provides unconditional cash transfers to girls ages 18-19 in rural Kenya, is demonstrating just the opposite: girls have been able to say where money is spent and the gender dynamics have improved. This raises the question of whether program methodologies need to be oriented towards engaging boys and men and involving them in changing gender dynamics, and whether engaging boys and men can help avoid an increase in violence. Working with boys to become “girl champions” was cited as a way to help to bring boys into the process as advocates and role models.

Girls as producers, not just consumers. ICTs are not only tools for sending content to girls. Some programs are working to help girls produce content and create digital stories in their own languages. Sometimes these stories are used to advocate to decision makers for change in favor of girls and their agendas. Digital stories are being used as part of research processes and to support monitoring, evaluation and accountability work through ‘real-time’ data.

ICTs and social accountability. Digital tools are helping young people address accountability issues and inform local and national development processes. In some cases, youth are able to use simple, narrow bandwidth tools to keep up to date on actions of government officials or to respond to surveys to voice their priorities. Online tools can also lead to offline, face-to-face engagement. One issue, however, is that in some countries, youth are able to establish communication with national government ministers (because there is national-level capacity and infrastructure) but at local level there is very little chance or capability for engagement with elected officials, who are unprepared to respond and engage with youth or via social media. Youth therefore tend to bypass local government and communicate with national government. There is a need for capacity building at local level and decentralized policies and practices so that response capacity is strengthened.

Do ICTs marginalize girls? Some Salon participants worried that as conversations and information increasingly move to a digital environment, ICTs are magnifying the information and communication divide and further marginalizing some girls. Others felt that the fact that we are able to reach the majority of the world’s population now is very significant, and the inability to reach absolutely everyone doesn’t mean we should stop using ICTs. For this very reason – because sharing of information is increasingly digital – we should continue working to get more girls online and strengthen their confidence and abilities to use ICTs.

Many thanks to UNICEF for hosting the Salon!

(Salons operate under Chatham House Rule, thus no attribution has been given in the above summary. Sign up here if you’d like to attend Salons in the future!)

*Disclosure: I co-authored this report with Keshet Bachan.

Read Full Post »

Screen Shot 2013-10-11 at 7.24.48 AMA paper that Keshet Bachan and I authored for Unicef is now available for your reading pleasure!

Here’s a  summary of what we talk about in the paper:

Social, cultural, economic and political traditions and systems that prevent girls, especially the most marginalized, from fully achieving their rights present a formidable challenge to development organizations. The integration of new Information and Communication Technologies (ICTs) to the Communication for Development (C4D) toolbox offers an additional means for challenging unequal power relations and increasing participation of marginalized girls in social
transformation.

We examine ways that ICTs can strengthen C4D programming by:

  • enhancing girls’ connections, engagement and agency;
  • helping girls access knowledge; and
  • supporting improved governance and service delivery efforts.

We reflect and build on the views of adolescent girls from 13 developing countries who participated in a unique discussion for this paper, and we then provide recommendations to support the integration of ICTs in C4D work with marginalized adolescent girls, including:

  • Girls as active participants in program design. Practitioners should understand local context and ensure that programs use communication channels that are accessible to girls. This will often require multi-channel and multiple platform approaches that reach more marginalized girls who may not have access to or use of ICTs. Programs should be community driven, and real-time feedback from girls should be incorporated to adjust programs to their needs and preferences. Mentoring is a key component of programming with girls, and holistic programs designed together with girls tend towards being more successful.
  • Privacy and protection. Every program should conduct a thorough risk analysis of proposed approaches to ensure that girls are not placed at risk by participating, sharing and consuming information, or publicly holding others to account. Girls should also be supported to make their own informed choices about their online presence and use of ICT devices and platforms. A broader set of stakeholders should be engaged and influenced to help mitigate systemic and structural risks to girls.
  • Research and documentation. The evidence base for use of ICTs in C4D programming with marginalized adolescent girls is quite scarce. Better documentation would improve understanding of what programs are the most effective, and what the real added value of ICTs are in these efforts.
  • Capacity building. Because the integration of ICTs into C4D work is a relatively new area that lacks a consistent methodological framework, organizations should support a comprehensive training process for staff to cover areas such as program design, effective use of new ICT tools in combination with existing tools and methods, and close attention to privacy and risk mitigation.
  • Policy. Programs should use free and open source software. In addition, child protection policies, measures and guidelines should be updated to reflect changes in technology, platforms and information sharing.

The paper was first shared at the 12th Inter-Agency Roundtable on Communication for Development in November 2011. It was then reviewed and updated in August 2012, and released in August 2013 under the title “Integrating Information and Communication Technologies into Communication for Development Strategies to Support and Empower Marginalized Adolescent Girls.”

Download it here!

Read Full Post »

At Catholic Relief Services’ annual ICT4D meeting in March 2013, I worked with Jill Hannon from Rockefeller Foundation’s Evaluation Office to organize 3 sessions on the use of ICT for Monitoring and Evaluation (ICTME). The sessions covered the benefits (known and perceived) of using ICTs for M&E, the challenges and barriers organizations face when doing so, and some lessons and advice on how to integrate ICTs into the M&E process.

Our lead discussants in the three sessions included: Stella Luk (Dimagi), Guy Sharrack (CRS), Mike Matarasso (CRS), David McAfee (HNI/Datawinners), Mark Boots (Votomobile), and Teressa Trusty (USAID’s IDEA/Mobile Solutions). In addition, we drew from the experiences and expertise of some 60 people who attended our two round table sessions.

Benefits of integrating ICTs into the M&E process

Some of the potential benefits of integrating ICTs mentioned by the various discussants and participants in the sessions included:

  • More rigorous, higher quality data collection and more complete data
  • Reduction in required resources (time, human, money) to collect, aggregate and analyze data
  • Reduced complexity if data systems are simplified; thus increased productivity and efficiency
  • Combined information sources and types and integration of free form, qualitative data with quantitative data
  • Broader general feedback from a wider public via ICT tools like SMS; inclusion of new voices in the feedback process, elimination of the middleman to empower communities
  • Better cross-sections of information, information comparisons; better coordination and cross-comparing if standard, open formats are used
  • Trend-spotting with visualization tools
  • Greater data transparency and data visibility, easier data auditing
  • Real-time or near real-time feedback “up the chain” that enables quicker decision-making, adaptive management, improved allocation of limited resources based on real-time data, quicker communication of decisions/changes back to field-level staff, faster response to donors and better learning
  • Real-time feedback “down the ladder” that allows for direct citizen/beneficiary feedback, and complementing of formal M&E with other social monitoring approaches
  • Scale, greater data security and archiving, and less environmental impact
  • Better user experience for staff as well as skill enhancement and job marketability and competitiveness of staff who use the system

Barriers and challenges of integrating ICTs into M&E processes

A number of challenges and barriers were also identified, including:

  • A lack of organizational capacity to decide when to use ICTs in M&E, for what, and why, and deciding on the right ICT (if any) for the situation. Organizations may find it difficult to get beyond collecting the data to better use of data for decision-making and coordination. There is often low staff capacity, low uptake of ICT tools and resistance to change.
  • A tendency to focus on surveys and less attention to other types of M&E input, such as qualitative input. Scaling analysis of large-scale qualitative feedback is also a challenge: “How do you scale qualitative feedback to 10,000 people or more? People can give their feedback in a number of languages by voice. How do you mine that data?”
  • The temptation to offload excessive data collection to frontline staff without carefully selecting what data is actually going to be used and useful for them or for other decision-makers.
  • M&E is often tacked on at the end of a proposal design. The same is true for ICT. Both ICT and M&E need to be considered and “baked in” to a process from the very beginning.
  • ICT-based M&E systems have missed the ball on sharing data back. “Clinics in Ghana collect a lot of information that gets aggregated and moved up the chain. What doesn’t happen is sharing that information back with the clinic staff so that they can see what is happening in their own clinic and why. We need to do a better job of giving information back to people and closing the loop.” This step is also important for accountability back to communities. On the whole, we need to be less extractive.
  • Available tools are not always exactly right, and no tool seems to provide everything an organization needs, making it difficult to choose the right tool. There are too many solutions, many of which are duplicative, and often the feature sets and the usability of these tools are both poor. There are issues with sustainability and ongoing maintenance and development of M&E platforms.
  • Common definitions for data types and standards for data formatting are needed. The lack of interoperability among ICT solutions also causes challenges. As a field, we don’t do enough linking of systems together to see a bigger picture of which programs are doing what, where and who they are impacting and how.
  • Security and privacy are not adequately addressed. Many organizations or technology providers are unaware of the ethical implications of collecting data via new tools and channels. Many organizations are unclear about the ethical standards for research versus information that is offered up by different constituents or “beneficiaries” (eg., information provided by people participating in programs that use SMS or collect information through SMS-based surveys) versus monitoring and evaluation information. It is also unclear what the rules are for information collected by private companies, who this information can be shared with and what privacy laws mean for ICT-enabled M&E and other types of data collection. If there are too many barriers to collecting information, however, the amount of information collected will be reduced. A balance needs to be found. The information that telecommunications companies hold is something to think about when considering privacy and consent issues, especially in situations of higher vulnerability and risk. (UNOCHA has recently released a report that may be useful.)
  • Not enough is understood about motivation and incentive for staff or community members to participate or share data. “Where does my information go? Do I see the results? Why should I participate? Is anyone responding to my input?” In addition, the common issues of cost, access, capacity, language, literacy, cultural barriers are very much present in attempts to collect information directly from community members. Another question is that of inclusion: Does ICT-enabled data collection or surveying leave certain groups out? (See this study on intrinsic vs extrinsic motivation for feedback.)
  • Donors often push or dictate the use of ICT when it’s perhaps not the most useful for the situation. In addition there is normally not enough time during proposal process for organizations to work on buy-in and good design of an ICT-enabled M&E system. There is often a demand from the top for excessive data collection without an understanding of the effort required to collect it, and time/resource trade-offs for excessive data collection when it leads to less time spent on program implementation. “People making decisions in the capital want to add all these new questions and information and that can be a challenge… What data are valuable to collect? Who will respond to them? Who will use them as the project goes forward?”
  • There seems to be a focus on top-down, externally created solutions rather than building on local systems and strengths or supporting local organizations or small businesses to strengthen their ICTME capacities. “Can strengthening local capacity be an objective in its own right? Are donors encouraging agencies to develop vertical ICTME solutions without strengthening local systems and partners?”
  • Results-based, data-based focus can bias the countable, leave out complex development processes with more difficult to count/measure impacts.

Lessons and good practice for integrating ICTs into M&E processes

ICT is not a silver bullet – it presents its own set of challenges. But a number of good practices surfaced:

  • The use of ICTs for M&E is not just a technology issue, it’s a people and processes issue too, and it is important to manage the change carefully. It’s also important to keep an open mind that ICT4D to support M&E might not always be the best use of scarce resources – there may be more pressing priorities for a project. Getting influential people on your side to support the cause and help leverage funding and support is critical. It’s also important to communicate goals and objectives clearly, and provide incentives to make sure ICTs are successfully adopted. The trick is keeping up with technology advances to improve the system, but also keeping your eye on the ball.
  • When designing an ICTME effort, clarity of purpose and a holistic picture of the project M&E system are needed in order to review options for where ICT4D can best fit. Don’t start with the technology. Start with the M&E purpose and goals and focus on the business need, not the gadgets. Have a detailed understanding of M&E data requirements and data flows as a first step. Follow those with iterative discussions with ICT staff to specify the ICT4D solution requirements.
  • Select an important but modest project to start with and pilot in one location – get it right and work out the glitches before expanding to a second tier of pilots or expanding widely. Have a fully functional model to share for broad buy-in and collect some hard data during the pilot to convince people of adoption. The first ICT initiative will be the most important.  If it is successful, use of ICTs will likely spread throughout an organization.  If the first initiative fails, it can significantly push back the adoption of ICTs in general. For this reason, it’s important to use your best people for the first effort. Teamwork and/or new skill sets may be required to improve ICT-enabled M&E. The “ICT4D 2.0 Manifesto” talks about a tribrid set of skills needed for ICT-enabled programs.
  • Don’t underestimate the need for staff training and ongoing technical assistance to ensure a positive user experience, particularly when starting out. Agencies need to find the right balance between being able to provide support for a limited number of ICT solutions versus the need to support ongoing local innovation.  It’s also important to ask for help when needed.  The most successful M&E projects are led by competent managers who seek out resources both inside and outside their organizations.
  • Good ICT-enabled M&E comes from a partnership between program, M&E and ICT staff, technical support internal and external to the organization. Having a solid training curriculum and a good help desk are important. In addition, in-built capacity for original architecture design and to maintain and adjust the system is a good idea. A lead business owner and manager for the system need to be in place as well as global and local level pioneers and strong leadership (with budget!) to do testing and piloting. At the local level, it is important to have an energetic and savvy local M&E pioneer who has a high level of patience and understands technology.
  • At the community level, a key piece is understanding who you need to hear from for effective M&E and ensuring that ICT tools are accessible to all. It’s also critical to understand who you are ignoring or not reaching with any tool or process. Are women and children left out? What about income level? Those who are not literate?
  • Organizations should also take care that they are not replacing or obliterating existing human responsibilities for evaluation. For example, at community level in Ghana, Assembly Members have the current responsibility for representing citizen concerns. An ICT-enabled feedback loop might undermine this responsibility if it seeks direct-from-citizen evaluation input.  The issue of trust and the human-human link also need consideration. ICT cannot and should not be a replacement for everything. New ICT tools can increase the number of people and factors evaluated; not just increase efficiency of existing evaluations.
  • Along the same lines, it’s important not to duplicate existing information systems, create parallel systems or fragment the government’s own systems. Organizations should be strengthening local government systems and working with government to use the information to inform policy and help with decision-making and implementation of programs.
  • implementors need to think about the direction of information flow. “Is it valuable to share results “upward” and “downward”? It is possible to integrate local decision-making into a system.” Systems can be created that allow for immediate local-level decision-making based on survey input. Key survey questions can be linked to indicators that allow for immediate discussion and solutions to improve service provision.
  • Also, the potential political and social implications of greater openness in information flows needs to be considered. Will local, regional and national government embrace the openness and transparency that ICTs offer? Are donors and NGOs potentially putting people at risk?
  • For best results, pick a feasible and limited number of quality indicators and think through how frontline workers will be motivated to collect the data. Excessive data collection will interfere with or impede service delivery. Make sure managers are capable of handling and analyzing data that comes in and reacting to it, or there is no point in collecting it. It’s important to not only think about what data you want, but how this data will be used. Real-time data collected needs to be actionable. Be sure that those submitting data understand what data they have submitted and can verify its accuracy. Mobile data collection needs to be integrated into real processes and feedback loops. People will only submit information or reports if they see that someone cares about those reports and does something about them.
  • Collecting data through mobile technology may change the behavior being monitored or tracked. One participant commented that when his organization implemented an ICT-based system to track staff performance, people started doing unnecessary activities so that they could tick off the system boxes rather than doing what they knew should be done for better program impact.
  • At the practical level, tips include having robust options for connectivity and power solutions, testing the technology in the field with a real situation, securing reduced costs with vendors for bulk purchasing and master agreements, using standard vendor tools instead of custom building. It’s good to keep the system simple, efficient and effective as possible and to avoid redundancy or the addition of features things that don’t truly offer more functionality.

Thanks to all our participants and lead discussants at the sessions!

Useful information and guides on ICTME:

Mobile-based technology for monitoring and evaluation: A reference guide for project managers, M&E specialists, researchers, donors

3 Reports on mobile data collection

Other posts on ICTs for M&E:

12 tips on using ICTs for social monitoring and accountability

11 points on strengthening local capacity to use new ICTs for M&E

10 tips on using new ICTs for qualitative M&E

Using participatory video for M&E

ICTs and M&E at the South Asia Evaluators’ Conclave

Read Full Post »

The March NYC Technology Salon offered an opportunity to discuss how mobile technology can transform workforce development and to hear how mobile is improving the reach and impact of existing initiatives working with girls and young women. Attendees also raised some of the acute, practical challenges and the deeper underlying issues that need to be overcome in order for girls and women to access and use mobile devices and to participate in workforce development programs and the labor market.

Conversation kicked off with comments from Kris Wiig (Samasource), Nancy Taggart (Education Development Center)  and Trina Das Gupta (former head of mWomen). The Salon was part of the Mobiles for Education Mobiles and Youth Workforce Development (mYWD) Working Group Learning Series, an initiative created in partnership with the MasterCard Foundation and USAID. The Salon was hosted at the offices of the Clinton Global Initiative.

The benefits of mobile vs stationary ICT for youth workforce development programs

Mobile holds a number of benefits over stationary ICT, including the feature of reaching people where they are because of the ubiquity of hand-held devices. Mobile is being used as both a primary tool in workforce development programming and as a complementary tool to enhance or reinforce content and interaction happening via other means such as web, face-to-face, and radio.

Reaching girls and women. Mobile can reach girls and young women with services and information they cannot normally get, helping them access the opportunities, skills, and information they need to better position them for work. Mobile job matching allows girls and young women to seek jobs without leaving the home. Micro-tasking (breaking up jobs into tiny tasks that can be done by a number of individuals, eg.,  via a mobile phone) offers a way for girls and young women from slum areas, those not able to work outside of the home, and those pulled out of difficult situations like sexual exploitation; to access entry-level work and gain experience that can help them quickly move to better jobs. Some 75% of women doing microtasking with Samasource move on to better jobs within 6 months, for example.

Getting geographically relevant information out to youth. Mobile can help spread information about opportunities to formerly unreached locations. In many places, jobs and scholarships exist, but they are promoted in places where youth do not see them. Mobile social networks can reach youth and connect them, based on their profiles and skill sets, to opportunities in their own geographical area, helping change the idea that youth have to move to the city in order to find work.

Strengthening soft and hard skills. Using mobile applications, gaming and quizzes, youth can work through career pathfinders in a fun way, find out what they like and what they are good at, and begin learning how to plan a career and what types of courses or preparation they need to achieve goals. They can also learn about savings and create savings plans for items they want to purchase, meanwhile making commitments to give up habits like smoking in order to put their limited resources towards other goals. Applications that reinforce basic literacy and numeracy, such as EDC’s Stepping Stone, help girls and young women strengthen the skills they need to move to a higher level of training or to access additional mobile-based information or engage in communications that help improve their livelihoods.

Lowering barriers to entry. Mobile offers a lower barrier to entry than more traditional ICTs. Mobile web has made it easier for many people to get online, especially in rural areas where people often have to be transported to centralized places in order to access desktop computers and broadband. Mobiles also require less electricity than desktop computers, a big plus in rural areas. One participant noted that an iPad costs only $400 vs a desktop that costs much more and requires more expertise and resources to set up and maintain. Tools available today make it easier for non-experts to create mobile applications. The challenge is getting over inertia and allowing kids to play and experiment.

Designing mobile workforce development programs with and for girls and young women

Even with all these benefits, however, mobile may not always be the best tool because access to information and content delivery does not resolve deeper gender-related issues. Salon attendees offered some insights on ways to make mYWD programs more inclusive of and adapted to the needs of girls and women.

Addressing underlying gender issues. Girls and young women may find a scholarship or a job via mobile but for various reasons, such as controlled mobility or cultural or resource restrictions, they may not be able to take advantage of it. When working with girls and women, underlying issues are central, for example, past trauma, self-esteem, self-doubt and the question “will I ever be good enough.” Organizations can talk this through with girls and women via a mobile phone or online chat, but in truth it’s a much a deeper issue than a cellphone can solve. Corollary and holistic programs are needed to respond to these broader issues in order to have real, in-depth and lasting impact.

Making mYWD programs accessible to girls and young womenWorkforce development programs need to be designed in ways that fit the lives of the girls and women they aim to support. For example,  training needs to happen at a time when women are more able to participate, such as after breakfast and before lunch when the children are at school and the husband is not back yet. Child care may need to be provided. It’s also critical to understand the dynamics of husbands and mothers-in-law who often want to know what young women are doing at all times. Some women may be happy to conceal the fact that they are participating in training, but programs should help women and girls gauge their potential risks. Another strategy is working with husbands and men to generate buy-in so that girls and women can participate in different labor market-related activities. In some cases negative reactions from fathers and husbands deter girls and women from participating or cause them to drop out. Eg.: “I make more money and my husband takes it and he drinks more, and then he beats me more.” The many precise cultural and social issues around gender and mobile require more research. Talking with girls and young women about these barriers and ensuring programs take them into account is an important part of the design process.

Remembering that women and girls are often the last to own phones. GSMA research found that there is indeed a mobile gender gap. Though there may be a high level of mobile penetration at the household level, often it’s the husband, then the first-born son who get a phone, and only afterward that perhaps a daughter or a wife get one — and this scenario is in wealthier households where there are multiple devices. For most families in emerging economies, there is only one or possibly two phones per household, and women and girls only have access to the phone when the man of the house gives it to them. This does vary from country to country, but overall, women are less active and with less access to mobile devices. This is a critical gap if organizations wish to involve girls and young women in mobile-based programs. Knowing the audience, population and context and designing information and communication strategies and workforce development programs that use a variety of channels (traditional and new media as well as face-to-face) to reach girls and women can help avoid marginalizing or not reaching those without mobile access.

Finding the incentive base for men. In many emerging markets, work needs to be done to discover what might incentivize men to allow girls and women to access mobile phones and/or to participate in workforce development activities. Sometimes it is money, but not always. Men may not want women and daughters working or earning money. In Afghanistan, for example, the CEO of the mobile network operator would sit with the men in the households and discuss the idea of women and girls having mobile phones. As part of one program that trained women for work, transportation services were set up just for women. It is important to meet people where they are in terms of cultural barriers and not try to shift things too quickly or all at once or there can be serious backlash.

Encouraging girls and young women to enter high growth sectors. Age-old gender frameworks are still at play and many girls and young women are not interested in entering certain high growth sectors, such as technology. This is a worldwide hurdle in terms of positioning girls and young women for the new jobs being created in these sectors, not just something that happens in ‘developing’ countries. Some programs are reaching out specifically to girls and young women to teach them to code and to break down the idea that only boys and men are smart enough to do it. Encouraging girls and women to see the world by accessing Internet via the mobile web and connecting with other girls and women this way can also be hugely transformative. Communication and marketing can play a role in helping girls and women see the world as it could be, if there were gender parity, and planting a seed that helps girls and young women see the possibilities of their own impact in the world. Enabling girls and young women to create, not just consume content, can change the status quo.

Mobile as a complementary tool, not a replacement.  Mobile can resolve some information and communication aspects, however, in the case of girls and young women, resource-intensive services are often the most needed and the most important, and these cannot always be done via a device. Mentoring and networking, for example, have shown to be highly valued by girls and women. These need to be more than a quick check-in however; they should be strong, active and consistent relationships of support. Some organizations are doing interesting work with mentoring but even with the added benefits of mobile technology, efficient and cost-effective ways to support quality mentoring at scale have not been fully worked out yet.

Data and research

There is a dearth of data around how girls and women use mobiles. Research has been done in some contexts with women at the base of the pyramid, but in many cases it’s difficult to apply conclusions across contexts. Evidence on what works, what is sustainable, and what can effectively scale is missing.

Understanding the meaning of mobile for girls and women. There is a need for more research on women’s ownership and use of devices, and a better understanding of what these devices mean to girls and women in their daily lives, in their family dynamics and with regard to their purchasing habits. In one country, 40% of women interviewed said they didn’t like text messaging, but this may not carry over to other countries or to girls and younger women. Women in one survey in Uganda said they didn’t like borrowing a phone because it meant they would owe a favor to the woman they borrowed it from — this breaks with assumptions that mobiles are freely shared in communities and everyone can access them. In Papua New Guinea, women surveyed in a micro-tasking project said that what they most liked about having mobile access was not the work opportunity, it was being able to call and arrange dinner time with their husband so they would not be beaten if he came home early and it was not ready.

Gaps in gender and age disaggregated data. The huge gap in gender and age disaggregated data on mobile ownership and use is a huge impediment in terms of going to scale. Donor organizations and governments often ask, “Where is the data that shows me this works?” Using mobile for different programs is a big shift for most countries and organizations. It requires behavior change and large investments, and so decision-makers logically want to know if it works. Some organizations avoid working with government as it can slow down processes. Others argue that government buy-in and support are vital to achieving scale and sustainability and that government plays an important role in reducing tariffs and establishing regulations that favor mobile for development initiatives.

One discussant recommended: “Do your baseline. Track your data. Share your data. Share your failures. Collect gender and age disaggregated data.” Large research firms are starting to set up these data but they are for the most part proprietary and are not available to those working in development. Organizations like CGI could use their influence to encourage firms and companies to share some parts of their data. Going beyond micro-level pairing of people with jobs to the use of mobile data at scale to look at development trends could be hugely beneficial.

In summary, more needs to be done to better understand the intersecting areas of gender, mobile technology, and youth workforce development programming. Further reading and resources compiled to complement the Salon are available here.

The Technology Salon methodology was used for the session, including Chatham House Rule, therefore no attribution has been made in this summary post. Sign up here to receive notifications about upcoming Salons in New York, Nairobi, San Francisco, London and Washington, DC. 

Visit the Mobiles and Youth Workforce Development Working Group page and sign up to receive information on mYWD Learning Series Events and the upcoming mYWD Landscape Review, due out in July 2013.

Read Full Post »

Learning to use a computer in Inhambane, Mozambique

Learning to use a computer in Inhambane, Mozambique

This is a slightly longer version of my Empowering Girls through Information, Communication and Technology, published in The Guardian’s Development Professional’s Network. A full article called “Why should you be holding a computer mouse when at the end of the day you will be holding a baby’s napkin?” was published in Redress, the Journal of the Association of Women Educators (Vol 21, No. 2, August 2012, pp 23-29.)

“Why should you be holding a computer mouse when at the end of the day you will be holding a baby’s napkin?”

This is the type of taunt a girl might hear when trying to sit in front of one of the computers at the school’s lab, said Fabiola, a young woman from Cameroon while speaking on a panel about girls, education, and new technologies at the 55th Session of the Commission on the Status of Women (CSW).

Fabiola was invited to the CSW to speak about her personal experiences as a girl studying a career in Science, Technology, Engineering and Math (STEM). Fabiola went on to share how her parents had been instrumental in encouraging her to pursue her studies, even though she was one of few girls who decided to go down the STEM path.

Unless you’ve been living under a rock, you’ll be quite aware that there has been an increasing emphasis in the development sector on girls and ICTs over the past few years. Everyone from large government donors to NGOs to the private sector is banking on girls and technologies, especially mobile phones, to play a big role in helping resolve poverty and make development gains.

Girls themselves consider ICTs to be a major element in their personal growth and development, useful for improving studies, staying informed and earning a living. Girls say that ICTs help them reduce their sense of isolation, acquire new skills, actively participate in national and global dialogues, learn about taboo subjects (such as reproductive health and HIV), feel safer and more in touch with family and friends, and strengthen self-esteem. They often credit participatory media and technology programs with helping them improve their ability to express themselves, speak in public, and to dialogue with adults and other decision makers to negotiate their needs and rights.

But what about access?

The flip side is that for many girls, access to and use of ICTs is a huge challenge. Gender discrimination, lack of confidence, not speaking a major language, low literacy, lack of time and money, and restricted mobility (due to cultural factors or safety) often prevent girls from taking advantage of the benefits of ICTs.

Despite the positive trend in mobile phone and Internet access worldwide, access is often characterized in terms of broad economics, eg., ‘developing’ vs ‘developed’ countries, or it is analyzed at the country level: eg., Kenya vs Mozambique. Analysis needs to go much deeper, however, to include individual factors like class and wealth status, gender, geographic location, age, disability, literacy, language, and device ownership.

Girls living in the same geographic area may have very different levels of access. An English-speaking Kenyan girl living in an urban high rise with her upper class parents will have more access to ICTs than a non-English speaking Kenyan girl with low literacy levels who works long hours cleaning that same apartment and lives in a slum area nearby. The mobile phone ownership capacity of the daughter of a relatively wealthy community leader who owns a small local business will be greater than that of the daughter of one of the poorest families in the same village.

Gender discrimination also comes into play, and in places where men and boys dominate women and girls, they also tend to dominate the available ICTs.  In places where boys are more favored, their confidence to try new things will tend to be higher. Girls often report that boys hog and monopolize ICT equipment and that they criticize, scorn and ridicule girls who are using equipment for the first time, making girls feel too timid to try again.

How can development agencies help girls overcome these barriers?

1)   Keep working to address underlying causes

If girls and women continue to live in greater poverty, with lower education levels, less access to healthcare and other services, less opportunity to work, and lower status in their societies, chances are that their access to and use of ICTs will not level out to that of boys and men.

Getting more girls into school and improving the quality of education could help more girls access and learn to use ICTs. Finding ways to encourage critical thinking and innovation within the education system and ways for girls to join in extra-curricular activities to stimulate new ways of thinking might also help more girls to build the skills and mindsets necessary to enter into the growing number of jobs in the ICT sector.

Advocating for and supporting policies that make Internet more accessible and affordable overall is another area where INGOs can play a role. Libraries and other safe spaces can also help girls and women feel more comfortable and able to access information and learn how to use ICTs.

2) Help change mentalities

A shift in thinking is needed in order to stimulate behavior change that is more conducive to girls participating fully in their family and communities as well as at broader levels. Girls need to be seen as people who can and should take advantage of the potential of ICTs, but they cannot create this shift in thinking on their own. Broad and deep legal, attitudinal and behavior changes need to happen in families, communities, institutions and society in general.

Organizations should engage men and boys as allies in this process. When fathers and male peers are aware, engaged and supportive of girls’ development and girls’ rights, they play a very strong role in changing broader norms and perceptions.

Female role models can also help change mentalities. Having a device or new technology in their possession can increase the status and strength of girls and women as role models and enable them to carry out different and important roles in the community.

3) Offer opportunities

In the short-term, offering specific and accompanied support and opportunities for girls to access and take advantage of ICTs can help fill some of the gaps mentioned above. ICTs can be incredible tools for engaging students in the classroom, making teaching methodologies more participatory, encouraging student-led research and building critical media and digital literacy skills in the process. In places where textbooks are old and outdated, the Internet can offer ways to connect with current events and up-to-date research.

Adding gadgets to the classroom experience involves more than just having the latest digital devices; however, and careful thought needs to be given to the teaching goals, desired outcomes, and issues like relevance and sustainability before deciding on tools and devices.

Special care needs to be taken to ensure that in these controlled spaces, girls have equal access to equipment. Where ICTs cannot be integrated into the classroom or where girls are not in school, non-formal education and extra-curricular activities can give girls a chance to interact with ICTs.

ICTs do hold much promise, yet access for girls remains a challenge. The NGO sector can play a role by addressing underlying causes of gender discrimination and gendered poverty, helping change mentalities, and supporting greater opportunities for girls. For more on ways that INGOs and educators can support girls access and effective use of ICTs, see “Why should you be holding a computer mouse when at the end of the day you’ll be holding a baby’s napkin?”

Read Full Post »

New technologies are changing the nature of monitoring and evaluation, as discussed in our previous Salon on the use of ICTs in M&E. However, the use of new technologies in M&E efforts can seem daunting or irrelevant to those working in low resource settings, especially if there is little experience or low existing capacity with these new tools and approaches.

What is the role of donors and other intermediaries in strengthening local capacity in communities and development partners to use new technologies to enhance monitoring and evaluation efforts?

On August 30, the Rockefeller Foundation and the Community Systems Foundation (CSF) joined up with the Technology Salon NYC to host the second in a series of 3 Salons on the use of ICTs in monitoring and evaluating development outcomes and to discuss just this question. Our lead discussants were: Revati Prasad from Internews, Tom O’Connell from UNICEF and Jake Watson from the International Rescue Committee. (Thanks Jake for stepping in at the last minute!)

We started off with the comment that “Many of us are faced with the “I” word – in other words, having to demonstrate impact on the ground. But how can we do that if we are 4 levels removed from where change is happening?” How can organizations and donors or those sitting in offices in Washington DC or New York City support grantees and local offices to feed back more quickly and more accurately? From this question, the conversation flowed into a number of directions and suggestions.

1) Determine what works locally

Donor shouldn’t be coming in to say “here’s what works.” Instead, they should be creating local environments for innovation. Rather than pushing things down to people, we need to start thinking from the eyes of the community and incorporate that into how we think and what we do. One participant confirmed that idea with a concrete example. “We went in with ideas – wouldn’t SMS be great… but it became clear that SMS was not the right tool, it was voice. So we worked to establish a hotline. This has connected [the population] with services, it also connects with a database that came from [their] own needs and it tracks what they want to track.” As discussed in the last Salon, however, incentive and motivation are critical. “Early on, even though indicators were set by the community, there was no direct incentive to report.” Once the mentioned call center connected the reporting to access to services, people were more motivated to report.

2) Produce local, not national-level information

If you want to leverage technology for local decision-making, you need local level information, not broad national level information. You also need to recognize that the data will be messy. As one participant said, we need to get away from the idea of imperfect data, and instead think: is the information good enough to enable us to reach that child who wasn’t reached before? We need to stop thinking of knowledge as discrete chunks that endure for 3-4 years. We are actually processing information all the time. We can help managers to think of information as something to filter and use constantly and we can help them with tools to filter information, create simpler dashboards, see bottlenecks, and combine different channels of information to make decisions.

3) Remember why you are using ICTs in M&E

We should be doing M&E in order to achieve better results and leveraging technologies to achieve better impact for communities. Often, however, we end up doing it for the donor. “Donors get really excited about this multicolored thing with 50,000 graphs, but the guy on the ground doesn’t use a bit of it. We need to let go.” commented one participant. “I don’t need to know what the district manager knows. I need to know that he or she has a system in place that works for him or her. My job is to support local staff to have that system working. We need to focus on helping people do their jobs.”

4) Excel might be your ‘killer app’

Worldwide, the range of capacities is huge. Sometimes ICT sounds very sexy, but the greatest success might be teaching people how to use Excel, how to use databases to track human rights violations and domestic violence or setting up a front-end and a data entry system in a local language.

5) Technology capacity doesn’t equal M&E capacity

One participant noted that her organization is working with a technology hub that has very good tech skills but lacks capacity in development and M&E. Their work over the past year has been less about using technology and more about working with the hub to develop these other capacities: how to conduct focus groups, surveys, network analysis, developing toolkits and guides. There’s often excitement on the ground – ‘We can get data in 48 hours! Wow! Let’s go!’ However creating good M&E surveys to be used via technology tools is difficult. One participant expressed that finding local expertise in this area is not easy, especially considering staff turnover. “We don’t always have M&E experts on the ground.” In addition, “there is an art to polls and survey trees, especially when trying to take them from English into other languages. How do you write a primer for staff to create meaningful questions.”

6) Find the best level for ICTs to support the process

ICTs are not always the best tool at the community or district level, given issues of access, literacy, capacity, connection, electricity, etc., but participants mentioned working in blended ways, eg., doing traditional data collection and using ICTs to analyze the data, compile it, produce localized reports, and working with the community to interpret the information for better decision-making. Others use hand-drawn maps, examine issues from the community angle and then incorporate that into digital literacy work and expression work, using new technology tools to tell and document the communities’ stories.

7) Discover the shadow systems and edge of network

One participant noted that people will comply and they will move data through the system as requested from on high, but they simultaneously develop their own ways of tracking information that are actually useful to them. By discovering these ‘shadow systems’, you can see what is really useful. This ‘edge of network’ is where people with whom headquarters doesn’t have contact live and work. We rely on much of their information to build M&E systems yet we don’t consult and work with them often enough. Understanding this ‘edge of network’ is critical to designing and developing good M&E systems and supporting local level M&E for better information and decision-making.

8 ) The devil is in the details

There are many M&E tools to choose from and each has its pros and cons. Participants mentioned KoBo, RapidSMSNokia Data GatheringFrontlineSMS and Episurveyor. While there is a benefit to getting more clean data and getting it in real-time, there will always be post-processing tasks. The data can, however, be thrown on a dashboard for better decision-making. Challenges exist, however. For example, in Haiti, as one participant commented, there is a 10% electrification rate, so solar is required. “It’s difficult to get a local number with Clickatell [an SMS gateway]; you can only get an international number. But getting a local number is very complicated. If you go that route, you need a project coordinator. And if you are using SMS, how do you top off the beneficiaries so that they can reply? The few pennies it costs for people to reply are a deterrent. Yet working with telecom providers is very time-consuming and expensive in any country. Training local staff is an issue – trying to train everyone on the ICT package that you are giving them. You can’t take anything for granted. People usually don’t have experience with these systems.” Literacy is another stumbling block, so some organizations are looking at Interactive Voice Response (IVR) and trying to build a way for it to be rapidly deployed.

9) Who is the M&E for?

Results are one thing, but as one participant noted, “part of results measuring means engaging communities in saying whether the results are good for them.” Another participant commented that Ushahidi maps are great and donors love them. But in CAR, for example, there is 1% internet penetration and maybe 9% of the people text. “If you are creating a crisis map about the incidence of violence, your humanitarian actors may access it, it may improve service delivery, but it is in no way useful for people on the ground. There is reliance on technology, but how to make it useful for local communities is still the big question…. It’s hard to talk about citizen engagement and citizen awareness if you are not reaching citizens because they don’t have access to technology.” And “what about the opportunity cost for the poor? ”asked one participant. “Time is restricted. CSOs push things down to the people least able to use the time for participation. There is a cost to participation, yet we assume participation is a global good. The poorest are really scraping for time and resources.  ‘Who is the data for?’ is still a huge question. Often it’s ‘here’s what we’re going to do for you’ rather than meeting with people first, asking what’s wrong, then listening and asking what they would like to do about it, and listening some more.”

10) Reaching the ‘unreachable’

Reaching and engaging the poorest is still difficult, and the truly unreached will require very different approaches. “We’re really very much spoke to hub,” said one participant, “This is not enough. How can we innovate and resolve this.” Another emphasized the need to find out who’s not part of the conversation, who is left out or not present when these community discussions take place. “You might find out that adolescent girls with mobility issues are not there. You can ask those with whom you are consulting if they know of someone who is not at the meeting. You need to figure out how to reach the invisible members of the community.”  However, as noted, “we also have to protect them. Sometimes identifying people can expose them. There is no clear answer.”

11) Innovation or building on what’s already there?

So will INGOs and donors continue to try to adapt old survey ideas to new technology tools? And will this approach survive much longer? “Aren’t we mostly looking for information that we can act on? Are we going to keep sending teams out all the time or will we begin to work with information we can access differently? Can we release ourselves from that dependence on survey teams?” Some felt that ‘data exhaust’ might be one way of getting information differently; for example a mode like Google Flu Trends. But others noted the difficulty of getting information from non-online populations, who are the majority. In addition, with these new ICT-based methods, there is still a question about representativeness and coverage. Integrated approaches where ICTs are married with traditional methods seem to be the key. This begs the question: “Is innovation really better than building up what’s already there?” as one participant commented. “We need to ask – does it add value? Is it better than what is already there? If it does add perceived value locally, then how do we ensure that it comes to some kind of result. We need to keep our eye on the results we want to achieve. We need to be more results-oriented and do reality checks. We need to constantly ask ourselves:  Are we listening to folks?”

In conclusion

There is much to think about in this emerging area of ICTs and Monitoring and Evaluation.  Join us for the third Salon in the series on October 17 where we’ll continue discussions. If you are not yet on the Technology Salon mailing list, you can sign up here. A summary of the first Salon in the series is here. (A summary of the October 17th Salon is here.)

Salons run by Chatham House Rule, thus no attribution has been made. 

Read Full Post »

New technologies are opening up all kinds of possibilities for improving monitoring and evaluation. From on-going feedback and crowd-sourced input to more structured digital data collection, to access to large data sets and improved data visualization, the field is changing quickly.

On August 7, the Rockefeller Foundation and the Community Systems Foundation (CSF) joined up with the Technology Salon NYC for the first in a series of 3 Salons on the use of ICTs in monitoring and evaluating development outcomes. Our lead discussants were: Erica Kochi from UNICEF Innovations; Steven Davenport from Development Gateway and John Toner from CSF.

This particular Salon focused on the use of ICTs for social monitoring (a.k.a. ‘beneficiary feedback loops’) and accountability. Below is a summary of the key points that emerged at the Salon.

1) Monitoring and evaluation is changing

M&E is not only about formal data collection and indicators anymore, one discussant commented, “It’s free form, it contains sentiment.” New ICT tools can help donors and governments plan better. SMS and other social monitoring tools provide an additional element to more formal information sources and can help capture the pulse of the population. Combinations of official data sets with SMS data provide new ways of looking at cross-sections of information. Visualizations and trend analysis can offer combinations of information for decision making. Social monitoring, however, can be a scary thing for large institutions. It can seem too uncontrolled or potentially conflictive. One way to ease into it is through “bounded” crowd-sourcing (eg., working with a defined and more ‘trusted’ subset of the public) until there is comfort with these kinds of feedback mechanisms.

2) People need to be motivated to participate in social monitoring efforts

Building a platform or establishing an SMS response tool is not enough. One key to a successful social monitoring effort is working with existing networks, groups and organizations and doing well-planned and executed outreach, for example, in the newspaper, on the radio and on television. Social monitoring can and should go beyond producing information for a particular project or program. It should create an ongoing dialogue between and among people and institutions, expanding on traditional monitoring efforts and becoming a catalyst for organizations or government to better communicate and engage with the community. SMS feedback loops need to be thought of in terms of a dialogue or a series of questions rather than a one-question survey. “People get really engaged when they are involved in back and forth conversation.” Offering prizes or other kinds of external motivation can spike participation rates but also can create expectations that affect or skew programs in the long run. Sustainable approaches need to be identified early on. Rewards can also lead to false reports and re-registering, and need to be carefully managed.

3) Responsiveness to citizen/participant feedback is critical

One way to help motivate individuals to participate in social monitoring is for governments or institutions to show that citizen/participant feedback elicits a response (eg., better delivery of public services).  “Incentives are good,” said one discussant, “But at the core, if you get interactive with users, you will start to see the responses. Then you’ll have a targeted group that you can turn to.” Responsiveness can be an issue, however if there is limited government or institutional interest, resourcing or capacity, so it’s important to work on both sides of the equation so that demand does not outstrip response capacity. Monitoring the responsiveness to citizen/participant feedback is also important. “Was there a response promised? Did it happen? Has it been verified? What was the quality of it?”

4) Privacy and protection are always a concern

Salon participants brought up concerns about privacy and protection, especially for more sensitive issues that can put those who provide feedback at risk. There are a number of good practices in the IT world for keeping data itself private, for example presenting it in aggregate form, only releasing certain data, and setting up controls over who can access different levels of data. However with crowd-sourcing or incident mapping there can be serious concerns for those who report or provide feedback. Program managers need to have a very good handle on the potential risks involved or they can cause unintended harm to participants. Consulting with participants to better understand the context is a good idea.

5) Inclusion needs to be purposeful

Getting a representative response via SMS-based feedback or other social monitoring tools is not always easy. Mandatory ratios of male and female, age groups or other aspects can help ensure better representation. Different districts can be sampled in an effort to ensure overall response is representative. “If not,” commented one presenter, “you’ll just get data from urban males.” Barriers to participation also need consideration, such as language; however, working in multiple languages becomes very complicated very quickly. One participant noted that it is important to monitor whether people from different groups or geographic areas understand survey questions in the same way, and to be able to fine-tune the system as it goes along. A key concern is reaching and including the most vulnerable with these new technologies. “Donors want new technology as a default, but I cannot reach the most excluded with technology right now,” commented a participant.

6) Information should be useful to and used by the community

In addition to ensuring inclusion of individuals and groups, communities need to be involved in the entire process. “We need to be sure we are not just extracting information,” mentioned one participant. Organizations should be asking: What information does the community want? How can they get it themselves or from us? How can we help communities to collect the information they need on their own or provide them with local, sustainable support to do so?

7) Be sure to use the right tools for the job

Character limitation can be an issue with SMS. Decision tree models, where one question prompts another question that takes the user down a variety of paths, are one way around the character limit. SMS is not good for incredibly in-depth surveys however; it is good for breadth not depth. It’s important to use SMS and other digital tools for what they are good for. Paper can often be a better tool, and there is no shame in using it. Discussants emphasized that one shouldn’t underestimate the challenges in working with Telco operators and making short codes. Building the SMS network infrastructure takes months. Social media is on the rise, so how do you channel that into the M&E conversation?

8) Broader evaluative questions need to be established for these initiatives

The purpose of including ICT in different initiatives needs to be clear. Goals and evaluative questions need to be established. Teams need to work together because no one person is likely to have the programmatic, ICT and evaluation skills needed for a successfully implemented and well-documented project. Programs that include ICTs need better documentation and evaluation overall, including cost-benefit analyses and comparative analyses with other potential tools that could be used for these and similar processes.

9) Technology is not automatically cheaper and easier

These processes remain very iterative; they are not ‘automated’ processes. Initial surveys can only show patterns. What is more interesting is back-and-forth dialogue with participants. As one discussant noted, staff still spend a lot of time combing through data and responses to find patterns and nuances within the details. There is still a cost to these projects. In one instance, the major project budget went into a communication campaign that was launched and the work with existing physical networks to get people to participate. Compared to traditional ways of doing things (face-to-face, for example) the cost of outreach is not so expensive, but integrating SMS and other technologies does not automatically mean that money will be saved. The cost of SMS is also large in these kinds of projects because in order to ensure participation, representation, and inclusion, SMS usually needs to be free for participants. Even with bulk rates, if the program is at massive scale, it’s quite expensive. When assuming that governments or local organizations will take over these projects at some point, this is a real consideration.

10) Solutions at huge scale are not feasible for most organizations 

Some participants commented that the UN and the Red Cross and similarly sized organizations are the only ones who can work at the level of scale discussed at the Salon. Not many agencies have the weight to influence governments or mobile service providers, and these negotiations are difficult even for large-scale organizations. It’s important to look at solutions that react and respond to what development organizations and local NGOs can do. “And what about localized tools that can be used at district level or village level? For example, localized tools for participatory budgeting?” asked a participant. “There are ways to link high tech and SMS with low tech, radio outreach, working with journalists, working with other tools,” commented others. “We need to talk more about these ways of reaching everyone. We need to think more about the role of intermediaries in building capacity for beneficiaries and development partners to do this better.

11) New technology is not M&E magic

Even if you include new technology, successful initiatives require a team of people and need to be managed. There is no magic to doing translations or understanding the data – people are needed to put all this together, to understand it, to make it work. In addition, the tools covered at the Salon only collect one piece of the necessary information. “We have to be careful how we say things,” commented a discussant. We call it M&E, but it’s really ‘M’. We get confused with ourselves sometimes. What we are talking about today is monitoring results. Evaluation is how to take all that information then, and make an informed decision. It involves specialists and more information on top of this…” Another participant emphasized that SMS feedback can get at the symptoms but doesn’t seem to get at the root causes. Data needs to be triangulated and efforts made to address root causes and end users need to be involved.

12) Donors need to support adaptive design

Participants emphasized that those developing these programs, tools and systems need to be given space to try and to iterate, to use a process of adaptive design. Donors shouldn’t lock implementers into unsuitable design processes. A focused ‘ICT and Evaluation Fail Faire’ was suggested as a space for improving sharing and learning around ICTs and M&E. There is also learning to be shared from people involved in ICT projects that have scaled up. “We need to know what evidence is needed to scale up. There is excitement and investment, but not enough evidence,” it was concluded.

Our next Salon

Our next Salon in the series will take place on August 30th. It will focus on the role of intermediaries in building capacity for communities and development partners to use new technologies for monitoring and evaluation. We’ll be looking to discover good practices for advancing the use of ICTs in M&E in sustainable ways. Sign up for the Technology Salon mailing list here. [Update: A summary of the August 30 Salon is here.]

Salons run by Chatham House Rule, thus no attribution has been made. 

Read Full Post »

The field of Information and Communication Technology (ICTs) tends to be dominated by men. Is this because men are more suited to working in technology? Because women don’t want to? Because boys are more interested from an early age?

Probably not. What is more likely is that there are factors throughout girls’ lives that discourage them from going into this field.

At a personal level, I’ve been lucky enough to work in settings and environments that are largely positive towards women in this field. I’ve met and collaborated with numerous wonderful men who treat me with respect and who have been more than willing to work side-by-side, to help me out, to ask for advice, to share their own experience and information, and to support and promote the work I’m involved in. The fact that I work more on the social side of ICTs rather than the super technical, engineering or ‘coding’ side, however, may have something to do with my positive experiences.

Many women who work on the more ‘techie’ side report feeling discriminated against, and the numbers tell a story that’s worth looking into.

In the US, for example…

When women are shown in the media working in technology, they are often seen as rare, they are patronized or sexualized, and their appearance is noted and commented on. (And don’t even get me started on ‘booth babes’ at for-profit technology conferences.)

As Miriam writes in ‘First Female Engineer Graces the Cover of Wired Magazine‘, ‘I’m glad they’ve featured her here, and I’m glad that she’s not scantily clad like most of the women who grace the covers of national magazines. But when will we get beyond the idea of Rosie the Riveter? When can women across fields just be acknowledged the way their male counterparts are–for their accomplishments? …Posing her like Rosie feels antiquated, and also draws attention only to the fact that she’s a woman in a man’s world–not that she’s an incredible engineer in her own rite [sic].’

It’s the same, or perhaps more pronounced, the world over.

At last year’s Commission on the Status of Women, Fabiola, a 17 year old from Cameroon commented: “when a girl succeeds to sit on a computer lab, a boy will raise his voice on her, saying: ‘Why should you be holding a computer mouse when at the end of the day you will be holding a baby’s napkin?’

In other parts of her talk, Fabiola recognized the important role that her parents played in keeping her in school and encouraging her to study for a career related to the sciences.

This highlights the importance of not only education, but of positive parental and community support and a broader set of changes that allow girls to have more freedom and more opportunities. Girls need to know that they have options open to them. And boys need to know too that girls can ‘do stuff’. Women role models are important, and where there are not yet women in certain careers to serve as role models, positive support from men to encourage girls to explore their options is key.

More girls and women in ICTs is not only an individual opportunity for women to earn an income. It can also mean that ICTs products and tools will be designed with women in mind. And I’m not talking about making things pink and purple to appeal to women, I’m talking about the design that responds to real needs in the real lives of women and girls around the world.

As part of a broader effort to encourage more girls to consider wider options, ‘Girls in ICTs Day‘, was established last year and will now be an annual event on the UN Calendar, to be celebrated every year on the fourth Thursday in April.

Many initiatives are underway already to support girls and women in the ICT sector. More governments recognize the importance and necessity of taking deliberate steps. The ITU’s latest report notes that “The choices made by policymakers, enterprises and individuals on investment in education and training must strive for gender equality—that is, to give women the same rights, responsibilities and opportunities as men.”

Positive attitudes and support from families, friends, communities, the private sector and the media is also part of the solution to helping girls see their potential.

The Girls in ICT Portal offers statistics and advice on how to encourage more girls to consider ICTs as a career option. 

Read Full Post »

I went to a great meeting hosted by NetHope and Plan International in Cairo, Egypt during the last week of February. The idea was to get several of the NetHope partners together — both IT companies and INGOs — to discuss ways of working together in the area of ICTs and Education.

I took advantage of the meeting to make some more “Reality Videos”, similar to the mHealth Reality Videos that James Bon Tempo and I did during the mHealth Summit.

1) My Finnish colleague Mika Valitalo asks ‘Really, what’s all the fuss? We just got some equipment and dropped it off in the community and it all worked fine….’

2) Nzila shares what was learned at the workshop and focuses on Grapho Game, a tool to improve literacy in local language.

3) Marcha Neeling says throwing devices at people will not solve any development issues.

4) Mohamed Hussein talks about how ICT4D needs to be led by programs and supported by ICT staff, not the other way around.

5) Maria Berenguer notes that teachers need computer training first if they are to use computers with their students.

6) Chris Bane reminds us that we don’t always need super sophisticated tools. Sometimes very simple ICTs can make all the difference.

7) Edison Nsubega explains that it’s important to base your selection of ICT tools and platforms on the local context and situation that you are trying to resolve.

Read Full Post »

« Newer Posts - Older Posts »