Feeds:
Posts
Comments

Archive for the ‘wait… what?’ Category

I attended the African Evaluators’ Conference (AfrEA) in Cameroon last week as part of the Technology and Evaluation strand organized by Pact with financial support from The Rockefeller Foundation’s Evaluation Office and The MasterCard Foundation. The strand was a fantastic opportunity for learning, sharing and understanding more about the context, possibilities and realities of using ICTs in monitoring and evaluation (M&E). We heard from a variety of evaluators, development practitioners, researchers, tool-developers, donors, and private sector and government folks. Judging by the well-attended sessions, there is a huge amount of interest in ICTs and M&E.

Rather than repeat what’s I’ve written in other posts (see links at the bottom), I’ll focus here on some of the more relevant, interesting, and/or new information from the AfrEA discussions. This first post will go into institutional issues and the ‘field’ of ICTs and M&E. A second post will talk about design and operational tips I learned /was reminded of at AfrEA.

1) We tend to get stuck on data collection –Like other areas (I’m looking at you, Open Data) conversations tend to revolve around collecting data. We need to get beyond that and think more about why we are collecting data and what we are going to do with it (and do we really need all this data?). The evaluation field also needs to explore all the other ways it could be using ICTs for M&E, going beyond mobile phones and surveys. Collecting data is clearly a necessary part of M&E, but those data still need to be analyzed. As a participant from a data visualization firm said, there are so many ways you can use ICTs – they help you make sense of things, you can tag sentiment, you can visualize data and make data-based decisions. Others mentioned that ICTs can help us to share data with various stakeholders, improve sampling in RCTs (Randomized Control Trials), conduct quality checks on massive data sets, and manage staff who are working on data collection. Using big data, we can do analyses we never could have imagined before. We can open and share our data, and stop collecting the same data from the same people multiple times. We can use ICTs to share back what we’ve learned with evaluation stakeholders, governments, the public, and donors. The range of uses of ICTs is huge, yet the discussion tends to get stuck on mobile surveys and data collection, and we need to start thinking beyond that.

2) ICTs are changing how programs are implemented and how M&E is done — When a program already uses ICTs, data collection can be built in through the digital device itself (e.g., tracking user behavior, cookies, and via tests and quizzes), as one evaluator working on tech and education programs noted. As more programs integrate digital tools, it may become easier to collect monitoring and evaluation data with less effort. Along those lines, an evaluator looking at a large-scale mobile-based agricultural information system asked about approaches to conducting M&E that do not rely on enumerators and traditional M&E approaches. In his program, because the farmers who signed up for the mobile information service do not live in the same geographical community, traditional M&E approaches do not seem plausible and ICT-based approaches look like a logical answer. There is little documentation within the international development evaluation community, however, on how an evaluator might design an evaluation in this type of a situation. (I am guessing there may be some insights from market research and possibly from the transparency and accountability sectors, and among people working on “feedback loops”).

3) Moving beyond one-off efforts — Some people noted that mobile data gathering is still done mostly at the project level. Efforts tend to be short-term and one-off. The data collected is not well-integrated into management information systems or national level processes. (Here we may reference the infamous map of mHealth pilots in Uganda, and note the possibility of ICT-enabled M&E in other sectors going this same route). Numerous small pilots may be problematic if the goal is to institutionalize mobile data gathering into M&E at the wider level and do a better job of supporting and strengthening large-scale systems.

4) Sometimes ICTs are not the answer, even if you want them to be – One presenter (who considered himself a tech enthusiast) went into careful detail about his organization’s process of deciding not to use tablets for a complex evaluation across 4 countries with multiple indicators. In the end, the evaluation itself was too complex, and the team was not able to find the right tool for the job. The organization looked at simple, mid-range and highly complex applications and tools and after testing them all, opted out. Each possible tool presented a set of challenges that meant the tool was not a vast improvement over paper-based data collection, and the up-front costs and training were too expensive and lengthy to make the switch to digital tools worthwhile. In addition, the team felt that face-to-face dynamics in the community and having access to notes and written observations in the margins of a paper survey would enable them to conduct a better evaluation. Some tablets are beginning to enable more interactivity and better design for surveys, but not yet in a way that made them a viable option for this evaluation. I liked how the organization went through a very thorough and in-depth process to make this decision.

Other colleagues also commented that the tech tools are still not quite ‘there’ yet for M&E. Even top of the line business solutions are generally found to be somewhat clunky. Million dollar models are not relevant for environments that development evaluators are working in; in addition to their high cost, they often have too many features or require too much training. There are some excellent mid-range tools that are designed for the environment, but many lack vital features such as availability in multiple languages. Simple tools that are more easily accessible and understandable without a lot of training are not sophisticated enough to conduct a large-scale data collection exercise. One person I talked with suggested that the private sector will eventually develop appropriate tools, and the not-for-profit sector will then adopt them. She felt that those of us who are interested in ICTs in M&E are slightly ahead of the curve and need to wait a few years until the tools are more widespread and common. Many people attending the Tech and M&E sessions at AfrEA made the point that use of ICTs in M&E would get easier and cheaper as the field develops, tools get more advanced/appropriate/user-friendly and widely tested, and networks/ platforms/ infrastructure improves in less-connected rural areas.

5) Need for documentation, evaluation and training on use of ICTs in M&E – Some evaluators felt that ICTs are only suitable for routine data collection as part of an ongoing program, but not good for large-scale evaluations. Others pointed out that the notions of ‘ICT for M&E’ and ‘mobile data collection/mobile surveys’ are often used interchangeably, and evaluation practitioners need to look at the multiple ways that ICTs can be used in the wider field of M&E. ICTs are not just useful for moving from paper surveys to mobile data gathering. An evaluator working on a number of RCTs mentioned that his group relies on ICTs for improving samples, reducing bias, and automatically checking data quality.

There was general agreement that M&E practitioners need resources, opportunities for more discussion, and capacity strengthening on the multiple ways that ICTs may be able to support M&E. One evaluator noted that civil society organizations have a tendency to rush into things, hit a brick wall, and then cross their arms and say, “well, this doesn’t work” (in this case, ICTs for M&E). With training and capacity, and as more experience and documentation is gained, he considered that ICTs could have a huge role in making M&E more efficient and effective.

One evaluator, however, questioned whether having better, cheaper, higher quality data is actually leading to better decisions and outcomes. Another evaluator asked for more evidence of what works, when, with whom and under what circumstances so that evaluators could make better decisions around use of ICTs in M&E. Some felt that a decision tree or list of considerations or key questions to think through when integrating ICTs into M&E would be helpful for practitioners. In general, it was agreed that ICTs can help overcome some of our old challenges, but that they inevitably bring new challenges. Rather than shy away from using ICTs, we should try to understand these new challenges and find ways to overcome/work around them. Though the mHealth field has done quite a bit of useful research, and documentation on digital data collection is growing, use of ICTs is still relatively unexplored in the wider evaluation space.

6) There is no simple answer. One of my takeaways from all the sessions was that many M&E specialists are carefully considering options, and thinking quite a lot about which ICTs for what, whom, when and where rather than deciding from the start that ICTs are ‘good and beneficial’ or ‘bad and not worth considering.’ This is really encouraging, and to be expected of a thoughtful group like this. I hope to participate in more discussions of this nature that dig into the nuances of introducing ICTs into M&E.

Some new resources and forthcoming documentation may help to further set the stage for better learning and application of ICTs in the M&E process. Pact has just released their Mobile Technology Toolkit, and Michael Bamberger and I are finishing up a paper on ICT-enabled M&E that might help provide a starting point and possible framework to move things forward. The “field” of ICTs in M&E is quite broad, however, and there are many ways to slice the cake. Here is the list of toolkits, blog posts and other links that we compiled for AfrEA – please add any that you think are missing!

(Part 2 of this post)

Previous posts on ICTs and M&E:

Read Full Post »

The NYC Technology Salon on February 28th examined the connection between bigger, better data and resilience. We held morning and afternoon Salons due to the high response rate for the topic. Jake Porway, DataKind; Emmanuel Letouzé, Harvard Humanitarian Initiative; and Elizabeth Eagen, Open Society Foundations; were our lead discussants for the morning. Max Shron, Data Strategy; joined Emmanuel and Elizabeth for the afternoon session.

This post summarizes key discussions from both Salons.

What the heck do we mean by ‘big data’?

The first question at the morning salon was: What precisely do we mean by the term ‘big data’? Participants and lead discussants had varying definitions. One way of thinking about big data is that it is comprised of small bits of unintentionally produced ‘data exhaust’ (website cookies, cellphone data records, etc.) that add up to a dataset. In this case, the term big data refers to the quality and nature of the data, and we think of non-sampled data that are messy, noisy and unstructured. The mindset that goes with big data is one of ‘turning mess into meaning.’

Some Salon participants understood big data as datasets that are too large to be stored, managed and analyzed via conventional database technologies or managed on normal computers. One person suggested dropping the adjective ‘big,’ forgetting about the size, and instead considering the impact of the contribution of the data to understanding. For example, if there were absolutely no data on something and 1000 data points were contributed, this might have a greater impact than adding another 10,000 data points to an existing set of 10 million.

The point here was that when the emphasis is on big (understood as size and/or volume), someone with a small data set (for example, one that fits into an excel sheet) might feel inadequate, yet their data contribution may be actually ‘bigger’ than a physically larger data set (aha! it’s not the size of the paintbrush…). There was a suggestion that instead of talking about big data we should talk about smart data.

How can big data support development?

Two frameworks were shared for thinking about big data in development. One from UN Global Pulse considers that big data can improve a) real-time awareness, b) early warning and c) real-time monitoring. Another looks at big data being used for three kinds of analysis: a) descriptive (providing a summary of something that has already happened), b) predictive (likelihood and probability of something occurring in the future), and c) diagnostic (causal inference and understanding of the world).

What’s the link between big data and resilience?

‘Resilience’ as a concept is contested, difficult to measure and complex. In its most simple definition, resilience can be thought of as the ability to bounce back or bounce forward. (For an interesting discussion on whether we should be talking about sustainability or resilience, see this piece). One discussant noted that global processes and structures are not working well for the poor, as evidenced from continuing cycles of poverty and glaring wealth inequalities. In this view, people are poor as a result of being more exposed and vulnerable to shocks, at the same time, their poverty increases their vulnerability, and it’s difficult to escape from the cycle where over time, small and large shocks deplete assets. An assets-based model of resilience would help individuals, families and communities who are hit by a shock in one sphere — financial, human, capital, social, legal and/or political — to draw on the assets within another sphere to bounce back or forward.

Big data could help this type of an assets-based model of resilience by predicting /helping poor and vulnerable people predict when a shock might happen and preparing for it. Big data analytics, if accessible to the poor, could help them to increase their chances of making better decisions now and for the future. Big data then, should be made accessible and available to communities so that they can self-organize and decrease their own exposure to shocks and hazards and increase their ability to bounce back and bounce forward. Big data could also help various actors to develop a better understanding of the human ecosystem and contribute to increasing resilience.

Can ivory tower big data approaches contribute to resilience?

The application of big data approaches to efforts that aim to increase resilience and better understand human ecosystems often comes at things from the wrong angle, according to one discussant. We are increasingly seeing situations where a decision is made at the top by people who know how to crunch data yet have no way of really understanding the meaning of the data in the local context. In these cases, the impact of data on resilience will be low, because resilience can only truly be created and supported at the local level. Instead of large organizations thinking about how they can use data from afar to ‘rescue’ or ‘help’ the poor, organizations should be working together with communities in crisis (or supporting local or nationally based intermediaries to facilitate this process) so that communities can discuss and pull meaning from the data, contextualize it and use it to help themselves. They can also be more informed what data exist about them and more aware of how these data might be used.

For the Human Rights community, for example, the story is about how people successfully use data to advocate for their own rights, and there is less emphasis on large data sets. Rather, the goal is to get data to citizens and communities. It’s to support groups to define and use data locally and to think about what the data can tell them about the advocacy path they could take to achieve a particular goal.

Can data really empower people?

To better understand the opportunities and challenges of big data, we need to unpack questions related to empowerment. Who has the knowledge? The access? Who can use the data? Salon participants emphasized that change doesn’t come by merely having data. Rather it’s about using big data as an advocacy tool to tell the world to change processes and to put things normally left unsaid on the table for discussion and action. It is also about decisions and getting ‘big data’ to the ‘small world,’ e.g., the local level. According to some, this should be the priority of ‘big data for development’ actors over the next 5 years.

Though some participants at the Salon felt that data on their own do not empower individuals; others noted that knowing your credit score or tracking how much you are eating or exercising can indeed be empowering to individuals. In addition, the process of gathering data can help communities understand their own realities better, build their self-esteem and analytical capacities, and contribute to achieving a more level playing field when they are advocating for their rights or for a budget or service. As one Salon participant said, most communities have information but are not perceived to have data unless they collect it using ‘Western’ methods. Having data to support and back information, opinions and demands can serve communities in negotiations with entities that wield more power. (See the book “Who Counts, the power of participatory statistics” on how to work with communities to create ‘data’ from participatory approaches).

On the other hand, data are not enough if there is no political will to make change to respond to the data and to the requests or demands being made based on the data. As one Salon participant said: “giving someone a data set doesn’t change politics.”

Should we all jump on the data bandwagon?

Both discussants and participants made a plea to ‘practice safe statistics!’ Human rights organizations wander in and out of statistics and don’t really understand how it works, said one person. ‘You wouldn’t go to court without a lawyer, so don’t try to use big data unless you can ensure it’s valid and you know how to manage it.’ If organizations plan to work with data, they should have statisticians and/or data scientists on staff or on call as partners and collaborators. Lack of basic statistical literacy is a huge issue amongst the general population and within many organizations, thought leaders, and journalists, and this can be dangerous.

As big data becomes more trendy, the risk of misinterpretation is growing, and we need to place more attention on the responsible use of statistics and data or we may end up harming people by bad decisions. ‘Everyone thinks they are experts who can handle statistics – bias, collection, correlation’ these days. And ‘as a general rule, no matter how many times you say the data show possible correlation not causality, the public will understand that there is causality,’ commented one discussant. And generally, he noted, ‘when people look at data, they believe them as truth because they include numbers, statistics, science.’ Greater statistical literacy could help people to not just read or access data and information but to use them wisely, to understand and question how data are interpreted, and to detect political or other biases. What’s more, organizations today are asking questions about big data that have been on statisticians’ minds for a very long time, so reaching out to those who understand these issues can be useful to avoid repeating mistakes and re-learning lessons that have already been well-documented.

This poor statistical literacy becomes a serious ethical issue when data are used to determine funding or actions that impact on people’s lives, or when they are shared openly, accidentally or in ways that are unethical. In addition, privacy and protection are critical elements in using and working with data about people, especially when the data involve vulnerable populations. Organizations can face legal action and liability suits if their data put people at harm, as one Salon participant noted. ‘An organization could even be accused of manslaughter… and I’m speaking from experience,’ she added.

What can we do to move forward?

Some potential actions for moving forward included:

  • Emphasis with donors that having big data does not mean that in order to cut costs, you should eliminate community level processes related to data collection, interpretation, analysis, and ownership;
  • Evaluations and literature/documentation on the effectiveness of different tools and methods, and when and in which contexts they might be applicable, including things like cost-benefit analyses of using big data and evaluation of its impact on development/on communities when combined with community level processes vs used alone/without community involvement – practitioner gut feelings are that big data without community involvement is irresponsible and ineffective in terms of resilience, and it would be good to have evidence to help validate or disprove this;
  • More and better tools and resources to support data collection, visualization and use and to help organizations with risk analysis, privacy impact assessments, strategies and planning around use of big data; case studies and a place to share and engage with peers, creation of a ‘cook book’ to help organizations understand the ingredients, tools, processes of using data/big data in their work;
  • ‘Normative conventions’ on how big data should be used to avoid falling into tech-driven dystopia;
  • Greater capacity for ‘safe statistics’ among organizations;
  • A community space where frank and open conversations around data/big data can occur in an ongoing way with the right range of people and cross-section of experiences and expertise from business, data, organizations, etc.

In conclusion?

We touched upon all types of data and various levels of data usage for a huge range of purposes at the two Salons. One closing thought was around the importance of having a solid idea of what questions we trying to answer before moving on to collecting data, and then understanding what data collection methods are adequate for our purpose, what ICT tools are right for which data collection and interpretation methods, what will done with the data/what is the purpose of collecting data, how we’ll interpret them, and how data will be shared, with whom, and in what format.

See this growing list of resources related to Data and Resilience here and add yours!

Thanks to participants and lead discussants for the fantastic exchange, and a big thank you to ThoughtWorks for hosting us at their offices for this Salon. Thanks also to Hunter Goldman, Elizabeth Eagen and Emmanuel Letouzé for their support developing this Salon topic, and to Somto Fab-Ukozor for support with notes and the summary. Salons are held under Chatham House Rule, therefore no attribution has been made in this post. If you’d like to attend future Salons, sign up here!

Read Full Post »

Screen Shot 2014-03-07 at 3.34.23 AM

As Tom over at Humanosphere wrote a few days ago, there’s a cool initiative happening at Sheffield University that seeks to develop a global research agenda related to the post-2015 sustainable development goals process. (Disclaimer, I’m part of the steering committee.)

ID100: The Hundred Most Important Questions in International Development asks individuals and organizations from across policy, practice and academia to submit questions that address the world’s biggest environmental, political and socioeconomic problems. These will then be shortlisted down to a final set of 100 questions following a debate and voting process with representatives from development organizations and academia who will meet in July 2014. 

The final list of questions will be published as policy report and in a leading academic journal. More on the consultation methodology here. Similar crowdsourced priority-setting exercises have worked in biodiversity conservation, food security and other areas, and they have been instrumental in framing global research priorities for policy development and implementation.

Screen Shot 2014-03-07 at 3.36.06 AMAnyone can submit up to five questions related to key issues in international development that require more exploration. You are encouraged to involve colleagues in the formulation of these questions.

Please submit your questions by March 25th – and check the submission guidelines before formulating questions. More information on the project can be accessed on the ID100 website. Hashtag: #ID100.

Read Full Post »

This is a guest post from Jamie Narkunski, who works as a UX consultant at ThoughtWorks NYC.

by Jamie Narkunski

IMAG0304

Photo from ThoughtWorks.

I recently attended a Tech Salon where the subject of grant applications came up.  Part of the conversation revolved around the issue that the complexity, format, and investment required in the traditional grant application process acts as a barrier for organizations that lack the resources or experience needed to complete the process in a competitive manner, leading to the exclusion or weeding out of potential target applicants in some cases.

The conversation made me think of a recent grant I was a part of:  The Digital Prototype Opportunity.  ThoughtWorks partnered with Parsons New School and Blue Ridge Foundation to host a grant for $100k in funds + $350k worth of development work. The grant was split across two winners. The grant application was open to organizations who had an existing social impact innovation but wanted to use technology to extend and/or deepen their impact in their social space.

Because there were organizations of varying sizes and capabilities involved, we wanted to try to level the playing field as best we could without negatively impacting the applicants.  We started the process with an announcement and invitation to come to our offices for a two-hour workshop where we helped the organizations explore their current process flows and the users they serve, and to identify where they could make the most impact with the addition of technology.

The interest came to around 120 individual organizations. After the first workshop we had the organizations submit a short proposal based around the work done in the workshop or work they’d done based on the format of the workshop we had introduced to them.  The proposals we received were, for the most part, to the point and included a direct ask and perceived impact.  The workshop had enabled organizations to understand our interest in the “What” and the “Why” over the “How”.  This allowed applicants to focus their efforts around what they know best:  their users and the needs of those users.  It would be misleading to say that every single proposal we received stuck to this format — there were of course the occasional 20+ page proposal from the organizations with the professional grant writer — but that was the exception.

Photo from ThoughtWorks.

Photo from ThoughtWorks.

Next, we narrowed the group down to ten finalists.  Our promise to the finalists was that even if they were not one of the two winners, they would walk away with a fleshed-out proposal with a clear ask, reasoning to back it up, and an understanding of resources, funds and time needed to complete it.  In order to make good on this promise, we held a second workshop for the finalist groups.  They each got 1:1 assistance, and this time the focus was on framing an MVP and rough scoping the tech, resources and time needed to complete.  From there they had the option to refine their proposal, images and diagrams from the workshop.

We ended up with a clear understanding of what was being asked for, why, and what it would take to pull off.  It made for a difficult evaluation on our end, because there were few applicants we could disqualify for technicalities. For me, that proved the success of the application process.  In the end we ended up with two diverse winners and 8 finalists with very strong proposals.

I would love to see and to personally attempt to repurpose the format we did at a local level on a larger scale.  It will be interesting to see the creative use of partnerships and program management most likely required to grow this model.

If there are any questions or interest in the methodologies and tools used in the workshop I am happy to help.  You can reach me at jnarkuns [at] thoughtworks.com.

Read Full Post »

Our February 6th Technology Salon in New York City focused on the organizational challenges that development organizations face when trying to innovate or integrate ICTs into their programs and operations. We looked at the idea of “innovation” and different ways to approach it. We asked what “innovation” really means and why “technology” and “innovation” seem to always be used interchangeably. We shared ideas, challenges and good practice around supporting and encouraging staff, managers, and donors to experiment with new and better ways of doing things.

A huge thank you to Somto Fab-Ukozor and Rachana Kumar for their collaboration on writing the summary below!

Mika

Mika Valitalo, Plan Finland. (Photo by Somto Fab-Ukozor)

Our lead discussants were Jessica Heinzelman, DAI’s senior ICT specialist; Chris Fabian, UNICEF’s advisor to the Executive Director on innovation and co-lead of UNICEF’s innovation lab; and Mika Valitalo, Plan Finland’s program manager for ICT4D.

What is innovation?

Different organizations bring in different ideas and definitions of innovation. Is innovation always synonymous with technology? Does it always require technology? For some organizations, “innovation” means doing things faster, better and differently in a way that adds value and has a concrete impact.

One discussant noted that innovation is not necessarily disruptive in nature; it can be categorized into 3 main forms:

  • a totally new context, new problem, new solution
  •  an existing solution that is improved
  •  an existing solution that is adapted to a new context, country or sector

Another lead discussant pointed out that innovation is not necessarily something brand new; it can be something that existed but that is used in a different way or simply different processes or ways of thinking, and innovation does not have to be technology. The concept of innovation is often misunderstood, he said, because “someone can come up with 10 crappy ideas that are new but that does not make them innovative or useful.” He also cautioned that innovation should not only be about replication and scale, yet donors sometimes decide that an idea is innovative and encourage organizations to replicate the idea, without ensuring that it is having a real or relevant impact across different local contexts.

One discussant disagreed and said that there’s no innovation without technology; for example, 60% of kids are stunting in one of the greenest areas in the world because of lack to electrical grid; the provision of electricity is technology. Without the electrical grid, the country will never reach any of its developmental goals. Technology enables the work to happen. A different viewpoint, as another discussant explained, was that the application of the technology is the innovative part, not the technology itself.

What fuels innovation?

A key part of the Salon discussion focused on whether having dedicated resources fueled innovation, or whether the presence of challenges and constraints forces innovation. Some Salon participants felt that when people are faced with challenges such as less time, fewer resources, no office space, etc., they may find themselves being more innovative in order to overcome constraints. Others found that staff often use the excuse of not having time and resources as a reason for not innovating or thinking outside the box. Some felt that innovation is difficult to achieve within large bureaucratic institutions due to their risk averse cultures, whereas others felt that one of the benefits of large-scale organizations is having resources to innovate and then test and scale innovations. Participants did agree that regardless of the outside setting, some people are more inclined to be innovative – these people are easy to identify almost everywhere, as they are always coming up with new ideas and trying/testing things out. The key is to find a way for organizational structures to support and reward innovators.

Encouraging innovation within large development organizations

Different organizations approach the innovation question in different ways. One discussant said that at his organization, the innovation team spends 60% of its time working on problems the organization is facing at the moment; 20% of its time looking towards the future (a 3-5 year horizon) for ideas that have an immediate direct impact on its work; and 20% of its time on organizational redesign, in other words, how to work with users to create solutions that are not top down and that take advantage of the existing ecosystem. His innovations team is only interested in finding/creating innovations that could reach very large scale, such as 10,000,000 people or more.

The innovation team created some guidelines for staff and allies with tips on how to defend one’s existence as someone working on innovation.  The guide addresses questions like: Why innovation?  Is it valuable to have an innovation unit? If so, why? If so and why, then prove it. Working on these questions led the innovation unit to develop metrics for innovation to justify staff positions focused on innovation. These guidelines can help people at other organizations who are trying something new to have a reference point; they allow innovation teams to say “such-and-such organization is doing this, so we can do it too.”

Metrics for innovation

Having a set of metrics can help innovation labs, teams or persons charged with organizational innovation to measure whether they are actually achieving their goals, too. One organization defined the following metrics:

  • permission to fail or fail cheaply without fear
  • working with heterogeneous groups
  •  sharing knowledge across countries and contexts

Working across organizational boundaries without “soul crushing bureaucracy” and having the real ability to work horizontally is one key to achieving these metrics.

Decentralizing the innovation function

Another lead discussant described the institutional changes and underlying understanding of people needed to improve and support innovation:

  • Identify the real incentives that someone has – individual or project – and the disincentives to innovating. It is important to look underneath the excuses people come up with such as time constraints and additional work, and find out what is driving them.
  • Hire realistic optimists – Sometimes in the ICT4D space, people gloss over the challenges and promote the technology. It is important to hire people who are grounded and have a good analytical sense, and who can think beyond gadgets and hype.
  • Building and sharing expertise within the organization – Creating a champions group of mid-to entry-level professionals within the organization, who understand the power that new technology has, is another way to make innovation and ICT4D spread. Rather than keep the expertise isolated within a specialist unit, finding younger people who are hungry for knowledge and who see this kind of work as a way to help further their career and set themselves apart from their colleagues can help. Then the “innovation team” can provide them with support and guidance. Participatory workshops on new tools and approaches can be organized where these innovation champions are tasked to research and explore something and then present it. Equipped with tools and trainings, they will be able to better identify opportunities for innovation.
  • Getting innovation into the plan early and working with those who are putting proposals and RFPs together to make sure that it is part of the metrics being measured from the beginning. It’s hard to add new elements into the program later because people will perceive it as additional work.

One Salon participant said that her organization disconnected “innovation” from its other programs so that space for trying new things would be made, and the fear of failing would be reduced or “offloaded” to the innovation team. In this case, the unit is funded through private sources which support it to experiment. It still has to struggle for its existence and show the impact and value of either failure or success.

Ideas for taking innovation and ICT4D forward

Some ideas for moving ahead included:

  1. Flexibility in program planning- In reality, most times during program implementation the plan changes and we have to figure out how to cope with it. The solution lies in the ability to quietly promote innovation and to influence donor organizations to embrace more flexible implementation.
  2. Integrating User-Centered-Design – Ethnographic research can help to better understand how people use technology locally and what its meaning is. It also helps identify existing patterns and ways of doing things that could be enhanced or shared with other communities if they are working well. Agile methodology from the software world can be pulled into development programs in order to end the top-down approach of solving problems from afar and having everything cooked up from the start. Rather, focusing on small iterations and the impact of the deliverables can be a better approach.
  3. Collaboration with Universities – Universities can be great places for working on and trying out  new ideas. Links with universities can be used as ways to find solutions, but even moreso to “change the proteins” inside of a traditional organization.  Collaboration among staff and students provides opportunities for staff to learn how to think about things differently and for students to understand real-world challenges in development agencies.
  4. Bridging the gap – Involving educators, health experts, child protection specialists and others who are not very interested in gadgets can bring about strong understanding of the real needs. Then connecting them with “techies” and ICTs in plain language and asking them to relate their own use of tech (they probably all use mobile phones in their personal lives, for example) to the ways that community members use tech can help to bring about solid, practical, sustainable and locally driven solutions.
  5. Provide a safe environment – Many humans are innovative by nature, said one discussant. Hierarchies and organizational processes are often what prevent people from doing new things. Giving feedback and psychological support can help those who are innovative to flourish within a difficult environment.
  6. The interdisciplinary approach – One Salon participant said that his organization had started to work with some senior staff to think and structure data in a way that would help them understand their challenges and programs better in order to innovate. This makes people more comfortable, and working across different teams with a variety of people and skill sets can help new ideas and solutions to bubble up.
  7. Information intermediaries – Infomediaries working at various levels can help connect people with technology, conduct training, and ensure that staff can acquire skills to use the technology themselves and in programs.
  8. Open source – Making project documents, budgets, concepts, “open” online can make them more accessible and  help  enable sustainable projects and prevent issues and costs associated with proprietary tools, applications and content.
  9. Younger management – There’s an age differential between the people who lead most large organizations and large-scale projects and those who are more interested in technology. One participant suggested it would be important to get younger people into positions where they can make contributions of ideas and decisions without being blocked by higher level people that may be “past their innovation prime.” Another solution may be to hire more experienced people but to ensure that they are open to working with  younger people who bring in new ideas. (Some Salon participants, however, felt that age has nothing to do with innovation, and that it is more related to personality types and organizational environments).

For  additional resources on the Salon topic, look here – and add your resources as well.

Salons are held under Chatham House Rule, therefore no attribution has been made in this post. Many thanks to our lead discussants and to ThoughtWorks for hosting and providing breakfast.

If you’d like to attend future Salons, sign up here!

Read Full Post »

This is a cross post from Heather Leson, Community Engagement Director at the Open Knowledge Foundation. The original post appeared here on the School of Data site.

by Heather Leson

What is the currency of change? What can coders (consumers) do with IATI data? How can suppliers deliver the data sets? Last week I had the honour of participating in the Open Data for Development Codeathon and the International Aid Transparency Initiative Technical Advisory Group meetings. IATI’s goal is to make information about aid spending easier to access, use, and understand. It was great that these events were back-to-back to push a big picture view.

My big takeaways included similar themes that I have learned on my open source journey:

You can talk about open data [insert tech or OS project] all you want, but if you don’t have an interactive community (including mentorship programmes), an education strategy, engagement/feedback loops plan, translation/localization plan and a process for people to learn how to contribute, then you build a double-edged barrier: barrier to entry and barrier for impact/contributor outputs.

Currency

About the Open Data in Development Codeathon

At the Codathon close, Mark Surman, Executive Director of Mozilla Foundation, gave us a call to action to make the web. Well, in order to create a world of data makers, I think we should run aid and development processes through this mindset. What is the currency of change? I hear many people talking about theory of change and impact, but I’d like to add ‘currency’. This is not only about money, this is about using the best brainpower and best energy sources to solve real world problems in smart ways. I think if we heed Mark’s call to action with a “yes, and”, then we can rethink how we approach complex change. Every single industry is suffering from the same issue: how to deal with the influx of supply and demand in information. We need to change how we approach the problem. Combined events like these give a window into tackling problems in a new format. It is not about the next greatest app, but more about asking: how can we learn from the Webmakers and build with each other in our respective fields and networks?

Ease of Delivery

The IATI community / network is very passionate about moving the ball forward on releasing data. During the sessions, it was clear that the attendees see some gaps and are already working to fill them. The new IATI website is set up to grow with a Community component. The feedback from each of the sessions was distilled by the IATI – TAG and Civil Society Guidance groups to share with the IATI Secretariat.

In the Open Data in Development, Impact of Open Data in Developing Countries, and CSO Guidance sessions, we discussed some key items about sharing, learning, and using IATI data. Farai Matsika, with International HIV/Aids Alliance, was particularly poignant reminding us of IATI’s CSO purpose – we need to share data with those we serve.

Country edits IATI

One of the biggest themes was data ethics. As we rush to ask NGOs and CSOs to release data, what are some of the data pitfalls? Anahi Ayala Iaccuci of Internews and Linda Raftree of Plan International USA both reminded participants that data needs to be anonymized to protect those at risk. Ms. Iaccuci asked that we consider the complex nature of sharing both sides of the open data story – successes and failures. As well, she advised: don’t create trust, but think about who people are trusting. Turning this model around is key to rethinking assumptions. I would add to her point: trust and sharing are currency and will add to the success measures of IATI. If people don’t trust the IATI data, they won’t share and use it.

Anne Crowe of Privacy International frequently asked attendees to consider the ramifications of opening data. It is clear that the IATI TAG does not curate the data that NGOS and CSOs share. Thus it falls on each of these organizations to learn how to be data makers in order to contribute data to IATI. Perhaps organizations need a lead educator and curator to ensure the future success of the IATI process, including quality data.

I think that School of Data and the Partnership for Open Data have a huge part to play with IATI. My colleague Zara Rahman is collecting user feedback for the Open Development Toolkit, and Katelyn Rogers is leading the Open Development mailing list. We collectively want to help people become data makers and consumers to effectively achieve their development goals using open data. This also means also tackling the ongoing questions about data quality and data ethics.


Here are some additional resources shared during the IATI meetings.

Read Full Post »

Migration is central to the current political debate as well as to the development discussion, especially in conversations about the “post 2015” agenda, the ‘youth bulge’, and youth employment. Prevention work is not likely to end migration, regardless of the organizations and governments working to improve the well-being of children and youth in their home communities. In fact, improved economic capacity may actually enhance people’s capacity to migrate.

Our Technology Salon on January 16, 2014, discussed the role of ICTs in child and youth migration, ways ICTs are influencing migration, how ICTs could make migration safer and more productive, and ideas for mobile applications that would be useful for child and youth migrants. We welcomed Ravi Karkara, United Nations Inter-agency Network on Youth Development; Lucas Codognolla, Lead Coordinator, Connecticut Students for a DREAM; and Michael Boampong, Migration and Development Consultant, UNDP, as our lead discussants.

Some areas on where and how ICTs are playing or could play a role:

  • Sending money / remittances / mobile money. Costs to transfer money need to be reduced. Some studies have shown that the African diaspora pays up to 20% for money transfers. More needs to be done to extend mobile money services, especially in rural areas.
  • Finding a job. Many youth use ICTs from the very start of the migration process to look for work. They may also use ICTs to find work in their home countries if they return.
  • Getting a visa to migrate legally. Most legal immigration processes require making appointments with Embassies via the Internet and the ability to communicate via email.
  • Identifying migration routes. Often, youth who migrate irregularly investigate routes online before their departure. GPS can also help during transit. One program in Mexico is developing a “safe migration map” that provides crowd-sourced, near real-time information to migrants on which areas are experiencing high crime or other dangers so that they can migrate more safely.
  • Reporting abuse. Child help lines are expanding their services across many countries and providing support, advice and help to children in case of emergency or abuse, including during migration. Many help lines are experimenting with text messaging.
  • Connecting with other youth in similar situations.  Youth who have an irregular migration status are able to find others in the same circumstances and feel less alone. They can also connect with peers and organizations who can provide support, help and advice.
  • Keeping in touch with parents/family. ICT are useful for children and youth keep families informed of how they are doing, and to ask for support and help. The African Movement for Working Children and Youth works with telecoms operators to provide a free number to children and youth who migrate in West Africa. Parents and children can remain in touch that way while children are moving from one town to the next.
  • Sharing information on migration rights. Organizations like Connecticut Students for a DREAM use ICTs and social media to reach out to youth who have an irregular migration status to provide support and to engage them in organized advocacy activities. The organization encourages sharing of stories and a safe space to discuss migration difficulties. The “Pocket DACA” application helps young migrants understand the deferred action law and apply for it.
  • Engaging, organizing, and influencing government. Youth in the US are organizing via Facebook and other social media platforms. In some cases, government officials have reached out to these groups for advice on legislation.

Participants pointed out that:

Children/youth are not always victims. Often the discourse around children’s movement/migration is centered on trafficking, protection and vulnerability rather than rights, power and choices. More needs to be done to empower children and youth and to provide opportunities and participation avenues. At the same time, more needs to be done to create opportunities at home so that children and youth do not feel like their home situation is hopeless and that migration is the only option.

Children and youth are not a homogeneous population. When thinking about ICTs and children/youth, it’s important to know the context and design programs that are relevant to specific children and young people. Age, wealth, sex, literacy and other aspects need to be considered so that ICT applications are useful. Both traditional communication and ICTs need to be used depending on the population.

ICTs can widen generation gaps. In some cases, ICTs increase the communication divide among generations. Older people may feel that youth are working in a medium that they are not skilled at using, and that youth are not considering their input and advice. This can create conflict and reduce levels of support that might otherwise be provided from community leaders, elders and government officials.

The role of the State needs more thought. Often irregular migration happens because legal channels are difficult to navigate or they are prohibitive. The role of ICTs in influencing or facilitating legal migration needs more thought, as does the potential role of ICTs in advocating for change. The State may not always be friendly to migration, however, so the topic is controversial. States may also use ICTs for surveillance of youth or migrating populations, especially in places where there is political or ethnic conflict, so ICTs may put people in extreme danger.

Risks need to be considered. There are serious risks associated with using ICTs in general, and especially with vulnerable populations. These include everything from online grooming and risks of being lured into trafficking or sex work, to scamming sites that take advantage of youth, to political aspects such as surveillance and targeting of certain populations of youth by the State or other armed groups. ICTs could be a way to help break conspiracies of silence and to report and speak out about human rights abuses, but care needs to be taken that people are not put at risk when they do so.

ICTs need to fit local contexts. Rural areas are less connected and so other forms of information and communication are often more common. Both online and offline means need to be used when working with children and youth. In addition, different social media tools and platforms are used in different places. For example, though the end of Facebook is heralded by some in the US, because youth are reportedly fleeing as older people join the site, Facebook is taking off in Latin America, where many organizations use it for engaging youth and helping them to organize and get informed about their rights.

Not much is known about children, youth, ICTs and migration.  The area of child migration is relatively weak in terms of research. The upcoming World Youth Report centers on child and youth migration and has been a highly controversial process. Migration needs to be considered from an evolving age perspective, with focus on aspects that impact on children, adolescents and youth differentially. A gender perspective needs to be included. There is also a difference between children and youth who migrate for employment and those who move due to conflict or who are seeking asylum, and deeper knowledge is needed in all of these different areas.

Recommendations for future efforts included:

  • More youth voice and support for youth movements in the area of migration
  • More involvement of youth in the debate/dialogue on migration and ICTs
  • Micro-grants for youth who want to work on migration initiatives, including those that use ICTs
  • More nuanced research and understanding of the role of ICTs in child and youth migration with specific lenses on age, sex, ethnicity, and other factors

Resources on ICTs and child/youth migration:

Salons are held under Chatham House Rule, therefore no attribution has been made in this post. Many thanks to our lead discussants and to ThoughtWorks for hosting and providing breakfast.

If you’d like to attend future Salons, sign up here!

Read Full Post »

The scars you have. The wounds you inflict. The knots wrapped up in your perceptions and the memories that cross generations….

We are using Skype to call a landline in San Salvador. That side — a father and a grandmother — doesn’t understand how it works, doesn’t realize that this side – a son, a daughter, an ex-wife – is gathered around the computer, all listening.

One-third of this side, the daughter, has dissolved into a heap of tears. Hyperventilating, choking sobs. The fact that we left 12 years ago for the US has punched her in the gut, and she’s destroyed upon hearing the deep, gravelly voice of her abuelita, who cared for her unconditionally when she was small.

Typical Skype, the connection is not good.

Alo? Alo? No se oye bien. Aqui no se oye. Alo? 

She had buried it. Every mention of facing it or trying to resolve it met with tears. With fear and resistance. With avoidance.

Her recent post-Thanksgiving twitter feed confesses: I’m late but thankful for my dad’s selfless decision to not ask for joint custody (c) 

…And to let my mom bring us to the US. If I were there I wouldn’t have any of what I have now.

He comes on the line, and his voice, his loss, his sacrifice become tangible. She sobs. He tries to reach out.

Why doesn’t she wanna talk? Ahhh, it’s ok. I know how it is…. She can hear me? Then both you kids know I am proud of you. I love you….  She still crying? Bueno, it’s ok. She gets that from me. I am a cry baby too. A cry-man.

The magnitude of his sacrifice hits her. She imagines what it felt like for a father to lose a wife, a son, and a small daughter to the United States. She wonders how he could handle it. Meanwhile she is living her life carefree, like nothing. She knows it’s not her fault, but the guilt is still there. Somehow until now she has not understood or appreciated it.

Maybe causing hurt can feel worse than being hurt. But even that is preposterous and selfish. The fact is that only some people have the privilege of being able to leave, to come and go as they please, to move on freely to better opportunities.

We hang up and have dinner and try to talk about it. We change the subject. We watch a movie about the time El Salvador’s national team made it to the World Cup. It was 1982 and the country was deep in civil war. The team had no funding and arrived through pure grist, themselves wondering what they had done to achieve such greatness. The players talk about how they were bathed in their reputation upon arrival to la Copa Mundial: A country at war. A country of assassins. A country full of poor people and violence.

On the field, the team won the record for having the most goals scored against them: 10 goles metidos. They returned home ashamed. But the players understand the context that led to their failure, and they also talk about el orgullo del pobre – their pride in themselves, their people and their country.

It strikes me that ‘la gente humilde,‘ (humble people) is the polite term sometimes used to describe ‘the poor’ in El Salvador. I keep thinking about what that means.

Read Full Post »

Sometimes a work trip accidentally has a theme, and my recent trip to Cape Town was one of those. I arrived on Thursday, December 5th to the news that Mandela had passed away. My cab driver was on the phone, telling someone that Friday would be a holiday. He glanced back at me and asked “Do you know who Nelson Mandela is? He’s passed.” I turned on the television when I got to my hotel and watched for a few hours, but it was already after midnight and so there was not a lot of new content.

Screen Shot 2013-12-13 at 7.56.17 AMThe following day I went with a small group to an ecumenical ceremony in the square, but it didn’t feel yet like the news had really hit. I had no idea how to interpret the crowd, the messages, the speakers, the politics. As the news traveled and people began writing about Mandela and his life, I dipped in here and there. The typical conversations happened. Was Mandela and his life going to be sanitized by the mainstream media for political purposes? It was good to see people attempting to show the full man, with all his complexities. It was striking to remember that such a short time ago apartheid was alive and well, and to really think about that, I mean really really think about it, and to be reminded yet again of the fact that social change is not easy, clean, or straightforward. It’s most certainly not a technical problem waiting to be solved with a new device or invention, though clearly international and national political pressure play a huge role.

Mandela and his life became an underlying base for the conference, as I’m sure was true for much of what was happening around the world. Whether he was directly mentioned or not, his life’s work was present. I participated in sessions on ICTs and open development, ICTs and children, ICTs and raising critical consciousness. In all of them, the issues of equity and power came up. How can development processes be more open and is there a role for ICTs there? What world do we want to see in the future? How do we get there? How do we include children and youth so that they are not marginalized? How can we take a critical approach to ourselves and our agendas in development and in ICT4D? Can ICTs play a role in helping people to change existing power structures, achieve more equity and equality, and transform our societies? All these sessions were planned before anyone knew of Mandela’s passing, but talking about issues in light of the recent news and the renewed presence of him and his life made them feel more real.

Fast forward to the flights home. My first flight was the long one, from Cape Town to Amsterdam. My seat mates were two inexperienced flyers in their late 30s or so. They didn’t know where to put their bags or that they could not get up to go to the bathroom while the seatbelt sign was on and the flight was taking off. They were tattooed and looked a little rough around the edges. One of them carried a small, stuffed cheetah and wore hot pink pumps. I fell fast asleep the minute we took off and woke up an hour before we landed. The woman with the pink pumps started a conversation. Almost immediately she told me that she and her friend were returning from 2 months in rehab. They were both struggling with addictions to alcohol and sex, she told me. She was originally from Croatia and had lived in Amsterdam for years. She had recently relapsed and that’s why she went into treatment. She was returning to a safe house now, and it was her daughter’s 10th birthday. She was feeling positive about her life, yet sad that she would spend her daughter’s birthday in a safe house. She had recently revealed her addiction to her boss and received a negative and disempowering response. She was trying to be strong and accept that she was a recovering addict, learning to not feel ashamed, and working on being proud of the fact that she was moving forward. I was struck by her vulnerability and sweetness and left wondering how she would fare in a world where addiction and mental illness are so buried and stigmatized.

I got on my last flight and checked my Facebook while waiting to take off. My friend Subir had posted that two Supreme Court judges had overruled the Delhi high court’s decision and upheld the constitutionality of Section 377 –  essentially ruling that homosexuality is a crime and throwing India back into the dark ages.

Screen Shot 2013-12-13 at 7.26.51 AM

My seatmate on this flight started up a conversation and I mentioned the India decision. I also told him about some of the different work that I do and the various hats I wear, including my involvement as a board member with ICAAD, the International Center for Advocates Against Discrimination. ICAAD’s work is fascinating because they look at discrimination that is embedded into law, and the link between structural and legal discrimination and racial, gender, religious and social discrimination, violence, and hate crimes including those against religious minorities, immigrants, women, the LGBT community, and people of color.

As we talked, I learned that my seat mate’s mother had been a Holocaust survivor and that he was traveling to the US to attend an event in his mother’s honor. Her father survived a concentration camp, and she had been hidden and sheltered by different families for many years until the two were finally reunited and moved to the US.  She spent years dealing with the psychological impacts of the experience, but now works to help children and youth understand and deal with bigotry and hate, to identify it around them even when it’s not directly aimed at them, and to find ways to stop it. She highlights that it can manifest itself in seemingly small ways, like bullying at school.

This accidental theme of discrimination, violence and hate, whether based on race, poverty, addiction, religious beliefs or sexual orientation was so alive for me this week. I met and learned more about brave individuals and the work of organizations who stand up in the face of injustice to take action at both the personal and the institutional level, raising critical consciousness to push for the changes that the world needs.

Despite our ‘advanced’ societies, our awareness of history, our facts, our data, our evidence, our literary genius, our ICTs, our innovations, we have very far to go, as I was reminded multiple times. But strong and caring individuals, organized communities, and political will can make a dent in structural discrimination and contribute to a more human society. More of us, self included, need to re-focus and work harder toward this end.

Read Full Post »

Screen Shot 2013-11-23 at 6.14.40 PM

Migration has been a part of the human experience since the dawn of time, and populations have always moved in search of resources and better conditions. Today, unaccompanied children and youth are an integral part of national and global migration patterns, often leaving their place of origin due to violence, conflict, abuse, or other rights violations, or simply to seek better opportunities for themselves.

It is estimated that 33 million (or some 16 percent) of the total migrant population today is younger than age 
20. Child and adolescent migrants make up a significant proportion of the total population of migrants in Africa (28 percent), Asia (21 percent), Oceania (11 percent), Europe (11 percent), and the Americas (10 percent).

The issue of migration is central to the current political debate as well as to the development discussion, especially in conversations about the “post 2015” agenda. Though many organizations are working to improve children’s well-being in their home communities, prevention work with children and youth is not likely to end migration. Civil society organizations, together with children and youth, government, community members, and other stakeholders can help make migration safer and more productive for those young people who do end up on the move.

As the debate around migration rages, access to and use of ICTs is expanding exponentially around the globe. For this reason Plan International USA and the Oak Foundation felt it was an opportune time to take stock of the ways that ICTs are being used in the child and youth migration process.

Our new report, “Modern Mobility: the role of ICTs in child and youth migration” takes a look at:

  • how children and youth are using ICTs to prepare for migration; to guide and facilitate their journey; to keep in touch with families; to connect with opportunities for support and work; and to cope with integration, forced repatriation or continued movement; and
  • how civil society organizations are using ICTs to facilitate and manage their work; to support children and youth on the move; and to communicate and advocate for the rights of child and youth migrants.

In the Modern Mobility paper, we identify and provide examples of three core ways that child and youth migrants are using new ICTs during the different phases of the migration process:

  1. for communicating and connecting with families and friends
  2. for accessing information
  3. for accessing services

We then outline seven areas where we found CSOs are using ICTs in their work with child and youth migrants, and we offer some examples:

Ways that CSOs are using ICTs in their work with child and youth migrants.

Ways that CSOs are using ICTs in their work with child and youth migrants.

Though we were able to identify some major trends in how children and youth themselves use ICTs and how organizations are experimenting with ICTs in programming, we found little information on the impact that ICTs and ICT-enabled programs and services have on migrating children and youth, whether positive or negative. Most CSO practitioners that we talked with said that they had very little awareness of how other organizations or initiatives similar to their own were using ICTs. Most also said they did not know where to find orientation or guidance on good practice in the use of ICTs in child-centered programming, ICTs in protection work (aside from protecting children from online risks), or use of ICTs in work with children and young people at various stages of migration. Most CSO practitioners we spoke with were interested in learning more, sharing experiences, and improving their capacities to use ICTs in their work.

Based on Plan Finland’s “ICT-Enabled Development Guide” (authored by Hannah Beardon), the Modern Mobility report provides CSOs with a checklist to support thinking around the strategic use of ICTs in general.

ICT-enabled development checklist developed by Hannah Beardon for Plan International.

ICT-enabled development checklist developed by Hannah Beardon for Plan International.

We also offer a list of key considerations for practitioners who wish to incorporate new technologies into their work, including core questions to ask about access, age, capacity, conflict, connectivity, cost, disability, economic status, electricity, existing information ecosystems, gender, information literacy, language, literacy, power, protection, privacy, sustainability, and user-involvement.

Our recommendation for taking this area forward is to develop greater awareness and capacity among CSOs regarding the potential uses and risks of ICTs in work with children and youth on the move by:

  1. Establishing an active community of practice on ICTs and children and youth on the move.
  2. Mapping and sharing existing projects and programs.
  3. Creating a guide or toolbox on good practice for ICTs in work with children and youth on the move.
  4. Further providing guidance on how ICTs can help “normal” programs to reach out to and include children and youth on the move.
  5. Further documentation and development of an evidence base.
  6. Sharing and distributing this report for discussion and action.

Download the Modern Mobility report here.

We’d love comments and feedback, and information about examples or documentation/evidence that we did not come across while writing the report!

Read Full Post »

Older Posts »

Follow

Get every new post delivered to your Inbox.

Join 667 other followers