Program Impact, Monitoring & Evaluation

Altai Consulting has developed strong expertise in program Monitoring & Evaluation (M&E) adapted to a variety of contexts. In each assignment, a specific methodology is designed, taking into account the program dynamics, the partners involved and the areas of implementation. With customized indicators and tools, and combined teams of national and international consultants, Altai Consulting reviews all layers of program implementation, extracting best practices and lessons learned and formulating recommendations for improvement and future programming.

Recent projects

Monitoring & Learning System of the EU Trust Fund (Migration, Displacement & Stabilisation) – EUTF Horn of Africa, 2017-2020

The European Union Emergency Trust Fund for stability and addressing the root causes of irregular migration and displaced persons in Africa (the EU “Trust Fund”, or EUTF) was initiated at the end of 2015, following the Valetta Summit. Altai Consulting has been tasked by the Horn of Africa Window of the EU Trust Fund to develop a real-time Monitoring and Learning System (MLS) at the regional level (comprising nine countries) to help the EUTF management team and member states in Brussels better understand and measure the progress made by migration and stabilisation projects, track their outputs and outcomes and connect these to macro-level changes in the Horn of Africa.

The MLS was designed to facilitate results management and cross-country analysis, strengthen strategic planning, and promote more effective communication. The MLS will ultimately cover a €1.2bn portfolio comprising over 100 projects spread across nine fragile and conflict-affected countries, and includes:

  • Monitoring: Developing a regional results management system. Altai is working with EUTF and its implementing partners to develop a set of common output- and outcome-level indicators covering all EUTF projects. A data pipeline has been developed and connected to all implementing partners, allowing for indicators to be updated on a quarterly basis and the production of customized reports and data visualizations analysing outputs and outcomes, to track progress made and analyse regional trends based on data.
  • Learning: Collating qualitative evidence of effect and facilitating uptake of lessons learned for future programme design and implementation. Altai is developing qualitative case studies on a sample of projects to better analyse the reasons behind successes and challenges met by individual projects and capture best practice and lessons learned, to be shared and directly incorporated into projects design (real time learning).
  • Technical assistance and capacity building: Altai is conducting a review of the portfolio’s existing logical frameworks and M&E systems, working closely with EUTF and implementing partners to strengthen projects results frameworks and theories of change and improve their alignment with EUTF’s overall strategy and objectives. This component also includes strengthening the capacity of project M&E teams based on needs identified at the project level.

The first quarterly report can be accessed at:

Learning and Monitoring Program in the Horn of Africa, DFID, 2017-2021

Altai Consulting, together with Integrity, is delivering the DFID-funded Learning Monitoring Program in Somalia (LAMPS). The program provides third-party monitoring (TPM) and technical assistance services to DFID implementing partners throughout Somalia. In addition to developing a digital platform and a learning framework for DFID partners, LAMPS acts as the vehicle through which DFID-Somalia can monitor and improve its programming, providing credible data for effective decision-making and to articulate best practices, lessons learned, and recommendations from across DFID Somalia’s portfolio.

Altai manages the Third-Party Monitoring component, which entails conducting field verification visits to assess the quality of DFID funded program outputs in the education, private sector, health and governance sectors across Somalia. The LAMPS TPM contributes towards a robust evidence base, increased transparency and greater accountability of DFID programming across Somalia. It does so by selecting a representative sample of IP activities to be verified at the activity and output levels. Over the course of the 4-year program LAMPS will conduct 600 verifications (200 per year). The LAMPS TPM objectives are to: i) increase DFID’s visibility and insight into funded activities through data collection with key stakeholders and beneficiaries; and to ii) nform programmatic decisions by triangulating information on what activities are being delivered and how and whether these appear to have a positive effect.

Monitoring and Evaluation of the UK Conflict, Stability & Security Fund East Africa and Somalia Programme, FCO, 2015-2018

Altai Consulting, together with Itad, have been contracted to establish a Monitoring and Evaluation Unit for the UK Conflict, Stability & Security Fund (CSSF) programmes in Eastern Africa. The M&E Unit is designed to support the UK FCO, DFID and MoD teams who contribute to the CSSF in strengthening their M&E capacity to develop indicators and results frameworks that allow them to track the impact trajectory of their regional programmes and local interventions. The M&E Unit will further play a role in consolidating knowledge and learning gathered across the programme to inform future programming strategy, adapt implementation to local dynamics and report on impact-level indicators at the regional level.

Altai has notably led the following assessments in Somalia and Eastern Africa:

  • Substantive Review of the Building Resilience in Civil Society (BRICS), a CVE programme in Kenya
  • Research into CVE best practices in Eastern Africa and globally
  • Evaluation of BBC Media Action strategic communication campaigns in Somalia and East Africa
  • Research into militias and regional forces in Somalia
  • Baseline mapping of stabilization activities in Somalia
  • Evaluation of Adam Smith’s International Mogadishu Security Programme
  • Evaluation of Stabilization programmes and Early Recovery Initiatives in Jubaland and SWA
  • Baseline mapping of Stabilization programmes in Somalia
  • Thematic research into regional non-state security forces

AFD / Evaluation of 10 Years of Support to the Agriculture Sector 

Since 2005, AFD has been involved in agriculture development in Afghanistan through a number of mechanisms (off and on budget bilateral programs with MAIL, intervention through NGOs) and on a variety of technical topics (cotton production and processing, livestock genetics, fish farms, beekeeping, cooperatives, institutional assistance to MAIL, etc.). Altai Consulting was requested to perform an in depth evaluation of the most relevant activities, as well as to provide an overall evaluation of AFD’s assistance strategy to Afghan agriculture sector, in terms of subsectors covered and methods of intervention in the context of a larger international assistance to the sector.

M&E of the Energy Security and Resource Efficiency

Altai Consulting and WYG were appointed by DFID to conduct a field-based research focusing on the political economy of the energy and health sector in Somaliland. This assessment was designed to contribute to a broader market diagnostic led by consultants from ECA and that aimed at analysing: 1) the extent and nature of development benefits from more widespread adoption of HMGs; 2) the market and policy existing gaps preventing the adoption of HMGs; 3) the potential risks to the development of HMGs; 4) the likely speed of adoption of HMGs without intervention.

Evaluation of the Regional Assisted Voluntary Return and Reintegration Program for Stranded Migrants from Libya to West Africa (RAVL) conducted in West Africa

Altai Consulting conducted the external evaluation of the RAVL program implemented by IOM Libya. The study assessed IOM’s selection process of beneficiaries, support to stranded migrants before their return to their country of origin, along with the reintegration assistance provided to returnees in countries of origin. The fieldwork included key informant interviews with stranded migrants in Libya, interviews with returnees in Ghana and Togo, along with meetings with IOM staff from Libya, Togo, Ghana, Sri Lanka, Burkina Faso, Ethiopia, Senegal and Benin.

Safety Net Program Evaluation

Altai Consulting was contracted by OXFAM to carry out a final assessment of their safety net programs in Bay, Lower Shabelle, Middle Shabelle and Hiraan regions. The study included both quantitative and qualitative components- 250 interviews with beneficiaries, 24 FGDs in twelve urban and rural locations within the program area as well as 24 Key Informant Interviews with local customary and formal leadership, implementing partners, market managers, etc. The analysis was directed at making recommendations to update current models of implementation for cash and in-kind distributions in conflict affected and draught affected areas of South Central Somalia, using innovative approaches based on local resiliencies and international best practices.

Community Safety Programme and external evaluation

DDG contracted Altai Consulting to conduct the external evaluation of its three-year CSP programme across the Somali territories (South-central, Puntland, Somaliland). Altai sent teams in Gedo, Galgaduud, Banadir, Puntland and Somaliland (including Sanaag) to survey the CSP’s outcome in light of the goals stated in the Wadajir Framework for development in Somalia. The research was essentially qualitative in nature (223 key informant interviews and paired interviews, as well as structured observation exercises) to measure the outputs of the programme focused on Mine risk education, Firearm safety education, Conflict management education, Community-Police dialogues, Security infrastructure (police stations and court houses), and Explosive ordnance advocacy and disposal; the outcomes of the programme; and the impact of the programme. Altai evaluated the extent to which local ownership was achieved for the activities and newly established state structures – village and district level committees – and what this meant for the sustainability of achievements. Recommendations to enhance future programming and to improve M&E systems were made.

Impact Evaluation of the Safety Nets and Pensions Support Project (SNPSP): Baseline and Endline Surveys

Altai Consulting has been mandated by the Afghan Ministry of Labour & Social Affairs to conduct an impact evaluation of the SNPSP, a World Bank-funded effort to provide financial support to vulnerable mothers of young children. The impact evaluation consists of a baseline, to be conducted at the beginning of 2016, and an end line, to be conducted mid- to late-2016, with selected families in 160 communities across Ghor, Kunar, and Paktia provinces.
2,400 households are to be interviewed per survey, with each household including both a male and female survey. Subject matter includes determination of baseline and end line values for poverty, hunger, and psycho-social indicators.

Formative Research, Baseline Studies and Support to M&E – University Support Program

Altai Consulting is partnering with FHI 360, AHG and Purdue University in the design and implementation of USWDP (University Support and Workforce Development Program), a 5 year program that started in January 2014 and will aim at adapting Afghan tertiary education to the needs of the labor market. In this program, Altai Consulting was tasked to conduct all formative research in support the program design phase, implement baseline studies, develop the capacity of the program M&E team in support of the M&E Director, and conduct several technical assessment that will support the program strategy, among which the assessment of data management systems and capacities at the Afghan Ministry of Agriculture.

Media Program Evaluation in the Great Lakes Region, La Benevolencija/University of Pennsylvania, Rwanda, Burundi, D.R.C

Radio La Benevolencija started broadcasting in the Great Lakes region in 2002, with a mix of informational and educational programs promoting conflict resolution, a sense of shared history and transitional justice based on analytical frameworks developed over the years by experts from John Hopkins University. Altai’s mission was to conduct a field-based cross-analysis of the program in the Great Lakes as part of a wider evaluation led by University of Pennsylvania. Altai conducted field research in each country, which comprised of a series of qualitative interviews (between one and two hours long) with staff from La Benevolencija, staff from partner media, listeners and potential listeners in urban and rural areas, prominent civil society actors and government officials. The research was conducted centrally (Kigali, Bujumbura, Bukavu, Goma), and also in rural communities that were selected depending on their geography, their conflict history and exposure to the program. It led to the identification of key challenges, lessons learned and best practices as well as  strategic and operational recommendations to help La Benevolencija improve its programming.

M&E of Action against Conflict and for Tolerance Project

Altai Consulting has conducted the final evaluation of the Action against Conflict and for Tolerance Project in Somalia (ACT) implemented by the Danish Refugee Council (DRC) in Eastern Somaliland (Sool and Sanaag regions) and in Puntland (Bari and Mudug regions). The research focused on conflict resolution mechanisms in some of the most unstable areas of Somaliland and Puntland. The report provides a comprehensive assessment of the programs processes and impact, as well as best practices, lessons learned, operational and strategic recommendations.

Media Program Evaluation in the Great Lakes region in DRC, Rwanda and Burundi

Radio La Benevolencija started broadcasting in the Great Lakes region in 2002 with a mix of informational and educational programs promoting conflict resolution, a sense of shared history and transitional justice based on analytical frameworks developed by experts from John Hopkins University. Altai Consulting’s mission was to conduct a cross-analysis and an evaluation of the program based on fieldwork in both central locations (Kigali, Bujumbura, Bukavu, Goma) and rural communities.

Evaluation of the NGO Development Center in Gaza

Altai Consulting supported the French Agency for Cooperation (AFD) to evaluate its funding strategy to the NGO sector in Palestine through the NGO Development Center (NDC). The study included a critical review of the aid dynamics in Palestine and an analysis of the coherence and effectiveness of the NDC as a fund channelling platform and as a tool to structure the NGO sector and improve the quality of service delivery to the population.

Evaluation of the Facilitating Partners of the National Solidarity Program (NSP)

Altai Consulting was mandated to conduct an evaluation of the facilitating partners of NSP, a large-scale World Bank-funded program (>$500m) implemented in 25 Provinces of Afghanistan. The facilitating partners included Care International, Oxfam, the IRC, AKDN, BRAC, ACTED and other major Afghan and international NGOs. The evaluation covered contractual fulfillments, adherence to the objectives and processes of NSP, management, cost-effectiveness and implementation, as well as a study of the social impact of the program in more than 250 Afghan villages.

M&E of Stabilization Programs in Sensitive Areas

Altai Consulting was mandated by the USAID Office of Transition Initiatives (OTI) to design, pilot and implement a comprehensive M&E methodology adapted to unstable areas of Southern Afghanistan. This entailed a combination of quantitative and qualitative research with innovative tools such as Delphi panel, storytelling and community case studies deployed in remote districts of Afghanistan over a two-year period.

M&E of a National Media Development Program

Altai Consulting was contracted by USAID and Internews to develop a set of indicators and monitoring tools, and accompany over two years the implementation of the Afghanistan Media Development & Empowerment Program (AMDEP). The project included a combination of baseline and endline surveys conducted in “treatment” and “control” locations and custom-made activities evaluation to support this large-scale media development program.