Program Impact, Monitoring & Evaluation

Altai Consulting has developed strong expertise in program Monitoring & Evaluation (M&E) adapted to a variety of contexts. In each assignment, a specific methodology is designed, taking into account the program dynamics, the partners involved and the areas of implementation. With customized indicators and tools, and combined teams of national and international consultants, Altai Consulting reviews all layers of program implementation, extracting best practices and lessons learned and formulating recommendations for improvement and future programming.

Recent projects

AFD / Evaluation of 10 Years of Support to the Afghan Agriculture Sector in Afghanistan

Since 2005, AFD has been involved in agriculture development in Afghanistan through a number of mechanisms (off and on budget bilateral programs with MAIL, intervention through NGOs) and on a variety of technical topics (cotton production and processing, livestock genetics, fish farms, beekeeping, cooperatives, institutional assistance to MAIL, etc.). Altai Consulting was requested to perform an in depth evaluation of the most relevant activities, as well as to provide an overall evaluation of AFD’s assistance strategy to Afghan agriculture sector, in terms of subsectors covered and methods of intervention in the context of a larger international assistance to the sector.

M&E of the Energy Security and Resource Efficiency in Somalia

Altai Consulting and WYG were appointed by DFID to conduct a field-based research focusing on the political economy of the energy and health sector in Somaliland. This assessment was designed to contribute to a broader market diagnostic led by consultants from ECA and that aimed at analysing: 1) the extent and nature of development benefits from more widespread adoption of HMGs; 2) the market and policy existing gaps preventing the adoption of HMGs; 3) the potential risks to the development of HMGs; 4) the likely speed of adoption of HMGs without intervention.

Evaluation of the Regional Assisted Voluntary Return and Reintegration Program for Stranded Migrants from Libya to West Africa (RAVL) conducted in West Africa

Altai Consulting conducted the external evaluation of the RAVL program implemented by IOM Libya. The study assessed IOM’s selection process of beneficiaries, support to stranded migrants before their return to their country of origin, along with the reintegration assistance provided to returnees in countries of origin. The fieldwork included key informant interviews with stranded migrants in Libya, interviews with returnees in Ghana and Togo, along with meetings with IOM staff from Libya, Togo, Ghana, Sri Lanka, Burkina Faso, Ethiopia, Senegal and Benin.

Safety Net Program Evaluation in Somalia

Altai Consulting was contracted by OXFAM to carry out a final assessment of their safety net programs in Bay, Lower Shabelle, Middle Shabelle and Hiraan regions. The study included both quantitative and qualitative components- 250 interviews with beneficiaries, 24 FGDs in twelve urban and rural locations within the program area as well as 24 Key Informant Interviews with local customary and formal leadership, implementing partners, market managers, etc. The analysis was directed at making recommendations to update current models of implementation for cash and in-kind distributions in conflict affected and draught affected areas of South Central Somalia, using innovative approaches based on local resiliencies and international best practices.

Community Safety Programme in Somalia and Somaliland external evaluation in Somaliland

DDG contracted Altai Consulting to conduct the external evaluation of its three-year CSP programme across the Somali territories (South-central, Puntland, Somaliland). Altai sent teams in Gedo, Galgaduud, Banadir, Puntland and Somaliland (including Sanaag) to survey the CSP’s outcome in light of the goals stated in the Wadajir Framework for development in Somalia. The research was essentially qualitative in nature (223 key informant interviews and paired interviews, as well as structured observation exercises) to measure the outputs of the programme focused on Mine risk education, Firearm safety education, Conflict management education, Community-Police dialogues, Security infrastructure (police stations and court houses), and Explosive ordnance advocacy and disposal; the outcomes of the programme; and the impact of the programme. Altai evaluated the extent to which local ownership was achieved for the activities and newly established state structures – village and district level committees – and what this meant for the sustainability of achievements. Recommendations to enhance future programming and to improve M&E systems were made.

Impact Evaluation of the Afghanistan Safety Nets and Pensions Support Project (SNPSP): Baseline and Endline Surveys in Afghanistan

Altai Consulting has been mandated by the Afghan Ministry of Labour & Social Affairs to conduct an impact evaluation of the SNPSP, a World Bank-funded effort to provide financial support to vulnerable mothers of young children. The impact evaluation consists of a baseline, to be conducted at the beginning of 2016, and an end line, to be conducted mid- to late-2016, with selected families in 160 communities across Ghor, Kunar, and Paktia provinces.
2,400 households are to be interviewed per survey, with each household including both a male and female survey. Subject matter includes determination of baseline and end line values for poverty, hunger, and psycho-social indicators.

Formative Research, Baseline Studies and Support to M&E – University Support Program in Afghanistan

Altai Consulting is partnering with FHI 360, AHG and Purdue University in the design and implementation of USWDP (University Support and Workforce Development Program), a 5 year program that started in January 2014 and will aim at adapting Afghan tertiary education to the needs of the labor market. In this program, Altai Consulting was tasked to conduct all formative research in support the program design phase, implement baseline studies, develop the capacity of the program M&E team in support of the M&E Director, and conduct several technical assessment that will support the program strategy, among which the assessment of data management systems and capacities at the Afghan Ministry of Agriculture.

Media Program Evaluation in the Great Lakes Region, La Benevolencija/University of Pennsylvania, Rwanda, Burundi, D.R.C

Radio La Benevolencija started broadcasting in the Great Lakes region in 2002, with a mix of informational and educational programs promoting conflict resolution, a sense of shared history and transitional justice based on analytical frameworks developed over the years by experts from John Hopkins University. Altai’s mission was to conduct a field-based cross-analysis of the program in the Great Lakes as part of a wider evaluation led by University of Pennsylvania. Altai conducted field research in each country, which comprised of a series of qualitative interviews (between one and two hours long) with staff from La Benevolencija, staff from partner media, listeners and potential listeners in urban and rural areas, prominent civil society actors and government officials. The research was conducted centrally (Kigali, Bujumbura, Bukavu, Goma), and also in rural communities that were selected depending on their geography, their conflict history and exposure to the program. It led to the identification of key challenges, lessons learned and best practices as well as  strategic and operational recommendations to help La Benevolencija improve its programming.

M&E of Action against Conflict and for Tolerance Project in Somalia and Somaliland

Altai Consulting has conducted the final evaluation of the Action against Conflict and for Tolerance Project in Somalia (ACT) implemented by the Danish Refugee Council (DRC) in Eastern Somaliland (Sool and Sanaag regions) and in Puntland (Bari and Mudug regions). The research focused on conflict resolution mechanisms in some of the most unstable areas of Somaliland and Puntland. The report provides a comprehensive assessment of the programs processes and impact, as well as best practices, lessons learned, operational and strategic recommendations.

Media Program Evaluation in the Great Lakes region in DRC, Rwanda and Burundi

Radio La Benevolencija started broadcasting in the Great Lakes region in 2002 with a mix of informational and educational programs promoting conflict resolution, a sense of shared history and transitional justice based on analytical frameworks developed by experts from John Hopkins University. Altai Consulting’s mission was to conduct a cross-analysis and an evaluation of the program based on fieldwork in both central locations (Kigali, Bujumbura, Bukavu, Goma) and rural communities.

Evaluation of the NGO Development Center in Gaza

Altai Consulting supported the French Agency for Cooperation (AFD) to evaluate its funding strategy to the NGO sector in Palestine through the NGO Development Center (NDC). The study included a critical review of the aid dynamics in Palestine and an analysis of the coherence and effectiveness of the NDC as a fund channelling platform and as a tool to structure the NGO sector and improve the quality of service delivery to the population.

Evaluation of the Facilitating Partners of the Afghan National Solidarity Program (NSP) in Afghanistan

Altai Consulting was mandated to conduct an evaluation of the facilitating partners of NSP, a large-scale World Bank-funded program (>$500m) implemented in 25 Provinces of Afghanistan. The facilitating partners included Care International, Oxfam, the IRC, AKDN, BRAC, ACTED and other major Afghan and international NGOs. The evaluation covered contractual fulfillments, adherence to the objectives and processes of NSP, management, cost-effectiveness and implementation, as well as a study of the social impact of the program in more than 250 Afghan villages.

M&E of Stabilization Programs in Sensitive Areas in Afghanistan

Altai Consulting was mandated by the USAID Office of Transition Initiatives (OTI) to design, pilot and implement a comprehensive M&E methodology adapted to unstable areas of Southern Afghanistan. This entailed a combination of quantitative and qualitative research with innovative tools such as Delphi panel, storytelling and community case studies deployed in remote districts of Afghanistan over a two-year period.

M&E of a National Media Development Program in Afghanistan

Altai Consulting was contracted by USAID and Internews to develop a set of indicators and monitoring tools, and accompany over two years the implementation of the Afghanistan Media Development & Empowerment Program (AMDEP). The project included a combination of baseline and endline surveys conducted in “treatment” and “control” locations and custom-made activities evaluation to support this large-scale media development program.