Consultancy Services

Norwegian Refugee Council

The consultant will lead the final evaluation and learning exercise for the TERRA project across project target locations (North Galkayo, Jariban, Baidoa and Bardere), ensuring a rigorous and coherent assessment aligned with OECD-DAC criteria, SIDA standards, and BRCiS requirements. The scope of work is organized into three interrelated phases:

• Phase 1: Project Final Evaluation and Learning Framework Development : The consultant will collaborate with the BRCiS Consortium to finalize the evaluation and learning framework. Rather than developing the evaluation framework from scratch, the consultant will build upon the existing project baseline framework. This includes reviewing relevant project documentation and baseline tools including the household survey, ARC-D assessment, and qualitative rubrics, refining existing data collection tools, and developing additional tools required for the OECD-DAC evaluation and learning components. OECD-DAC evaluation questions will be integrated into the household survey and community discussion guides where relevant otherwise the consultant will lead OECD-DAC Key informant interview with project stakeholders.
• Phase 2: Data Collection and Quality Assurance: Upon approval of the evaluation and learning framework, the consultant will lead the technical implementation of the final evaluation. This includes finalizing all data collection tools (household surveys, qualitative discussion guides, and learning exercise tools), developing field implementation plans, and conducting in-person training for Consortium members and partners on the final evaluation data collection tools, protocols, and data quality standards. The consultant will oversee final evaluation household survey data collection remotely in collaboration with BRCiS Consortium Members, while leading qualitative rubric discussions and learning exercises in the field across Galkayo, Jariban, Baidoa, and Bardera districts. The consultant will also conduct remote key informant interviews for the OECD-DAC evaluation. Throughout the process, the consultant will establish and implement data quality assurance mechanisms and supervise field activities to ensure full adherence to methodological standards.
• Phase 3: Analysis, Reporting, and Dissemination: The consultant will lead the analysis of final evaluation quantitative and qualitative data, integrating findings into a comprehensive final evaluation report and a separate learning report. The final evaluation report will present results from the household survey, ARC-D resilience assessment, and qualitative rubric-based analysis, alongside a structured assessment of the project using OECD-DAC criteria. The learning report will document key lessons, best practices, and actionable recommendations. The consultant will also prepare key dissemination materials and facilitate a final dissemination workshop in Mogadishu, presenting evaluation findings, lessons learned, and recommendations to project stakeholders, including Consortium Members, government representatives, and donor.

3.1 TERRA Project Pre-post Longitudinal Evaluation (baseline and endline)

The TERRA project utilizes a baseline endline mixed-methods evaluation framework to assess progress against project logframe indicators and measure changes in the project logframe KPIs. The final evaluation will collect endline data using comparable tools and methodologies, enabling systematic comparison of results over the project implementation period using baseline and endline results.The evaluation will apply a contribution analysis approach, recognizing that changes in resilience, food systems, and livelihoods may be influenced by multiple external factors in Somalia s complex operating environment. Rather than attributing outcomes solely to the project, the evaluation will assess the plausible contribution of the TERRA project to observed changes. These components will be integrated within a comprehensive final evaluation framework guided by OECD-DAC evaluation criteria, enabling systematic assessment of the project s relevance, effectiveness, efficiency, impact, and sustainability.

The evaluation combines three core assessment components:

• Household Endline Survey: Measures progress against key logframe indicators related to food security, food production capacity, income stability, and participation in governance and food systems among supported households and food producers. OECD-DAC criteria questions will be integrated into the survey instrument to capture household-level perspectives on relevance, effectiveness, and sustainability. Endline results will be compared against household level baseline benchmarks to assess changes over the project implementation period.
• ARC-D Endline Resilience Assessment: Measures changes in community resilience capacities using participatory resilience scoring across 30 resilience components aligned in project target communities. Endline results will be compared against ARC-D community level baseline benchmarks to assess changes over the project implementation period.
• Qualitative Rubric-Based Endline Assessments : Explores contextual dynamics through key informant interviews, examining urban/rural communities' social and economic linkages and interest in rural-urban supply chains, local governance dynamics, market relationships, and sustainability of project interventions.Endline results will be compared against qualitative rubrics baseline benchmarks to assess changes over the project implementation period.
• OECD-DAC Key Informant Interviews: Additional semi-structured interviews will be conducted with project stakeholders, including implementing partner staff, BRCiS Consortium Management Unit (CMU) representatives, donor representatives, and Federal Member State (FMS) authorities, to gather strategic perspectives on project performance across all DAC criteria and consolidate lessons learned.

3.2 Learning Exercise

A dedicated learning exercise will complement the final evaluation to generate actionable insights for future programming. Through outcome harvesting, document review, and direct engagement with Consortium Members, communities, and the donor