TERMS OF REFERENCE Final Evaluation of the “Participatory Utilization and Resource Efficiency of Water (PUREWater)” Project

The Urban Foundation for Sustainable Development (the Urban Foundation) solicits applications from Consultants (individual or organization) for fulfilling an Assignment described below in the framework of the PUREWater Project funded by USAID.

The goal of the PUREWater Activity is to contribute to the increase ofwater productivity, efficiency, and quality, as well as foster behavioral change, to reduce the rate of groundwater extraction in the Ararat Valley.

The goal was planned to achieve through the following objectives:

Objective 1: Support the development of and advocacy for an enabling policy and regulatory framework for improved participatory use of water;

Objective 2: Facilitate participation and oversight of integrated water management practices in about 12 target communities to increase water resource efficiency;

Objective 3: Raise public awareness and foster water-related behavioral change among affected stakeholders;

Objective 4: Identify small-scale infrastructure pilot projects to complement local water needs.

The duration of the project:

3 years, March 2017 – February 2020.

Expected results :

1. Policy and regulatory improvements to foster participatory use of water are in place;
2. Participation in and oversight of water resources ensured to improve efficiency;
3. Public Awareness raised and behavioral change fostered among water users; and
4. Small-Scale infrastructure pilots to complement local water needs identified and implemented.

Beneficiaries:

The local population of the following selected rural communities: Vedi, Aygavan, PoqrVedi, Burastan, Berqanush and Khachpar in Ararat marz, and Aknalich, Aratashen, Yeraskhahun, Yeghegnut, Guy and Griboyedov in Armavirmarz.

1. Description of the Assignment

Overall objective

The evaluation should contribute to accountability by providing an assessment of the results achieved.Furthermore, it should contribute to learning by understanding what have been the factors that madepossible or created obstacles to the achievement of results (the focus is therefore on why, not only onwhat); and by identifying any key lessons that would lead to improved future actions in the country andsector. The evaluation will also evaluate the impact and sustainability in order to draw conclusions that may inform further actions. It shall not onlydescribe what has been achieved but particularly why and upon what conditions results have been (orhave not been) achieved.

Specific objectives

The final evaluation will analyze the relevance, efficiency, effectiveness of the Project and assess whether the Project’s expected outputs have been achieved during the implementationperiod of the Project (effectiveness), and if this was done in an efficient manner (efficiency). It will also assess the extent to which the Project has contributed to the achievement of the stated specific and overall objectives (outcome and impact, if any) and whether the results of the Project (at all levels) are likely to be sustainable (sustainability). Finally, it will draw conclusions on whether the Project provided the best avenue to address the actual needs and priorities (relevance) as well as the indicator relevance to the project and provide concrete recommendations for the Project.

The focus of evaluation is on the assessment of achievements, the quality andthe resultsof actions in the context of an increasing emphasis onresult-oriented approaches and the contribution towards the implementation of the SDGs.From this perspective, the evaluation should look for evidence of why, whether or how these results arelinked to the USAID interventions in Armeniaand seek to identify the factors driving or hindering progress.Evaluation should provide an understanding of the cause and effect links between: inputs and activities,and outputs, outcomes and impacts and should serve accountability, decision making, learningand management purposes.

The main objectives of this evaluation are to provide the relevant services with:

an overall independent assessment of the past performance of the Project, paying particularattention to its results measured against its expected objectives; and the reasons underpinningsuch results;key lessons learned, conclusions and related recommendations in order to improve current andfuture actions.

Indicative Evaluation Questions

The specific Evaluation Questions as formulated below are indicative. Based on the latter and followinginitial consultations and document analysis, the evaluator(s) will discuss them with the Project Teamand propose in their Inception Report a complete and finalised set of Evaluation Questions withindication of specific Judgement Criteria and Indicators, as well as the relevant data collection sourcesand tools.

Once agreed through the approval of the Inception Report, the Evaluation Questions will becomecontractually binding.

The below evaluation questions are reflective of the evaluation objectives and selected specific aspects,covering all the evaluation criteria.

1. Relevance

1.1 – How well do the original objectives still correspond to the current and expected needs andpriorities of the target groups?

1.2 – How does the project address the needs of the beneficiaries and other stakeholders?

2. Effectiveness

2.1 – What have been and what are the expected (quantitative and qualitative) effects of theintervention?

3. Efficiency

3.1 – To what extent are the costs proportionate to the benefits achieved, considering the full costs andbenefits to the society?

4. Sustainability

4.1 – How likely the effects, specifically in terms of results, are to last after the intervention ends, also interms of the institutional arrangements and capacities, and how they can be effectively transitioned frompiloting to mainstreaming? Please identify the relevance per each contract.

5. Impact

5.1 – Which of the changes produced by the Project among the target groups, both intended andunintended, are long-term?

5.2 – How can the progress achieved under the Project be tracked?

5.3 – Assess the visibility of the Project intervention for the USAID. How do the final beneficiaries associate the Project intervention with the USAID?

These evaluation questions must be fully addressed by the Evaluator(s) in the proposed methodology.

Additional questions can be added if considered related and bringing important insights.

The results will be used:

• by the USAID and other stakeholders, as well as, partners to replicate and/or review and redesign the approaches for future participatory projects, particularly in the water sector. 

Methodology

The Successful Consultant should suggest a methodology for the implementation of the assignments which, inter alia, may include:

• Designing the evaluation;
• Preparing  the questionnaire;
• Conducting desk research, and in-depth interviews with experts, policymakers and practitioners in the water sector at the national and local levels;
• Designing and facilitating a focus group session(s);
• Designing and carrying out a stakeholder analysis and prepare a comparison chart comparing with the same type of analysis carried out at the beginning of the project. The methodology of the current evaluation should consider previously done assessments.

Deliverables

Deliverables should include the following:

• Evaluation questionnaire;
• Evaluation Timetable;
• Comparative stakeholder analysis (with a chart and table) – (Armenian and English);
• Final Evaluation Report in (Armenian and English) with recommendations;
• Powerpoint presentation (Armenian and English);
• Audio recordings and transcripts of expert interviews.

• Duration of the assignment

The successful organization/individual should suggest a timeline for the assignment which should cover the period from mid-December 2019 to the end of February 2020 not to exceed a two and half month period. Preference will be given to the organization/individual who would be able to allocate resources to implement several tasks in parallel.

Interested organization/individuals are requested to submit Technical and Financial applications.

Maximum 70% of the total score will go to the Technical application, which will include the following documents:

• Brief methodology (max. 1 page) – 30%
• Description of human resource capacities of the applicant to fulfill the described tasks within limited timelines (max. 1 page) – 40%
• The past experience about the accomplishment of similar tasks (max. 1 page) – 20%
• The CV of the lead social scientist – 30%.

Maximum 30% of the total score will go to the financial application, which will include budget estimate with per task breakdown.

• Required experience and qualification

The Lead social scientist/consultant shall have the following expertise and qualifications:

• Master’s degree in Public Policy, Sociology, International Development, Development Studies/Planning, Economics, Statistics or any other relevant university degree;
• At least 3 years of experience in the project evaluation. Experience in conducting an evaluation of in water-sector will be considered as an advantage;
• At least 3 years of experience in working with international organizations and donors,
• Excellent written and verbal communication skills in English and Armenian.

• Cost of the Assignment

The maximum price offered for this assignment should not exceed 2,300,000 AMD.

• Application procedures

Interested organizations/individuals should submit the requested documents electronically to the following address: avanoyan@urbanfoundation.am by COB December 06, 2019.