Georgia: Final Evaluation – Project “Local Action Group Kazbegi”

1.Background

People in Need (PIN) is a Czech non-governmental organization that provides relief aid and development assistance, while working to defend human rights and democratic freedom. It is one of the largest relief and development organizations in Central/Eastern Europe and has administered projects in 37 countries over the past 20 years. People in Need has been working in Georgia since 2005 and has offices in Tbilisi, Kazbegi and Kutaisi.

PIN Georgia has three priority sectors: Agriculture and Rural Development, Social Protection and Inclusion and Civil Society Development and Local Governance. The project “Local Action Group (LAG) Kazbegi is focused on rural development and local governance.

Information about the project:

Main Donors: European Union through the European Neighbourhood Programme for Agriculture and Rural Development (ENPARD) and Czech Development Agency.

Leading implementing organization of the project: People in Need (PIN).

Other implementing partners: National Network of Local Action Groups in the Czech Republic (NNLAG CR) and Biological Farming Association Elkana.

Location: Kazbegi district, Mtskheta-Mtianeti region, Georgia.

Duration: 28 months (July 2015 – October 2017).

Total budget: 1,198,802 EUR**.**

Background

The project introduces the LEADER approach to Kazbegi district to build on existing local development potential, support participatory mechanisms in local decision making processes and the district’s sustainable growth, as well as improve the quality of life of its residents. Built-in follow-up surveys, close monitoring and evaluation provide data and lessons learnt to facilitate LEADER implementation adapted to local context in other rural regions in Georgia, for an improved model of participatory decision making process and a tool for sustainable rural development. With established participatory planning processes and prepared participatory rural development strategies, Kazbegi district will be able to effectively use future national and EU funds for rural development.

It is the basic principle of the LEADER approach that the action targets all types of local public, private and civic actors and individual inhabitants to create local partnerships and direct local resources towards more effective development. The active and committed representatives of Local Government, entrepreneurs, farmers, CSOs, citizens and other important local players, such as the Kazbegi National Park Administration, are all invited to participate in local strategy planning and become members of Local Action Group (LAG). Together, following on from regional research undertaken by the team, the LAG members have formulated the Rural Development Strategy, with substantial input from other community members. Once the Strategy was developed, they solicited calls for proposals from residents and distributed small grants for projects in areas prioritized by the Strategy. The whole process was transparent and open to any Kazbegi resident. The Action includes strong capacity building component for all target groups to enable a new methodology to be efficiently implemented, and to ensure sustainability of project outcomes. Based on experience from EU countries, which have long history of LEADER implementation, this approach ensures that active individuals are able to mobilize their social networks, the level of community participation increases overall and it helps economic development renewal. The individual projects supported by small grants can become positive models to follow. The networking activities bring innovations to remote areas.

The Overall Objective of the project is to contribute to the reduction of poverty through integrated, sustainable and participatory rural development in Georgia. Its Specific Objective is to improve employment, community empowerment and living conditions of rural population in Kazbegi by introducing the LEADER approach to community-led local development as a pilot for national scale up.

The achievement of the above mentioned objective is supported by the following results:

Result 1: Functioning Kazbegi Local Action Group with the active involvement of public, private and civic actors has been established

Result 2: Area-based Rural Development Strategy reflecting the potential of rural economy and environmental protection for local development has been produced by the Local Action Group

Result 3: Growth potential of Kazbegi has been enhanced through environmentally sustainable, innovative and more competitive agricultural practices and non-agricultural activities

Result 4: Lessons learnt and best practices for community led local development using LEADER approach have been identified and disseminated amongst stakeholders

The major activities to support the attainment of results are as follows:

· Public meeting on LEADER approach introduction, LEADER workshops for potential members of LAG

· Establishing Local Action Group (LAG), Capacity building of LAG members

· Expert studies: General development overview, Tourism survey, Agriculture potential assessment, Environment assessment

· Kazbegi Rural Development Strategy drafting and presentation

· Area branding and information strategy

· Grant scheme based on Rural Development Strategy

· Capacity building for grant applicants and grantees

· Coordination and networking

· Conferences and publications - project results, lessons learnt, best practices

The European Union has already approved a costed extension of the project (contractually, in the form of a new grant), to be implemented from November 2017 to October 2019.

2.Objective and Scope of the Evaluation

The main purpose of the evaluation is to assess thequality of implementation, the immediate impact of the project and its perspectives for sustainability, as well as provide recommendations for the next stage of the project.

Objectives:

1. Evaluate the output /outcomes and impact of the Local Action group Kazbegi pilot project against its objective

2. Analyze the process of LEADER approach implementation, focusing on participation of the target groups and stakeholders

3. Analyze the impact or changes that have occurred within beneficiary groups – in particular members of Local Action Group Kazbegi and sub-grantees

4. Identify problems and constraints that have been encountered

5. Assess the project’s financial management and value for money.

6. Identify important lessons to be learnt and make recommendations for the implementation of the project over the two years of the costed extension.

Scope:

Aspects of the project requiring more in-depth analysis:

· Relevance of effort for capacity building of LAG Kazbegi members;

· Relevance of capacity building of applicants and grantees for sub-grants;

· Relevance of structure such is LAG for the support of socio-economic growth and rural development in Kazbegi;

· Potential of LAG Kazbegi to contribute to national rural development policy in Georgia.

Geographical scope: most of the field work will take place Kazbegi district, with some interviews in Tbilisi.

3.Key evaluation questions

.

Relevance

· Is the LEADER approach relevant to Kazbegi as a means to encourage participatory rural development?

· Was the project design relevant to target groups/beneficiaries needs?

· Was the intervention (specific activities) tailored to maximize involvement of all relevant target groups, stakeholders in Kazbegi and reflect their needs?

· Was the sub-grants scheme designed in a participatory transparent way, reflecting the needs of the target group?

Effectiveness

· Were all the intended outputs and outcomes delivered according to the set indicators?

· What was the quality of the project documents including log frame, activity plan etc.; and to what extent it contributed to the effectiveness of the project?

· Was the sub-grants scheme implemented in a fair and transparent way? How is it perceived by the grantees and LAG Evaluation Committee? What can be improved for future?

Efficiency

· What is the ratio between sub-grants allocated to businesses and employment to be created / income expected?

· Was the management, coordination and monitoring of the project efficient and appropriate?

· If there were any delays how important, for what reason and what are the consequences?

Impact

· What changes can be observed with regards to participation of Kazbegi population in development planning in the district?

· Did the sub-grants scheme contribute to economic development and job creation in Kazbegi?

· What perceived changes has the project brought to the quality of life of the Kazbegi population?

Sustainability

· Do LAG Kazbegi members demonstrate commitment to the LEADER approach or to future participatory approaches for rural development?

· Do local and national authorities demonstrate commitment to participatory approaches to rural development?

· Do LAG Kazbegi members demonstrate sufficient skills to make the LAG a sustainable organization?

PIN will require specific and data-supported answers to each of the agreed evaluation questions or strong justification for why the data could not be obtained. Justification of data unavailability must be communicated by the evaluator without any delay as soon as it becomes apparent and approved by PIN. Failure to do so can result in decreasing the consultant’s remuneration.

4.Methodology

The evaluation is expected to apply qualitative methods of research - semi structured interviews, focus group discussions, desk research of related data including project documentation.

Document review

Project documents

· Project proposal, logframe and budget

· M&E plan

· Results Framework

· Gantt chart

· EU call for proposals

· Internal Mid-term review

· EU Results-Oriented Monitoring mission report

· Tourism Survey Report

· Agriculture Potential Assessment

· General Development overview

· Subjective well-being survey (baseline and endline)

Documents produced by LAG

· LAG Kazbegi Charter

· Kazbegi Local Development Strategy

· Grants Management Manual

· LAG action plans and reports

Field research:

· Interviews and/or focus group discussions with: project team and partners, project consultants; authorities (local and national); LAG members, LAG Project Evaluation Committee and management group; grantees, direct or indirect customers/beneficiaries of sub-grants projects, rejected applicants.

1. Specific Tasks to be performed by the Evaluation Consultant:

· Review of project documents

· Meetings with project staff and relevant stakeholders

· Provision of recommendations for future programming (emphasis on the next phase of the project, but looking also at other possible rural development interventions) and for capacity building

· Preparation of evaluation documents (inception report, draft report, final report)

1. Expected Deliverables

· Inception report (methodology, tools, work schedule).

· Presentation of findings to the project team and partners in Tbilisi.

· Draft report submitted to the PIN Kazbegi LAG Project Manager for review and comments prior to finalizing and submitting the final document.

· Final report (with incorporated feedback) submitted to the PIN Kazbegi LAG Project Manager.

1. Evaluation Report

Final evaluation report should include:

· Executive summary;

· Brief description of the context and the project;

· Description of evaluation goals and objectives;

· Description of evaluation methodology and data collection methods;

· Presentation of main finding and conclusions of the assessment;

· Discussion of lessons learned;

· Recommendations

· Annexes

The evaluation report Executive summary should not exceed 2 pages, and the remaining parts of the report should not exceed 25 pages (excluding annexes).

1. Duration

The Consultant should perform all of the tasks under this Terms of Reference during the Assignment Period. Expected workload is approximately 20-25 working days.

First draft report should be submitted on September 22^nd 2017, Deadline for submission of the final evaluation report is October 11^th 2017.

9.Logistics

PIN will arrange transportation from Tbilisi to Stepantsminda (main settlement of Kazbegi district) and within Kazbegi to selected project sites. PIN will also ensure accommodation in Kazbegi. All other costs must be borne by the Consultant and included in the financial offer.

1. Qualification requirements

Education

· Degree in rural development, international development or other related field

Work Experience

· Proven professional experience in the field of community development, rural development, economic development and good governance

· Significant practical experience in social research, monitoring and evaluation activities, measuring project impact against agreed project indicators and targets, report writing and formulation of recommendations.

Skills

· Strong analytical, organizational and communication skills

· Ability to meet deadlines and prioritize tasks · Fluency in English, Georgian language skills an advantage

Interested applicants must submit the following:

· Full CV (in English) to include relevant professional experience and list of previous similar assignments;

· Proposed evaluation methodology and work plan ( max. 4 pages);

· Price offer (to include consultant’s fees and ALL costs not specifically mentioned in the Logistics section above); please note that, due to budget constraints, offers above 10,000 EUR will not be considered.

· Sample of previous similar work (in English).

The above shall be sent to the following email address: georgia.admin@peopleinneed.cz using the subject heading: Ref: Final Evaluation LAG Kazbegi. Incomplete applications or applications sent through other channels will not be considered.

Deadline for applications: August 6^th, 2017. The Consultant should be available to start no later than August 29^th, 2017.