1. Introduction
Secours Catholique - Caritas France (SCCF) is a French association governed by 1901 Law, registered at the Paris Police Prefecture under No. 9092 on October 1, 1946 (published in the Official Journal on October 29, 1946), whose public usefulness was acknowledged by a September 25, 1962 decree (published in the Official Journal on September 29, 1962), company I.D. (SIREN) No. 775 666 696, with headquarters at 106 rue du Bac, Paris, 75007, France.
It supports the Balasore Social Service Society (BSSS) in the frame of the above-mentioned project. An external final evaluation is to be done before the end of the project.
BSSS is an organisation registered under Society Registration 1860 Act XXI, Income Tax Act (U/s 12 A) and Foreign Contribution Regulation Act having its headquarters at Balasore district of Odisha state. BSSS is a social development organization based in/at: Vivekananda Marg, PO/Dist-Balasore, Odisha -756001. The organization was founded on 24th October 1992 with a vision is to envisage a transformed society where Love, Peace and Justice prevails and having mission to undertake the mandate of promoting, facilitating and enabling sustainable human development of all, especially the poor and the marginalized by fighting poverty, diseases, enhancing quality education, ensuring livelihood, food security and addressing emergencies.
2. Presentation of the project**
Project title: Social Welfare through Agricultural & Allied Development – SWAAD
Timeframe: June 2019 to May 2022 (Three Years)
Project Holder: Balasore Social Service Society (BSSS)
Project’s fields of work: Livelihood and Agriculture
Project Location: 17 villages of Saragachhida GP of Kuliana Block of Mayurbhanj district of Odisha State.
- Covid 19 response: 15 villages among the 17 mentioned above.
Program Participants:
Direct beneficiaries: 1000 out of 1265 households (approx. 6 325 individuals) in the project area of Saragachhida Gram Panchayat (GP) as per the proposal. 1140 households as per the baseline survey.
- Covid 19 response: 60 unemployed youth and/or migrant worker returnees, specifically from the scheduled Tribes and Castes.
Criteria used in the selection of the beneficiaries: Poor households mostly landless, marginal and small farmers.
Indirect beneficiaries: The total population, approximately 4600 of Sargachhida GP
Budget (Amendment n°2):
Budget of the project : 16 797 486 Indian Rupees, which is equal to 223,966 Euros (rate of exchange of 1 Euro = 75 Indian Rupees)
- Additional budget for the COVID 19 response: 911,500 Indian Rupees, which is equal to 11,394 Euros (rate of exchange of 1 Euro = 80 Indian Rupees)
Project key objective and expected results
Overall Goal: The rural communities in Mayurbhanj District have enhanced social welfare through improved and sustainable livelihood practices.
A sub-objective related to the COVID 19 response is added: Migrant returnees and youth affected by COVID-19 crisis of Mayurbhanj districts of Odisha have a life with dignity and decent work.
Specific Objectives
SO 1: To increase households’ income through sustainable livelihood options and increase of productivity
SO 2: To form and strengthen Farmers Clubs (FC) and Self Help Groups (SHG) (at least 1 in each village), which organize and manage by themselves their own livelihood and income generation activities, and establish good rapport with government line departments to tap the schemes and entitlements
SO 3: To favour social action of the Saragachhida Panchayat, which will have identified and strongly tackled with the major social issues which hinder their social and economic growth, bringing it down to a low rate by at least 30%.
Specific objectives related to the COVID 19 response: The unemployed youth/migrants returnees have better skills for employment; The unemployed youth/migrants returnees have suitable employment or self-employment; The unemployed youth/migrants returnees trained have a permanent source of income; The unemployed youth/migrants returnees have increased income through self-employment or job, for a better future; The migration of the youth is decreased.
3. Overall Objectives of the Evaluation**
Final external evaluation of the project is foreseen in the project contract. It takes place ahead of the end of the project to assess the implementation of planned activities and achievements of results until now, taking into account the Covid 19 crisis; find out the strengths and weaknesses of the project; review the project methodologies; assess the impact of the project; in order to highlight gaps, best practices and lessons learnt and to make realistic recommendations regarding the different components of the project, its management and its sustainability.
Ø To provide BSSS and SCCF with an independent, evidence-based assessment of how the strategies adopted in the project address the relevant issues and how they contributed to the goals of the project. Assessment is to be based on the indicators outlined in the project monitoring and evaluation plan and on DAC framework (Relevance, Coherence, Effectiveness, Efficiency, Impact, Sustainability, Accountability)
Ø To assess the changes in practices and behaviours, the improvements in:
The food security and income generation of the beneficiaries trained on organic agriculture, off-farm and nonfarm income generating activities. The productivity, sustainability and resilience to climate change of these livelihood opportunities
The financial and social empowerment of the people, and especially of the women, who are part of the project (social cohesion, access to government social schemes and provisions, development of income generating activities, etc)
The institutional and financial capacities, empowerment, functioning and networking of the CBOs (self-help groups, farmers’ clubs, Federations) and of local authorities.
For each point, check the reasons why the objectives or improvement were met or not.
Assess the systems, process and programmatic approach of BSSS and give recommendations for improvement and development of further strategies.
Review the capacity and effectiveness of the partnerships (SCCF, BSSS, local public bodies, other organizations, etc.).
Provide recommendations by capturing the learnings and best practices in order to replicate them if relevant.
Areas for Assessment
This section is broadly organized as per the 7 OECD Development Assistance Committee (DAC) criteria (Relevance, Coherence, Effectiveness, Efficiency, Impact, Sustainability, Accountability). To this usual pattern, other key questions to be used per criteria are taken from the Core Humanitarian Standard (CHS). The specific objectives of this evaluation are:
A) To assess the relevance of the project
The extent to which the project objectives and design respond to beneficiaries, global, country, and partner/institution needs, policies, and priorities, and continue to do so if circumstances change. Examples of questions: How relevant is the project to the targeted beneficiaries needs and constraints and other stakeholders it sought to support? How appropriate are the project’s intended results for the context within which it operates, as well as meeting the needs, vulnerabilities and capacities of the target groups? Does planning consider optimal times for activities, accounting for factors such as climatic or season?
B) To access the coherence of the project
The compatibility of the project with other interventions in a country, sector or institution. Examples of questions: Was there external coherence: complementarity, harmonization and coordination between the project and those carried out by other organisations and authorities in the same context? Did the project bring added value while avoiding duplication of activities?
C) To assess the effectiveness of the project
The extent to which the project achieved, or is expected to achieve, its objectives, and its results, including any differential results across groups. Examples of questions: To what degree were the set objectives achieved, in terms of qualitative and quantitative results? How? What are the difference between the new villages and the old villages supported in the previous project and monitored by BSSS facilitators in the first one year of the current project? a) Targeted people and groups: participation, involvement and leadership, links to available schemes and to the market, empowerment and networking to develop sustainable and resilient livelihood opportunities and responses to social issues (WASH, hygiene, migration, alcoholism, school absenteeism, human trafficking, child marriage, etc) b) Gram Panchayats and local public bodies: information, involvement, and support to the project and to the target groups, etc.; Did the interventions meet the immediate and intended results? For instance: How practical and useful were the campaigns and awareness sessions on social issues, trainings of farmers and peer to peer sharings on Rabi and Kharif crops, seeds management, organic and integrated farming, etc? What did the villagers learn? Did the coordination among the farmers and with Gram Sabhas and local public bodies improved so that local development issues are resolved? If not, what is still missing?
D) To assess the efficiency (activities, methodology and means) of the project
The extent to which the intervention delivers, or is likely to deliver, results in an economic and timely way. Examples of questions: Have the project been designed and processes implemented to ensure the efficient use of resources, balancing quality, cost and timeliness of each phase of the intervention? Were all possible resources (public schemes, experts, financial contribution, in-kind contribution, etc.) utilized and managed in an efficient way (to achieve the intended objective, minimizing waste)? Was the monitoring and evaluation system efficient? Was it used to adjust programs and address quality of work issues?
E) To assess the impacts/effects and sustainability of the project
The extent to which the intervention has generated or is expected to generate significant positive or negative, intended or unintended, higher-level effects. Examples of questions: Are all the alternative livelihood opportunities productive, sustainable and resilient to climate changes? What were the main impacts (positive/negative, expected/unexpected) as perceived by the different actors and beneficiaries of the project? What were the impacts of the project in terms of food security, income generation and access to market, inclusion and gender equality, climate change adaptation and sustainable natural resources management? What were the impacts of the linkage/coordination actions? To what extent has the project changed the stakeholders’ knowledge, attitudes, and practices: Are the beneficiaries able to use the knowledge learnt through the project? To what extent appropriation of this knowledge has been achieved? Were the groups (FC, SHG, Federations) well organized and have they demonstrated their capability to lead future actions? Are they financially sustainable? Did the intervention contribute to the development of local leadership and local organizations in terms of their capacity to link with different stakeholders and coordinate responses to development issues?
F) To assess the accountability of the project
Set-up appropriate mechanisms through which affected populations can measure the adequacy of interventions, and address concerns and complaints. Examples of questions: Have communities and individuals been consulted on the design, implementation and monitoring of the complaints processes? Have complaints been handled in a timely, fair and appropriate manner that prioritizes the safety of the complainant and those affected at all stages?
G) Highlight the best practices and lessons learnt in the frame of the project
This section may concern every aspect of the project: activities, strategies and methodologies, project management, partnerships, etc.
**
4. Proposed Methodology to conduct the Evaluation**
The exact methodology is to be determined by the consultant. However, the following are suggested for consideration:
Briefing sessions with SCCF (online meeting).
Preparation work based on background project documents and reports.
Meetings with the management and project staff in headquarters and local offices. Field visits and analysis in the villages. A participative methodology is highly recommended in order to take into account the opinion of all partners and stakeholders, as well as mixed methods approach by using both qualitative and quantitative instruments. The selection and evaluation methods will be shared with SCCF and BSSS (Review of training materials and techniques; Observations of implemented activities; Focus groups discussions and individual interviews with beneficiaries of IGA and of government schemes; Meetings with groups/ committees, State level authorities, local government officials; Interaction with BSSS staff; Meetings with any other relevant stakeholders and discussions with key informants, etc.).
Debriefing session with BSSS to share the key findings, the first conclusions.
Draft report sent to SCCF and BSSS.
Questions and answers with SCCF (online meeting) and BSSS.
Final report sent to SCCF and BSSS.
Output
The consultant(s) will prepare a comprehensive report in English containing all detailed information and recommendations, as well as an executive summary to be submitted to BSSS and SCCF. The evaluation report shall include the following:
Executive summary,
Introduction with reference to the background, the objectives and the methodology,
Analysis and key findings,
Best practices and lessons learned,
Recommendations,
Conclusion,
Annexes (tools used, collected data, list of stakeholders consulted/interviewed, case studies, etc.)
Assessment requirements
Requested profile of the consultant(s)
It is possible to send the application of a team of 2 consultants, if justified and relevant.
Ideally, the consultant fulfils the following requirements:
Postgraduate degree in social work and agricultural studies,
Strong expertise on rural livelihood,
Understanding of the local context (ideally with a previous experience of work in Orissa, or at least in India)
Evidence of substantial work on sustainable agriculture, off-farm income generating activities and climate change adaptation projects
Significant experience in project management, coordination, design, and evaluation
Excellent communication and interpersonal skills
Ability to write clear and relevant reports
Impartial and independent of the parties
Proficiency in English and, if possible, in Orissa local language.
Provisional Timetable of the Assessment
This evaluation will be completed within a period of 21 working days, including preparatory work, field visits with briefing sessions, field analysis, debriefing sessions, reporting work. The evaluation is to be carried preferably in the month of January.
The consultant(s) is expected to submit the expected outcomes 1 week after the evaluation ended.
Criteria of selection
The selection will be based on the following criteria:
The presentation of the issue and understanding of the assignment/outlines of the evaluation
The methodological approach proposed
Qualifications, experiences and skills of the candidate
Experiences in the region and regarding the project’s specific issues
Budget proposal with detailed breakdown
Timetable for the implementation
How to apply:
The candidate is invited, knowing the present terms of reference, to make a methodological and technical proposal for the assessment, including:
• Methodology used to carry out the evaluation mission.
• Experiences and references relating to project evaluation implemented by NGOs (5 pages maximum)
• CV of any persons concerned by the mission
• A provisional mission timeline and work plan with an estimated ratio man/hour.
The candidate is also invited, knowing the present terms of reference, to make a financial proposal for the assessment. The proposed budget should only include the consultant’s fees. Travel and mission expenses will be reimbursed on the actual costs (with proofs of payment) by SCCF at the scale established and which will be transmitted to the chosen candidate(s). The terms of payment will be indicated in a schedule. BSSS will support the consultant for the logistics of the field work (accommodation and food, local transportation, and support to organise meetings, interviews and focus groups, etc.)
The methodological, technical and financial propositions (answering to the present Terms of Reference), should be sent, with the candidate’s resume, to SCCF, before 28th December by email at missioncourteduree@secours-catholique and copy chloe.bonnemains@secours-catholique.org