India: CONSULTANCY – Advocating for Change for Persons with Disabilities in South and South East Asia – Phase 2 – Final Evaluation

Organizational overview

Handicap International (HI) is an independent international solidarity organization which works in situations of poverty or exclusion, conflict and natural disasters. Working alongside people with disabilities and people in vulnerable situations, the association takes action and speaks out in order to meet their essential needs and improve their living conditions. Handicap International is committed to campaigning to ensure their dignity is preserved and their fundamental rights upheld.

Since its creation, HI has set up development programs in around 60 countries and works in various emergency contexts. The network of eight national associations (Belgium, Canada, France, Germany, Luxemburg, Switzerland, United Kingdom and United States of America) works relentlessly to mobilize resources, co-manage projects and promote the organization’s principles and actions. Having provided support for the most vulnerable since 1982, HI works and campaigns in order to restore their dignity and give them back a role in the community.

HI in India: HI started its work in India in 1988. It has focused its efforts on building local capacities of local partners to provide improved physical rehabilitation and support to people with disabilities along with their inclusion into disaster preparedness programs. In India, HI supports local partners for actions towards a barrier free and rights based society for people with disabilities and other vulnerable people. The liaison office of HI-India is based in Delhi.

HI in Indonesia and Timor-Leste: HI has started its works in Indonesia in early 2005 and extended its presence and intervention in Timor-Leste in 2012. A regional program framework (2013 – 2017) aims to ensure that, in emergency and development settings, persons with disabilities and vulnerable groups have better access to services and increase their participation in political and public life. HI office is based in Jogjakarta.

Background

In a global context of rising inequalities, and of proclaimed intentions from the upcoming new global development framework to “leave no one behind”, disability issues are still not given sufficient attention. The World Health Organization estimates that approximately 15% of the world’s population is people with disabilities. According to the World Bank, there is an intricate link between disability and poverty and they estimate that people with disabilities represent the poorest of the world’s poor^.[1]Experiencing multiple vulnerabilities, people with disabilities are amongst one of the most marginalized groups in the world and tend to have poorer health, lower education and limited access to economic participation.^[2] They are denied equal opportunities, and remain isolated, marginalized and trapped in poverty. These poor outcomes become even more extreme in developing countries and protecting and promoting the rights of people with disabilities is a global human rights issue^[3].

[1] World Bank: http://web.worldbank.org/WBSITE/EXTERNAL/TOPICS/EXTSOCIALPROTECTION/EXTDISABILITY/0,,contentMDK:2018...

[2] World Health Organization, World Report on Disability, 2011: http://whqlibdoc.who.int/publications/2011/9789240685215_eng.pdf

[3] World Health Organization, World Report on Disability, 2011: http://whqlibdoc.who.int/publications/2011/9789240685215_eng.pdf

Situation in India (focus on Odisha State):

According to the Census of India 2011, India constitutes a total population of 26,810,557 people with disabilities, which makes up to 2.21 per cent of total population, largely living in rural than urban areas. According to Census 2011, 4.6 per cent of the total population on people with disabilities in India resides in Odisha (1.24 million)[1]. Amongst scheduled tribes in Odisha, 2.65 per cent are people with disabilities. Odisha is one of the many states where very few persons with disabilities can access to the services available as one of the poorest state in India. Government of Odisha shows that around 45% of people with disabilities do-not have disabilities certificates (disability certificate is required for any entitlements from government services). Since 2007 and ratification of the UNCRPD^[2] by the Government of India, the government of Odisha has passed a series of laws^[3] that entitle persons with disabilities to benefit from subsidized food rates, pensions schemes, mission Kshyamata (self-employment schemes for people with disabilities involved in Disabled People’s Organizations (DPOs), providing micro finance for income generation activities), health services, rights to education and education scholarships for persons with disabilities. Although these laws are very positive in theory, in practice persons with disabilities in rural and tribal areas are not aware about them. This is because information has not reached those who need them the most, nor are they able to access these rights: due to low literacy rate, people do-not have the capacities to apply for these schemes and because of society stigma they choose not to share openly that they have a person with disability in their house.

[1] [1] http://disabilityaffairs.gov.in/content/page/state-ut-wise-persons.php

[2]United Nations Convention on the Rights for Persons with Disabilities

[3]Modifications of the schemes entitled by the Disability Act 1999 and National Trust Act 2000 passed by Central Government followed by State Government of Odisha.

Situation in Indonesia and Timor Leste

Indonesia

According to basic health research from the Ministry of Health, the prevalence of mild to severe disability is 11% of the overall population. Indonesia has released a disability law on March 17, 2016 – UU no. 8 / 2016 (UU = Undang-Undang / Law or Bill). The new bill highlights the correct disability terms to be used, and is based on the rights-based approach, as a follow up for the ratified UNCRPD (UU no. 19 / 2011). UU n°8 officially replaces the previous law UU no. 4 / 1997 that uses negative connotation and the charity based approach. However, with the decentralization process, this Disability Law at national level must be adapted to provincial and district regulations, for it to be effectively in place and with the obligation for the local government to follow the implementation.

Timor-Leste

Timor-Leste hasn’t signed the UNCRPD yet, but the governments engagement with disability inclusion is demonstrated by the development of a community based rehabilitation strategy in 2010, in line with the ASEAN Decade for Persons with Disabilities and the promulgation of the National Policy for Inclusion and Promotion of the Rights of People with Disabilities in 2012, followed by the National Action Plan for People with Disabilities (2014-2018). Unfortunately the level of priority to implement this action plan is low and ongoing work of the Ministry of Social Solidarity (MSS) and HI on the creation of the national council on disability and the ratification of the UNCRPD are currently on hold due to the elections and upcoming changes in government. National census is including questions on disability (Washington group according to national bureau of statistics). But inconsistency in the use of these questions may explain why the percentage of persons with disabilities went down from 4.6% to 3.2% between 2010 and 2015.

In south East Asia, the UNCRPD has been ratified in 2011 in Indonesia and a recently approved National Disability Policy and the National Disability Action Plan in Timor-Leste provides a potential positive momentum to launch the UNCRPD ratification process in the country.

There is still a long way to go in ensuring that the UNCRPD is appropriately implemented and enforced. Gaps persist between commitments, reach, and impact at community level and the reality of practices and policies actually meeting the needs of individual persons with disabilities. Adequate legislation, policies and implementing regulations at national, provincial and district levels will be vital, as will raising the awareness of authorities, decision makers and service providers for national commitments to result in real changes in the lives of people with disabilities.

Decision makers lack a clear understanding of the UNCRPD and its implications in terms of policy reforms, and do not provide opportunities for people with disabilities to contribute to development and decision-making.

Disabled People’s Organizations (DPOs) can play a meaningful role in challenging exclusion and bringing attention to the rights and priorities of people with disabilities. However, as disabled leaders have had limited access to education opportunities, and as disability issues are given trifling attention and resources, representatives of people with disabilities often lack the capacities to meaningfully engage in and influence policy making.

Service providers and general development initiatives fail to address adequately the needs and priorities of people with disabilities. This lack of access to the full range of services they need to live a decent and meaningful life deprives them from essential human rights. Inclusive development initiatives need to be implemented to demonstrate how it can happen in practice and benefit to the entire society.

General Presentation of the project: “Advocating for Change for Persons with Disabilities”

Objectives

To challenge this situation, and in line with the general principle and purpose of the UNCRPD, HI proposed through this project to enhance participation of people with disabilities, and work with their representative organizations (DPOs) as key agents for change. People with disabilities in South East and South Asia are indeed an untapped yet vital resource for making critical changes towards inclusive development, in alliance with other civil society movements.

The project therefore aims to challenge this situation by equipping DPOs to engage effectively in promoting the rights of people with disabilities, through (1) consistent capacity development strategies and (2) pragmatic involvement into inclusive development practices that demonstrate an immediate impact for their constituencies.

The proposed intervention strategically combines:

• Country-level interventions in India, Indonesia and Timor-Leste, tailored to the realities and priorities of each context, addressing specific capacity development needs of DPOs and stimulating inclusive development practices to advance participation of people with disabilities in practice,
• Regional exchange and capacity development, addressing needs that have been identified common to these countries, and fostering exchanges on good practices in inclusive development and on issues of common concern for DPOs in South Asia and South East Asia.

By developing their capacities as legitimate and functioning organizations, representing people with disabilities effectively at national, provincial and district level; by ensuring that disabled advocates acquire an in-depth understanding of the UNCRPD and its implication; by strengthening their technical expertise in leading advocacy and awareness raising actions; by developing expertise in policy reform; and by developing and documenting good practices to feed into such advocacy initiatives, DPOs will be in a much stronger position to reach out at different levels and effectively advocate for change.

The proposed project can be considered as a second phase of intervention, which builds upon the results achieved and addresses the challenges faced during the implementation of this previous BMZ funded project. Phase 1 included the three target countries as well as Bangladesh, and was complemented by a GIZ funded project for Indonesia and Timor-Leste, and organized 2 regional initial training on the Making It Work methodology (see below). Evaluations from phase 1 brought about interesting recommendations, and in particular gaps in DPOs’ understanding of the UNCRPD was identified as one limit to engage in effective advocacy and know what to ask for, or how to identify a practice as “good” (i.e. CRPD compliant). Phase 2 intended to sustain the regional component to address issues common to the three countries, designed to address the recommendations received from evaluators. It will also include specific actions depending on each country as described below. HI is now proposing a 3^rd phase of BMZ funding of this project. Other opportunities of funding from GIZ/EU have been identified, especially in Timor-Leste.

Country Level Objectives and intervention

• India:
• Duration of the project: 15 months (from October 2015 to December 2016).
• Location: India – Odisha State (Koraput, Rayagda and Khordha Districts)**
• Implementing partner: EKTA (Koraput)
• Overall objective: To contribute to improved access to rights of persons with disabilities as per the UNCRPD in Odisha State
• Specific Objective: To strengthen Disabled People’s Organizations (DPOs) to promote the rights of persons with disabilities through evidence-based advocacy at districts and state levels in three districts of Koraput, Rayagda and Khordha on Odisha State.
• Direct beneficiaries: 10 representatives of the local NGO partner- EKTA; 30 representatives of 10 DPOs (3 from each DPO) in three districts; 60 government stakeholders, public/private service providers
• Indirect beneficiaries*:* 54,450 (approx.) people with disabilities and 217,800 (approx.) family members and care givers in 3 targeted districts.

Expected Results and related activities:

ER1: DPOs have improved their capacities on (i) problem analysis (including barrier assessment), (ii) advocacy and (iii) organizational management

A1.1 Develop selection criteria, selection of 10 DPOs in the three districts and sign of MoUs with EKTA

A1.2 Assess needs of 10 DPOs for capacity-building, development of modules and develop IEC material

A1.3 Train and build capacities of 10 DPOs on simple problem analysis tools, organizational development and programmatic needs of DPOs (3 from each DPO, total 30 DPO members will be trained at State level)

A1.4 Support 10 DPOS to collect evidence on main problems faced by women and men, boys and girls with disabilities in their areas of operation

ER 2: DPOs are empowered to collect good practices on the problems identified on accessing rights for persons with disabilities

A2.1 Set up the MIW working groups in each district (3 districts) and at State level for collection of good practices based on the identified problems

A2.2: Train 10 training on MIW methods, setting of the selection criteria for good practices collection

A2.3 Strengthen capacities of 10 DPOs for collection of good practices based on the problems identified

A2.4 Support to 10 DPOs in development of advocacy plans in three districts

A2.5 Develop and produce IEC materials for advocacy and awareness raising messages

A2.6 Organize dissemination workshop on good practices documented for policy influence and advocacy

ER 3: Each DPO is engaged in removal of barriers in their operational district and strengthening of the existing service provision system for equality and equity, in collaboration with other social change actors

A3.1 Support to implementation and monitoring of community assessment of barriers and facilitators to participation mapping

A3.2 Support to 10 DPOs on community mobilization, advocacy on rights of persons with disabilities, advocacy action for inclusive service provisions from government/ public/ private sectors

*A3.**3* Carry out sensitization of service providers on identified problems, needs of persons with disabilities, accessibility issues for effective services mobilization

A3.4 Document action for change, good practices in DPO advocacy and share at State level workshop for replication

Indonesia:

Duration of the project: 24 months (from October 2015 to September 2017)

Location of the project: Kupang Municipality in Nusa Tenggara Timur (NTT) Province and Gunungkidul district in Yogyakarta (DIY) Province.

Overall objective: To enhance effective participation of people with disabilities in local inclusive development efforts and their promotion at national level

Specific objective: Enhance and monitor the access of people with disabilities to local governance processes and public services.

Implementing partner: CIQAL, Bengkel Appek, Perkumpulan IDEA

Direct beneficiaries: 48 members of 4 local DPOs in Yogyakarta and NTT provinces; 36 persons from Kupang municipality and Gunungkidul district local governments and 4 target village administrations; 24 members of 4 local NGOs and civil society forums working on good governance in Yogyakarta and NTT provinces; 16 representatives of national DPO platforms

Indirect beneficiaries: 531,000 people with disabilities in Yogyakarta Special Province (15% of the 3,540,000 inhabitants) and 801,600 people with disabilities and their relatives in East Nusa Tengarra Province (15% of the 5,344,000 inhabitants). In targeted village and districts, the general population will also benefit from increased accessibility to social services and development policy.

Expected Results and related activities:

ER1: In Gunungkidul district and Kupang municipality, local governance processes and social services include persons with disabilities

A1.1 Organize, together with organizations of people with disabilities (DPO) and fora for inclusive development, awareness-raising sessions at village, sub-district and district levels on the participation of people with disabilities in local development processes and right to access to social services

A1.2 Implement in collaboration with DPOs a territorial assessment of the situation of persons with disabilities in Kupang municipality (NTT) and one district of DIY province, with a specific emphasis on the access to social services (social security, public health centers, registers office)

A1.3 Organize workshops with local authorities, service providers, DPOs and other civil society organizations to discuss the findings of the assessment and define priorities to be included in local development plans, so that they adequately address the needs and priorities of men and women with disabilities

A1.4 Facilitate a local multi-stakeholders committee to identify, document and analyze good practices in making public infrastructures and local services inclusive of and accessible to men and women with disabilities (using the Making it Work methodology)

A1.5 Provide training and coaching for DPOs on evidence-based advocacy methods and inclusive service-delivery policies

ER2: In 4 villages of Gunungkidul district and Kupang municipality, accessibility of public infrastructure and social services for persons with disabilities is increased.

A2.1 Provide a Training of Trainer to DPOs on accessibility, reasonable accommodations and universal principles, with a focus on information and communication means (sign language, audio caption and software solutions etc.).

A2.2 Train social service providers and local authorities on accessibility and universal design:

A2.3 Support DPOs to implement accessibility audits of social services (social security, public health centers, registers office) at village and sub-district levels in the two target districts

A2.4 Support social services providers and local authorities to implement pilot projects and inclusive actions aiming to improve access to their services and infrastructures (considering accessibility of both physical infrastructures and information and communication means) and ensure their incorporation in local development plan

A2.5: Strengthen coordination between DPOs and other CSOs to mainstream disability issues in local governance and social services delivery fora:

ER3: In Yogyakarta and NTT provinces, oversight mechanisms of local governance processes involving DPOs and other civil society organizations are developed

A3.1 Reinforce capacities of DPOs and CSOs to advocate for the inclusion of men and women with disabilities in local governance processes and social services delivery using good practices

A3.2 Support DPOs and other concerned civil society actors to establish a participatory monitoring mechanism for the accessibility of public infrastructure and social services, using international references and the criteria developed to evaluate good practices in accessibility of public infrastructures

A3.3 Support DPOs in the target areas to define a simple participatory method to assess the disability-inclusion of local governance and decision-making processes (adapting the Participation Index used by HI in other contexts)

A3.4 Organize national workshops for DPOs to promote local good practices for inclusive development in NTT and DIY provinces and coordinate on UNCRPD monitoring mechanisms

Timor Leste:

Duration of the project: 24 months (from October 2015 to September 2017)

Location of the project: Dili, the capital city of Timor-Leste and Liquica district.

Implementing partner: Klibur Domin, Ahisaun, Resomliq, ETBU, Caucus, HDMTL

Overall objective: To enhance effective participation of people with disabilities in inclusive development efforts at local and national levels

Specific objective: Support the creation of favourable conditions for the ratification of the UNCRPD in TimorLeste, through supporting the preparation of adequate institutions and policies at the national level, and setting model practices of disability-inclusive governance and economic empowerment at the local level.

Direct beneficiaries: 32 representatives from 4 local NGOs/platforms working for People with Disabilities and 4 DPOs ; 35 executives staff from MSS and 10 Ministries/State secretaries; 20 representatives from self-help groups in 4 sucos (villages); 16 representatives from village councils in 4 sucos; 20 young persons with disabilities and their families; supported to participate in vocational/literacy training programs;20 staffs from CNEFP Tibar and other literacy course/vocational training service providers.

Indirect: 49,500 persons with disabilities in Timor-Leste^[1] and their families, as well as the total population of the country (1,178,000 persons)

[1] 4.5% of the total population. Source 2010 national census.

Expected Results and related activities

ER1: The Ministry of Social Solidarity is supported to establish, set-up and/or implement relevant institutions, mechanisms, policies and processes towards becoming a Party to the UNCRPD

A1.1 Maintain support to the Ministry of Social Solidarity in particular, to engage into actions towards ratification of the UNCRPD

A1.2 Support the organization of regular inter-ministerial coordination meetings aiming at promoting the UNCRPD, Incheon strategy and supporting the effective implementation of the NDAP

A1.3 Support setting-up of a timeline of the administrative and legal steps towards signature and ratification of UNCRPD

A1.4 Support the setting-up of the National Council for the Rights of People with Disabilities and the dissemination of the timeline for the signature and ratification of the UNCRPD

A1.5 Provide coaching to the National Council for the Rights of People with Disabilities members and DPOs to review and monitor the implementation of the National Disability Action Plan/Incheon strategy including gender disaggregated information

ER 2: In 4 sucos of Bazartete & Liquica sub-districts, model(s) of inclusive local governance are established in line with the National Disability Action Plan and the decentralisation reform.

A2.1 Provide training on local governance, leadership and rights of persons with disabilities to participate in local decision-making for Self-Help Groups members

A2.2 Support experience-sharing on access to local governance, leadership and participation in local decision-making processes for people with disabilities facilitated by Self-Help Groups members

A2.3 Implement in 4 sucos a territorial assessment of facilitators and barriers to access vocational training and livelihoods services using participatory methods (gender disaggregated data

A2.4 Support 24 Self-Help Groups and DPOs members to implement micro-level advocacy initiatives based on the findings and recommendations of the territorial assessment on the participation on the participation of people with disabilities in village/suco governance mechanisms (including gender specific actions)

A2.5 Provide coaching to 24 Self-Help Groups and DPOs members to monitor the inclusion of recommendations from the territorial assessment on the participation of people with disabilities in local governance mechanisms (using the adapted Participation Index)

A2.6 Facilitate a multi-stakeholder committee (including representatives of DPOs, authorities, service providers) to identify, document and analyse existing good practices that facilitate the participation of men and women with disabilities to local governance mechanism (using the Making it Work methodology)

A2.7 Organize a national workshop to share lessons learned from micro-advocacy and territorial assessment on vocation training and livelihood and to share good practices on inclusive local governance to inspire policy reform and/or replication in other districts of the country

ER3: In 4 sucos of Bazartete & Liquica sub-districts young persons with disabilities build vocational capacities and increase livelihood opportunities.

A3.1 Provide technical support to the vocational training center (CNEFP) to ensure further development of the enrolment of men and women with disabilities

A3.2 Develop peer support/support networks for youth with disabilities enrolled in literacy/vocational training courses

A3.3 Support referral to rehabilitation and provision of assistive devices enabling youth to enroll

A3.4 Ensure regular coordination with the State Secretary for Professional Training and Employment (SEPFOPE) about the access of men and women with disabilities to vocational training sessions and employment

A Regional Initiative

Through its experience of working with DPOs in low and middle income countries HI has identified the need to develop capacities of DPOs to effectively advocate for the implementation of the UNCRPD. The holistic nature of the UNCRPD which calls for policy and societal reforms at all levels results in complexity in terms of the translation of its provisions in different contexts. Enacting the provisions enshrined in the UNCRPD in a context of limited resources implies a difficult exercise of prioritization without lowering the standards of the Convention. For this, it is essential that stakeholders – and DPOs in particular who play a lead role in holding States accountable – have an in-depth understanding of the implications of the CRPD, as well as a sound knowledge of mechanisms for public policy reform including budgeting. As a result of such challenges, an increased demand for additional guidance on CRPD implementation and monitoring is coming from DPOs in the three countries of this action.

This regional action proposed in this project aimed to contribute to uplift the capacities of disabled advocates through the adaptation of BRIDGE Training at national and local context. BRIDGE aims to accelerate the implementation of the UNCRPD through the empowerment of the national disability leadership so that they acquire an in-depth understanding of the Convention, acquire skills to analyze development with a CRPD lens (module 1), and connect it with the mechanic of public policies to improve people with disabilities’ access to services (module 2). Based on the ToTAL training led by the International Disability Alliance^[1] (IDA), and piloted by HI and IDA in West Africa and the Maghreb region^[2], the BRIDGE training aims to bridge the gaps between human rights and development, national advocacy and grassroots realities.

While BRIDGE focuses on training national disability advocates at the regional level, this regional action proposed to link with and adapt this training to the needs and priorities of disability leaders at sub-national level in the three project countries (modules, adapted to each sub-national situations, to be conducted in India and Indonesia; in addition, regional trainers, already engaged in ToTAL or BRIDGE during previous actions, will continue to develop their capacities (module 2 and/or 3) to be better equipped as trainers in their countries, in support to sub-national initiatives).

Furthermore, the three countries will continue using Making it Work (MiW)^[3], a methodology for documenting good practices on inclusion of people with disabilities and using these as evidence and recommendations for further advocacy. Experienced technical expertise will be mobilized to ensure adequate levels of technical support all along the project cycle in the three countries, driving a coherent capacity development approach through ToTAL, but also providing targeted support to enact the capacities imparted through the training, e.g. technical assistance to the Ministry of Social Solidarity in Timor-Leste towards ratification and implementation of the national disability action plan, as well as the facilitation of evaluations and consolidation of countries’ reports.

Experienced technical expertise will be mobilized to ensure adequate levels of technical support all along the project cycle in the three countries. This action will develop and implement a coherent capacity development approach using and building on the BRIDGE experience, but also providing targeted support to enact the capacities imparted through the training, with a learning by doing approach. For example, technical assistance will be provided to engage with the Ministry of Social Solidarity in Timor-Leste towards ratification and implementation of the national disability action plan.

[*1]*IDA is an international organization of persons with disabilities and their families. The aim of IDA is to promote the effective and full implementation of the United Nations Convention on the Rights of Persons with Disabilities (UN CRPD) worldwide, as well as compliance with the CRPD within the UN system, through the active and coordinated involvement of representative organizations of persons with disabilities at the national, regional and international levels.

[2] IDA has also implemented ToTAL in India and the Philippines, as well as in the Pacific region, and replication/ roll-out of this training initiative are being planned by IDA, HI and other organizations in South East Asia, Latin America and Eastern Africa.

[3]http://www.makingitwork-crpd.org/

Objective of the evaluation

This external evaluation will aim to capture the work done by HI along with its partners in the three countries. The evaluation will assess the overall quality of the implementation of the BMZ supported project, in line with HI Monitoring and Evaluation Policy; it will focus on the following criteria: relevance, the effectiveness, the impact and the sustainability of the project. It will be clearly documented; it will present lessons learned (especially in Timor-Leste), conclusions and practical recommendations for approaches to be used for the next phase / other projects being developed.

The geographical location for evaluation would be at project level (3 countries) and field works should be conducted at different administrative units as stated above in country level project information).

Evaluative Questions should be assessed and answered with gender and disability considerations whenever relevant.

• Relevance :

° Needs : How well the project fits the needs of the people in the targeted community.Is there any important intervention missing? Is there an emerging need that should be addressed? Are the activities and outputs of the outcomes consistent with the overall objectives and the attainment of its objectives/outputs and with the intended outcome and impacts?

°Context : How flexible was the project to react to unidentified needs and was the team able to re-align project deliverables to better meet needs that were not initially met? What are the specific needs in terms of DPOs strengthening, in remote and tribal populated context?

• Changes :

°Effect : Does the project bring about positive short- and medium-term changes in the lives of the beneficiaries and their families Focus on impact on the economic and social inclusion of households with persons with disabilities)? Does the project contribute to a tangible empowerment of persons with disability?

°Impact : Does the project helps to bring about long-term positive effects on the lives of beneficiaries and their families Focus on impact on the economic and social inclusion of households with persons with disabilities. Does the project contribute to a tangible empowerment of persons with disability?

• Sustainability :

°Anticipation : Is the post-project phase anticipated and planned from the outset

°Continuity :

• Has the intervention met the identified needs of the populations?

• What are the unmet needs that would justify the continuity of the action?

• Has the project's activity been transferred to other stakeholders in a position to continue it (looking at different stakeholders involved in the different results)?

• What are the elements contributing positively/negatively to the sustainability?

• To what extent capacity of the project stakeholders (vocational training centers, SHG, partners) have been developed on disability and livelihoods issues in a way that can be sustained even after the project? What are the achievements made by HI to partner organization in India (EKTA) in terms of their capacity building since beginning of the project?

What is the potential for sustainability / scale up / replication of actions and approaches?

• Effectiveness :

° Faesibility : To what extent is the overall objective achieved? What are the major factors influencing the achievement or non-achievement of the objectives (for instance, related to team capacities)? Any activities that should have been added in order to achieve objectives?

°Product / Service : Are the project's outputs of the required quality, in compliance with HI's and/or international technical standards? Are there areas that could have benefitted from appropriate/further technical support?

• Efficiency :

°Strategy : As the project intervenes at different level and works with various stakeholders across the different results, how the links between results has been thought and implemented in terms of implementing strategy?

°Flexibility : The project is flexible and adapts to the evolving needs and risks (operational constraints and opportunities) What were the challenges (operational) faced during implementation period, and solutions that HI put in place/should have put in place to overcome them

°Optimization : The necessary resources are mobilised and optimised throughout the project. Project and support teams (HI and partners) know their roles and offer a timely, cost-effective and quality contribution (operational, financial...). Controls are in place for monitoring activities, compliance with HI rules and the effects of the project, allowing corrective measures to be taken where necessary

• Participation :

°Consultation : Extent of level of consultation of beneficiaries and project stakeholders in project implementation cycle

°Expression : Beneficiaries have the means to express their opinions (complaint mechanisms, satisfaction surveys...)

°Understanding : Beneficiaries agree with the priorities defined for the project and understand the expected benefits. To what extent project beneficiaries participate and reflect on ownership of the project?

• Cooperation :

°Involvement : Partners are kept regularly informed and involved in decision-making processes concerning the project's steering and implementation

°Results : Partners actively contribute towards the project's success

• Synergy :

°Cooperation : To what extent the team and partners coordinate with existing governmental schemes that could multiply project’s impact?

°Complementarity : Which synergy / complementarity between different results, especially in Timor Leste

• Ethics :

°Values : The project applies the ethical principles promoted by HI (Humanity, Solidarity, Impartiality and equity, Independence and Commitment)

Expected results of the evaluation

1. An assessment of the overall project’s results and approaches is carried out taking into account the different contexts with a view to increase impact and sustainability in the next phase of the project
2. Strengths and weaknesses of the project’s methodology and implementation procedures are identified and analysed, with a view to increase efficiency and effectiveness

Methodology

The expert (or the team of experts) shall propose a participatory evaluation methodology (including a gender approach), addressing main project stakeholders as well as beneficiaries and their families. Activities are expected to include:

• Review existing project documentation
  1. Phase 1 Project and External Evaluation Reports
  2. Phase 2 Project proposal, reports, M&E tools,
  3. Training manuals, workshop minutes, advocacy documents, IEC material…
• Meet with relevant stakeholders: HI team (HQ, Coordination, Field), DPOs, partners, government stakeholders…
• Carry out field visits to interview beneficiaries of different backgrounds/types of activities; conduct Focus Group Discussion or Semi Structured Interview as appropriate

HI will provide the consultant with all project documentation.

Travels to India (Odisha, all 3 districts preferably), Indonesia (Yogyakarta, NTB and NTT provinces) and to Timor Leste (Dili) will be necessary to perform field visits.

Deliverables :

The consultant in charge of the assignment will produce:

• Inception Phase Report (incl. evaluation methodology and tools) to be validated prior to the field mission
• Draft report, to be validated before submitting a final version. Feedbacks from HI will be required mainly on recommendations’ part (to be accepted by HI team).

• A final report that should not exceed 50 pages for the three countries. The report will describe the evaluation (background, methodology, tools), the evaluation findings, lessons learned and recommendations. It should include:

• Executive summary common for the two projects (maximum 2 pages)

• Three sections (one per project) that should be organized as following:

• Introduction

• Description of the intervention evaluated

• Analysis of the information compiled

• Results

• Conclusions

• Challenges and lessons learned

• Recommendations

• Annexes:

• Initial and final terms of reference of the evaluation

• List of persons interviewed

• List of documents reviewed

• Final timetable of evaluation

• Tools used for data collection

• Preliminary results presentation and report of the meeting

• Detailed analysis if relevant

Timeline and Logistics Arrangement

The evaluation is expected to take place during the month of September, with the submission of the final report on the 29^th of September at the latest. This evaluation is including a field mission in India, Indonesia and Timor-Leste expected to take place for 2-3 weeks.

The consultant will be in charge of the planning of his interventions in the field with the support of the project team.

The work schedule will be subject to following restrictions:

o International travel days are not working days

o Inception phase: maximum 3 working days (payable)

o Full time local travel days are considered working days but are paid 40% of the daily consultancy fee

o Weekends are not working days, except when agreed

o Reporting phase (final report): max 0,5 working day (payable)

The consultant will:

o Organize and pay return flights (economy class) from the consultant’s country of residence to countries of evaluation (location – if applicable) according to the agreed work schedule;

o Pay his/her country entry visa fee. (Business visa)

o Organize and pay his/her stay in evaluation location (transport, meals and accommodation)

o Organize and pay adequate medical insurance coverage including repatriation. Provide proof of adequate professional, third party liability insurance or a discharge of responsibility by which he/she responds personally to any damages caused to third parties by his/her act.

o Provide a proof of its freelance worker’s official status and the documents evidencing the legality of his/her activities in his/her country of domicile.

Handicap International will:

o Assist in getting country entry visa into countries of implementation (location) (Business Visa)

o Provide logistical support and cover the costs for meetings, workshops and training with HI, partners and stakeholders’ staff.

o Provide an external interpreter to English when necessary

o Make available relevant documents to the consultants.

o Provide working space, access to the internet, telephone usage and office services

Note that NO per diem will be paid to the consultant. Also, international travel days will not be considered as working days and will not be paid. Local travel days (between project’s sites) will be paid 40% of the consultancy fee.

The consultant financial proposition will solely include the consultant’s fee in Euros.

Note that the total budget available for this consultancy (all inclusive) cannot exceed 13.000 €

Expertise required:

The expert (or team of experts) who will undertake this assignment should have the following skills, experience and knowledge:

• Experience in project evaluation and related methodologies, preferably in South and South East Asia.
• Experience in conducting interviews and discussion groups with different actors (Ministry officials, community leaders, marginalize group, etc.).
• Experience in the field of advocacy and inclusive development in developing countries.
• Experience working with persons with disabilities, alternatively with other groups in situation of vulnerability
• Practical knowledge of rights-based and gender approaches
• Familiarity with India and / or Indonesia and Timor-Leste culture is an asset.
• Excellent spoken and written English
• Knowledge of local language will be considered as an asset.

Candidates should submit the following information with their application:

1.Brief cover letter

2.Curriculum vitae and list of previous assignments, highlighting those focused on similar project evaluations. Please include two references and mention earliest availability to start the mission.

3.A financial proposition for the consultancy (refer to terms and conditions)

Complete applications should be sent to: Anne-Lyse COUTIN : alcoutin@handicap-international.org

Subject of the e mail: Advocating for Change BMZ 2 - Final Evaluation / Application

Deadline for submission of applications:

15th of August 2017

Applications submitted after the deadline will not be considered.

The selection will be done by HI Federation in August 2017. Selected applicant will be informed by 17th of August 2017 at the latest and is expected to arrive in country between the 21st of August and the 01st of September. Only short-listed applicants will be informed by e mail.