
Posted date | 27th March, 2025 | Last date to apply | 8th April, 2025 |
Country | Pakistan | Locations | Khipro |
Category | Accounting/Auditing | ||
Type | Consultancy | Position | 1 |
Experience | 8 years |
TERMS OF REFERENCE (TOR)
Title of Assignment: |
Final Evaluation of the Project |
Project Title: |
Khipro 5C'S Project |
Donor: |
Humedica International-BMZ |
Location: |
Khipro, District Sanghar, Province Sindh, Pakistan. |
1. Introduction/Background
The Province of Sindh is rich in natural resources; it is also subject to a host of environmental and development issues. There is a severe water shortage in the province, especially in the arid and desert areas of interior Sindh. The poor and poorest of the poor live in the areas that are most deprived and lack basic resources. The land is afflicted by desertification, waterlogging, and salinity. Water is an increasingly contested issue in Sindh. The province has been facing severe water shortages in recent years, which have exacerbated other cross-sectoral issues. Scant rainfall and the politicization of water distribution to the provinces are leading to both economic and social hardship. District Sanghar has a medium development ranking (0.637) among the districts of Pakistan according to the Human Development Index. The sub-district (Tehsil) Khipro is a neglected region of Sanghar because of its distance from the District Headquarters and little representation in Federal and Provincial Assemblies. Inadequate funding for development activities and little interest from the Government have left many communities with facilities that are inadequate and in urgent need of improvement. Women, in particular, are often compelled to travel long distances to fetch water for drinking and domestic purposes. Open defecation is still widely practiced in these areas, resulting in high diarrhea and vector-borne diseases, particularly among children. According to ECHO, 27% of the population in Sindh is moderately to acutely food insecure. A lack of access to WASH facilities and medical services exacerbates food security and nutrition conditions. Landless agricultural laborers, pastoralists, and sharecroppers are most vulnerable and the worst hit. In light of the above-mentioned observed problems and difficulties, Khipro is one of Pak Mission Society’s three Integrated Development Areas (IDA), along with Rajanpur and Kohistan. The area has been selected because of the innumerable challenges faced by its high percentage of marginalized, indigenous, and minority populations and the authentic need for health, nutrition, WASH, livelihood, education, environment, and disaster preparedness initiatives. The area chosen for the series of proposed interventions is Tehsil Khipro. Through two consecutive interventions, supported by Humedica and BMZ, Pak Mission Society has positively intervened in 35 villages and, in the proposed project, will further engage the said communities and facilitate 125 communities and establish 25 clusters.
Problem Statement:
The economy of Sindh province is primarily driven by irrigated agriculture, with wheat, rice, and cotton being the main crops. However, increasing water shortages are leading to more frequent droughts. The situation regarding agricultural yields and access to food, particularly for the large population of landless people, is deteriorating across the province, with a high proportion of children under five being underweight.
The majority of cultivable land is owned by large landowning families, and the latifundia are managed by tenant farmers. These farmers, often in a weak position, have become continuously indebted, leading to complete dependency on landlords in the form of bonded labor.
Building on the results of project interventions in 125 villages, which primarily focused on improving drinking water supplies, hygiene, and establishing self-help structures at the village level, the project aims to create self-help structures at higher levels that can serve as permanent and competent representatives in dealings with government agencies and landowners. The capacity of self-help groups at three levels – village/hamlet, village cluster, and union council – will be strengthened, enabling them to independently plan and implement development initiatives within their communities. Additionally, representatives from the target groups, as registered entities, will be empowered to establish connections with other actors in the civil society sector, join networks, and gain support for their legitimate concerns.
- 1. Project Outcome/Outputs
Impact: The social and economic situation of landless agricultural labourers and small tenants in Khipro sub-county will in the long-term improve.
1.1 Outcome includes:
The population of 125 villages effectively and actively promotes their social, legal, and economic situation, advocates their legitimate rights and cases, and positively influences decisions affecting their situation.
Outcome indicators:
- Three target group representations at Union Council level have been officially registered as Community Based Organizations (CBOs) representing 125 village target group representations (VDC: Village Development Committees) and have started their work.
- In at least 80% of the decisions that have been taken at upper administrative level in relation to the 125 village communities, since the start of the project, target group representatives have been involved.
- 50 % VDCs have prepared new micro project schemes rated sufficiently feasible by the project engineer. For 40% of these schemes contacts with potential supporters have been established.
- In 25 village communities, other local development initiatives supported by governmental or non-governmental agencies have been launched, in addition to the micro projects supported by the project.
- 70% of targeted 125 communities showed "high organisational maturity" score on Maturity Index Calculation (community members representation, gender mainstreaming, VDPs, record keeping, regular meeting etc).
- 75% of Human Rights issues arising during project period have been addressed and solved in equitable manner.
- 50% human rights related issues have decreased throughout the project period.
Outputs:
- At the Union Council level, three Community Based Organisations are registered as target group representations and represent the interests of 125 target villages to government agencies and potential sponsors.
- The targeted communities on village and Union Council level are equipped with development approaches enabling them to identify and implement development initiatives in their area.
- 3 UC level representative organizations (CBO) have access to relevant government institutions and are equipped to lobby for services at government agencies.
Output Indicator-1:
- Three Union Council representations are registered as CBOs (Community Based Organisations) by the Welfare Department.
- 90 % of the Village Development Committees (VDC) of 125 villages are represented in these Union Council Committees (CBOs).
- The Village Development Committees (VDC) and Union Council representations (CBOs) hold regular meetings (monthly to quarterly) and are take meeting protocols.
- All three CBOs have established contacts with institutions and persons who can support them in asserting their legitimate interests - legally and otherwise - e.g. NGOs, legal advisors, organisational consultants, UN, sponsors, and can provide information about these contacts.
Output Indicator-2:
- 75 % of the targeted communities have written Village Development Plans.
- In 100 of 125 micro projects of target communities, community representatives have independently managed and made arrangements for sustaining the results, according to an assessment by the project team.
- 100% of the communities managing small projects, for that VDCs maintain financial records using procedures that ensure transparency and accountability (Cash books, receipts)
Output Indicator-3:
- 75 % of the target villages - represented by their VDCs - have used the advisory services of the government agencies, 30 % of them several times.
- 30 % of representatives at cluster level made at least two additional visits to the relevant authorities in addition to the visits organised by the project.
- 75 % of 450 randomly selected community members from 15 target villages name responsibilities of government institutions and how to address them.
Final Evaluation:
The project was implemented from December 2021 to November 2024. Initially, it was set to end in November 2024, but after a five-month extension, it will now conclude in April 2025. This is a mandatory final project evaluation required by the project donor, Humedica International-BMZ Fund, to assess the effectiveness, relevance, efficiency, coherence, sustainability, and impact of project initiatives.
2. Objectives
The objectives of the evaluation are summarized below:
- To evaluate the project in terms of its effectiveness, relevance, efficiency, coherence, sustainability, and impact, with a primary focus on assessing the expected results and outcomes.
- To identify key lessons learned and potential practices for future learning.
- To assess challenges encountered, highlight best practices, and document outcomes for future processes.
- To provide recommendations for similar future interventions as well as for new initiatives in the targeted areas.
3. Scope of Work
The evaluation will cover the entire project duration from December 2021 to November 2024, including the five-month extension until April 2025. During this period, the evaluation will assess project outcomes at all levels, including result-based management, beneficiaries and project stakeholders, timeline, budget, inputs, and resources. The impact assessment will provide a comprehensive evaluation of the project's interventions in the targeted villages, focusing on the overall impact and relevance of the project. It will analyze the effectiveness of project management and activity implementation in terms of budget consumption and efficiency.
The evaluation will closely examine the results achieved, the coordination with local line departments, and the level of involvement of stakeholders and beneficiaries in the project interventions across 125 target villages.
Additionally, the assessment will identify challenges faced and best practices utilized for future engagement. The review will include feedback from the target group or beneficiaries, representing a diverse group that includes males, females, children, vulnerable individuals, minorities, transgender individuals, and the elderly from the target areas.
Overall, the impact assessment will provide valuable insights into the strengths and weaknesses of the project, enabling informed decisions for future interventions and ensuring sustainable positive impacts on the communities in the 125 target villages approx. 19,000 persons in 2,750 households; the VDCs of these villages; and the new committees to be formed: 25 cluster committees; 3 CBOs.
4. Timeframe
(Outline the estimated working days for each activity in a table.)
Activity |
Working Days |
|
02 |
|
02 |
|
10 |
|
02 |
|
04 |
|
02 |
Total Working Days |
22 |
5. Deliverables
The following are the expected deliverables:
Sr.# |
Deliverables |
Detail |
Timeline/days |
1 |
Proposed work plan and tools |
Proposed work plan and evaluation questionnaires to be submitted within 02 days following the official initiation of the evaluation. |
2 |
2 |
Fieldwork |
Training of enumerators, testing of tools and final validation |
2 |
3 |
Data Collection |
Briefing, deployment of enumerators, data collection and post field work debriefing. |
10 |
4 |
Presentation of Data (excel sheets) |
Lead Consultant to present analysed summary of field data before the writing the first draft report. This will allow for review, questioning and field follow up and cross validation of the data. |
2 |
5 |
Draft of Evaluation report |
The evaluator must submit draft report for review and comments by all parties involved after analysis of the field data. Both the PMS management members and other related stakeholders in the evaluation must review the draft evaluation report to ensure that the evaluation meets the required quality criteria. |
4 |
6 |
Final Report |
Report and database will be submitted 2 days after receiving comments from the PMS management members and other related stakeholders. The content and structure of the final analytical report with findings, recommendations and lessons learnt covering the scope of the evaluation must include the following: • Executive summary • Introduction • Description of the evaluation methodology • Situational analysis with regard to the outcome, outputs • Analysis of opportunities to provide guidance for future programming • Key findings, including best practices and lessons learned • Conclusions and recommendations • Appendices: Terms of reference, field visits, people interviewed, documents reviewed. • After the final report, LFA-based reporting will be required
|
2 |
6. Methodology
1. Evaluation Methodology:
The proposed methodology for the endline/final evaluation will combine qualitative and quantitative data collection and evaluation techniques. The methodology will be developed by the consultant, as well as all relevant tools and presented in the inception report. The data collection should include the use of a number of approaches to gain a deeper understanding of the outcomes of the project, including,
- Desk-base review: The evaluation will review relevant project documents and content produced before and during project implementation including the project proposal, work plans, project progress reports, annual project reports and other documents produced by or associated with the project.
- Survey: Kindly make a sample estimation part of the technical proposal according to the population of 125 villages across four Union Councils (UCs) of District Khipro. The total population of 125 villages as per baseline was 21161.
KII Interviews: In addition to the desk review, the evaluation will also conduct interviews of key project stakeholders using a structured methodology developed by the consultant.
ü Livestock Department
ü District Administration
ü Public Health Department
ü Social Welfare Department
ü NGO/INGO
ü PMS Staff/HO Staff (if required)
- Focus Group Discussions (FGDs):
Data will also be collected using focus groups discussion with the key project stakeholder. The details of FGDs are below.
ü 10 FGD’s will be conducted with Village Development Committees (VDCs)
ü 5 FGD’s with Female groups
ü 5 FGD’s with Male groups
ü 03 FGD’s will be conducted with (CBO’s) from each union council
1.1 Evaluation Questions
The evaluation will be guided by the following questions by keeping DAC criteria in focus.
Sr.# |
Evaluation Criteria |
Mandatory Evaluation Questions |
1 |
Relevance |
|
2 |
Effectiveness |
These questions will be applied in 125 villages.
|
3 |
Efficiency |
These questions will apply in 125 villages. |
4 |
Sustainability |
These questions will apply in 125 villages. |
5 |
Impact |
These questions will be applied in 125 villages. |
6 |
Learning and Replicability |
These questions will be applied in 125 villages. |
7. Selection Criteria
The Evaluator shall have the following expertise and qualifications:
Required Qualifications
- Education: At least a Master’s degree in Public Policy, International Development, Development Economics/Planning, Economics, International Relations/Diplomacy, or any other relevant field.
- Expertise in Aid Effectiveness and Management: Extensive expertise, knowledge, and experience in aid effectiveness and aid management processes.
- Project Evaluation Experience: At least 08 years of experience in project formulation, evaluation, and conducting end-of-project evaluations, particularly in Sindh or similar contexts.
- Experience with International Organizations: Proven experience working with international organizations, donors, and evaluating projects.
- Survey and Evaluation Experience: Past experience in conducting surveys, particularly evaluations of German donor-funded projects (Optional).
- Language Proficiency: Excellent written and verbal communication skills in English. Knowledge of Sindhi and Balochi will be considered an advantage.
Expertise in Localization and Resilience
- Proven experience (minimum 08 years) in localization and resilience-building initiatives, particularly in mobilization projects within marginalized regions.
- Demonstrated ability to assess and strengthen local actors' capacities in governance, humanitarian response, and sustainable development.
In-depth Knowledge of Localization within the Framework of the 18th Amendment
- Excellent understanding of the constitutional, legal, and policy frameworks governing localization in Pakistan, particularly post-18th Amendment.
- Familiarity with the roles and responsibilities of provincial and local governments in disaster management, governance, and service delivery mechanisms.
- Successfully completed at least 2–3 similar assignments in the past.
Technical Expertise in Governance, Localization, and Humanitarian Coordination
- Extensive knowledge of localization principles, governance structures, and humanitarian coordination mechanisms in Pakistan.
- Experience in evaluating institutional capacities, inter-agency coordination, and multi-stakeholder engagement in local governance and emergency response.
Experience in Developing Implementation Roadmaps and Strategic Frameworks
- Prior experience in designing and implementing roadmaps, models, and frameworks for localization, resilience, and disaster management.
- Proven ability to translate research findings into actionable strategies, roadmaps, and policy recommendations for sustainable, locally led development.
- Successfully completed at least 2–3 assignments in this area.
Evaluation and Analytical Skills
- Strong background in qualitative and quantitative evaluation methodologies, including data collection, analysis, and reporting.
- Experience in conducting midterm evaluations, endline/final evaluations, impact assessments, and stakeholder consultations.
Regional and Contextual Understanding
- In-depth knowledge of Khipro’s socio-economic and governance landscape.
- Experience working with local government bodies, civil society organizations, and humanitarian agencies in Pakistan.
8. Evaluation Criteria
The Following are the evaluation criteria for the individual consultant/ consulting firm:
Proposed Criteria for Evaluation |
Marks |
Proven experience in conducting similar studies and share previous work of similar nature at least 2-3 assignment reports. |
30 |
In-depth Knowledge of Localization within the Framework of the 18th Amendment |
15 |
Regional, Contextual Understanding and work plan |
15 |
Report writing and excellent verbal and communication skills |
15 |
Detailed and itemized financial proposal |
25 |
Total |
100 |
- Note: The applicant must adhere to ethical research/evaluations standards, ensuring:
- Informed Consent: Participants are fully informed about the purpose of the research and consent to participate.
- Confidentiality: Personal information of participants is protected.
- Do No Harm: The research study does not adversely affect participants or communities.
9. Desired Competencies, Technical Background, and Experience
The Evaluator shall have the following expertise and qualifications:
- At least Master’s degree in Public Policy, International Development, Development Economics/Planning, Economics, International Relations/ Diplomacy or any other relevant university degree.
- Extensive expertise, knowledge, and experience in the field of aid effectiveness and aid management process related issues.
- Experience of project formulation and evaluation and practical experience of end of project evaluation in South Punjab/Sindh or in similar context; At least 08 years of experience in working with international organizations, donors and evaluating projects.
- Past experience in conducting surveys, especially evaluations of German Donors funded projects. (Optional)
- Strong grasp of the legal, policy, and institutional landscape of localization in Pakistan, particularly in the context of the 18th Amendment.
- Excellent written and verbal communication skills in English.
- Experience in Sindhi and Balochi languages will be considered an advantage.
- Offers will be evaluated on these criteria as well as the quality of the technical offer (proposed methodology, capacity to mobilize qualified personnel in the field, etc.) and the soundness of the financial offer.
10. Technical Proposal
- Company profile – including the proof of relevant experiences
- Up to date CV of the lead consultant/evaluator (showing education and expertise).
- Technical proposition detailing proposed methodology and resources needed (max 8 pages).
- An example of a previous reports (evaluations) from similar work which demonstrates evidence of the skills and experience required and a list of past evaluation produced by the lead consultant/evaluator.
11. Financial Proposal
- Proposed financial offer with a complete breakdown of activities.
- The financial proposal must be submitted in PKR inclusive of all applicable taxes.
- The Consultant/Firm must be legally registered with the Federal Board of Revenue (FBR).
12. Payment Terms
All payments will be made in the form of a cheque. The disbursement schedule, including the amount and timeline, will be outlined in the agreement. Payments will be subject to the successful completion of agreed-upon deliverables and compliance with contractual obligations and submission of final report and database. Any applicable taxes or deductions will be as per prevailing government regulations.
13. How to Apply
For any clarification, please write an email at [email protected].
Interested applicants should submit their sealed envolopes which (cover letters, profiles, and CVs with technical and financial proposals (PDF, Word, and Excel)) by 08th April, 2025 COB at the following address.
Procurement Manager
House # 333, Street 29 - Sector G-14 / 4 - Islamabad
+92-51-8446166
Relevant Experience: Job Description:....
MBBS with MPH / Master of Social Sciences with MPH / MBA with MPH from recognized Univers....