[DevJobsIndo] Consultant for Final Evaluation Stakeholder, Coordination, Advocacy, Linkages, and Engagement for Resilience (SCALE-R) Phase 2 Program
Final Evaluation of Stakeholder,
Coordination, Advocacy, Linkages, and Engagement for Resilience (SCALE-R) Phase
2 Program
1.
BACKGROUND
The
Stakeholder Coordination, Advocacy, Linkages and Engagement for Resilience (SCALE-R)
program, better known as API Perubahan (Adaptasi Perubahan Iklim dan
Pengurangan Risiko Bencana untuk Ketahanan) is currently phasing out to its
completion in November 2015. The project was designed to build upon
achievements from Phase 1. During the first implementation phase of SCALE-R
program from October 2010 – September 2013, climate change adaptation (CCA) and
disaster risk reduction (DRR) measures were integrated through structured
activities from the national to sub-district levels in selected pilot areas in
Stakeholder Coordination, Advocacy, Linkages and Engagement for Resilience (SCALE-R)
program, better known as API Perubahan (Adaptasi Perubahan Iklim dan
Pengurangan Risiko Bencana untuk Ketahanan) is currently phasing out to its
completion in November 2015. The project was designed to build upon
achievements from Phase 1. During the first implementation phase of SCALE-R
program from October 2010 – September 2013, climate change adaptation (CCA) and
disaster risk reduction (DRR) measures were integrated through structured
activities from the national to sub-district levels in selected pilot areas in
four provinces in Indonesia. CCA-DRR integration has been demonstrated
particularly through the development of vulnerability and capacity assessments,
local resilience action plans to support government and community engagement, collaboration
of actors and government institutions responsible for climate change and
disaster management issues, and policy advocacy to integrate CCA and DRR into
government plans.
The
goal of Mercy Corps’ SCALE-R program is to improve the resilience of
populations in Indonesia that are vulnerable to natural hazards and the impact
goal of Mercy Corps’ SCALE-R program is to improve the resilience of
populations in Indonesia that are vulnerable to natural hazards and the impact
of climate change through strengthening the capacity of government, civil
society, and the private sector to reduce the risk of disaster and adapt to
climate change in sub-districts in Maluku Tengah and Pekalongan regency, as
well strengthen partnership from national down to local level.
The
above stated goal of the Project is aimed to be achieved through a range of
activities, which are grouped under three objectives
and eight outputs,
as listed below:
above stated goal of the Project is aimed to be achieved through a range of
activities, which are grouped under three objectives
and eight outputs,
as listed below:
Objective 1: Better coordination between and inclusive
planning by national, provincial and district-level government on disaster risk
reduction and climate change adaptation.
planning by national, provincial and district-level government on disaster risk
reduction and climate change adaptation.
Objective 1 of the program is set to be achieved by
implementing various activities grouped under following Outputs:
implementing various activities grouped under following Outputs:
Output 1: National engagement is improved.
Output 2: Program Advisory Committees (PAC) are established and functioning.
Output 3: Sub-District Working Groups (SDWG)
are established and functioning.
are established and functioning.
Output 4: Collaborative actions are
improved between PAC and SDWG.
improved between PAC and SDWG.
Objective 2: Reduce the vulnerability to hazards and climate
change impacts of targeted community members.
change impacts of targeted community members.
Objective 2 of the program will be achieved through
following Outputs:
following Outputs:
Output 1: Improved knowledge of communities
and local government on CCA-DRR.
and local government on CCA-DRR.
Output 2: Improved
CCA-DRR development plan in local government and community.
CCA-DRR development plan in local government and community.
Output 3:
5 Pilot projects are implemented in 5 targeted sub-districts.
5 Pilot projects are implemented in 5 targeted sub-districts.
Objective 3: Replication of best practices
promoted in new target vulnerable communities.
promoted in new target vulnerable communities.
Objective 3 of the program will be achieved through
one Output “CCA-DRR model is established’.
one Output “CCA-DRR model is established’.
Intervention
Area
During the implementation of
SCALE-R phase 2, there are varieties groups of interventions from national to
community level, as described following:
SCALE-R phase 2, there are varieties groups of interventions from national to
community level, as described following:
1)
National level. This group including from BNPB, KLHK, and
SCDRR-UNDP.
National level. This group including from BNPB, KLHK, and
SCDRR-UNDP.
2)
Pekalongan Regency in Central Java Province. This group including
member of the Pekalongan DRR Forum such as BPBD, Bappeda, DKP, and
non-government entities.
Pekalongan Regency in Central Java Province. This group including
member of the Pekalongan DRR Forum such as BPBD, Bappeda, DKP, and
non-government entities.
3)
Maluku Tengah District in Maluku Province. This group including
member of the Maluku Tengah DRR Forum such as BPBD, Bappeda, DKP, and
non-government entities.
Maluku Tengah District in Maluku Province. This group including
member of the Maluku Tengah DRR Forum such as BPBD, Bappeda, DKP, and
non-government entities.
4)
Subdistrict Working Group (SDWG) in Jeruksari, Mulyorejo, and
Tegaldowo in Pekalongan Regency.
Subdistrict Working Group (SDWG) in Jeruksari, Mulyorejo, and
Tegaldowo in Pekalongan Regency.
5)
Subdistrict Working Group (SDWG) of Amahai and Haruku in Maluku
Tengah Regency. SDWG of Amahai consists of Amahai and Soahuku subdistrict while
SDWG of Haruku consists of Oma, Haruku, Sameth, Rohomoni and Kabaw subdistrict.
Subdistrict Working Group (SDWG) of Amahai and Haruku in Maluku
Tengah Regency. SDWG of Amahai consists of Amahai and Soahuku subdistrict while
SDWG of Haruku consists of Oma, Haruku, Sameth, Rohomoni and Kabaw subdistrict.
6) Community
member of the all subdistricts as mentioned above.
member of the all subdistricts as mentioned above.
2.
FINAL EVALUATION OBJECTIVES
Main
objective of this final evaluation is: (1) to facilitate a process, to assess
the project’s performance and achievements vis-à-vis the project’s overall
objectives and goal; and (2) to generate lessons learned and make
recommendations from the implementation of the project’s activities and the
outcomes achieved that will be useful for similar projects in the future for
the same sector.
objective of this final evaluation is: (1) to facilitate a process, to assess
the project’s performance and achievements vis-à-vis the project’s overall
objectives and goal; and (2) to generate lessons learned and make
recommendations from the implementation of the project’s activities and the
outcomes achieved that will be useful for similar projects in the future for
the same sector.
3.
SCOPE OF EVALUATION
3.1
Assessment
of functional aspect of the program implementation.
Assessment
of functional aspect of the program implementation.
It includes program partnership approach, coordination, outreach, action plan
development process, financial management and etc.
development process, financial management and etc.
3.2 Program Achievements
Elaborate
delivery of the outputs and activities of the program taking into consideration
the various factors that contributed to the successful implementation of the Program.
delivery of the outputs and activities of the program taking into consideration
the various factors that contributed to the successful implementation of the Program.
3.3
Analysis
on the Program Achievement
Analysis
on the Program Achievement
The
program achievements will be analyzed against five key development criteria, namely
relevance,
effectiveness, efficiency, impacts and sustainability. Definition of these key
development criteria are as following:
program achievements will be analyzed against five key development criteria, namely
relevance,
effectiveness, efficiency, impacts and sustainability. Definition of these key
development criteria are as following:
3.3.1 Relevance
·
How appropriate were the inputs, activities, outputs and outcomes
as related to the local needs/problems?
How appropriate were the inputs, activities, outputs and outcomes
as related to the local needs/problems?
·
What value did the intervention add to the local context?
What value did the intervention add to the local context?
3.3.2
Effectiveness
Effectiveness
·
Have the objectives led to the achievement of the expected
results? Did the assumptions/risks affect the project?
Have the objectives led to the achievement of the expected
results? Did the assumptions/risks affect the project?
3.3.3
Efficiency
Efficiency
·
Did the project use the most efficient process?
Did the project use the most efficient process?
·
Did the project use the most cost-effective approach or could
other approaches produce the same results at more reasonable costs?
Did the project use the most cost-effective approach or could
other approaches produce the same results at more reasonable costs?
3.3.4 (Potential)
Impact
Impact
·
Review the relationship between the project objectives and
goal and the extent to which the benefits received by target beneficiaries had
and/or have tendency to affect large number of people in the project sites.
Review the relationship between the project objectives and
goal and the extent to which the benefits received by target beneficiaries had
and/or have tendency to affect large number of people in the project sites.
·
Are there unintended or unforeseen results?
Are there unintended or unforeseen results?
·
Are there any
factors or interventions on the target area/beneficiaries at the same time that
is very possible influence the impact of the program?
Are there any
factors or interventions on the target area/beneficiaries at the same time that
is very possible influence the impact of the program?
3.2.5
Sustainability
Sustainability
·
What sustainability mechanisms are in place to ensure the
livelihoods and impacts of the program continue to be maintained?
What sustainability mechanisms are in place to ensure the
livelihoods and impacts of the program continue to be maintained?
·
Provide recommendations for design, planning, and implementation
of future DRR and CCA program based on a summary of relevance, effectiveness,
and efficiency assessments.
Provide recommendations for design, planning, and implementation
of future DRR and CCA program based on a summary of relevance, effectiveness,
and efficiency assessments.
4. EVALUATION METHODOLOGY
The
Final Evaluation will be conducted by a national individual consultant. The
final evaluation should be conducted in participatory approach to optimize the
learning opportunities for Mercy Corps Indonesia staff. During the work of
final evaluation, the national consultant will work closely with Monitoring and
Evaluations Specialist of the program. Methods that will be used on this final
evaluation includes:
Final Evaluation will be conducted by a national individual consultant. The
final evaluation should be conducted in participatory approach to optimize the
learning opportunities for Mercy Corps Indonesia staff. During the work of
final evaluation, the national consultant will work closely with Monitoring and
Evaluations Specialist of the program. Methods that will be used on this final
evaluation includes:
1) Qualitative
Study. Qualitative study will mostly use any relevant participatory method
including but not limited to focus group discussion and key informant
interview, by using purposive sampling (non-probability) from the treatment
group. Gender balance of the sampling should be considered during this final
evaluation.
Study. Qualitative study will mostly use any relevant participatory method
including but not limited to focus group discussion and key informant
interview, by using purposive sampling (non-probability) from the treatment
group. Gender balance of the sampling should be considered during this final
evaluation.
2) Desk Study. Utilize
result from SCALE-R monitoring activities. This final evaluation has to
consider information from the M&E results. Information about the nature of
the intervention to causally link any documented outcomes to what was done.
Basic information from routine M&E is required about: the actual nature of
services provided; baseline data, end line data, lessons learned from the phase
1, as well as changes over time, with respect to who is served (or addressed,
such as with advocacy initiatives); the number and characteristics of
beneficiaries reached, including relevant subgroups; program outputs; and how
the intervention has progressed.
result from SCALE-R monitoring activities. This final evaluation has to
consider information from the M&E results. Information about the nature of
the intervention to causally link any documented outcomes to what was done.
Basic information from routine M&E is required about: the actual nature of
services provided; baseline data, end line data, lessons learned from the phase
1, as well as changes over time, with respect to who is served (or addressed,
such as with advocacy initiatives); the number and characteristics of
beneficiaries reached, including relevant subgroups; program outputs; and how
the intervention has progressed.
3) Identify other
interventions and factors may influence whether or not an intervention can
“work”? This question is important in order not to simplify impact. It is very
possible that other programs exist on the targeted area. It is the task of this
final evaluation to capture the situation to generate necessary conclusion.
interventions and factors may influence whether or not an intervention can
“work”? This question is important in order not to simplify impact. It is very
possible that other programs exist on the targeted area. It is the task of this
final evaluation to capture the situation to generate necessary conclusion.
Following
approaches should be considered for the purpose of the final evaluation:
approaches should be considered for the purpose of the final evaluation:
4.1 Desk Phase – Inception
In
the inception stage, the consultant should review the relevant programming
documents, as well as documents shaping the wider strategy/policy framework.
The evaluation consultant will analyses the logical framework. Some programmatic
documents including program reports, newsletter, base-line and end-line report,
logical framework and performance monitoring plan, program achievement tracker,
Mercy Corps Indonesia profile especially program that works in the same
geographical area as SCALE-R phase 2 Program, SCALE-R Phase 1 lessons learned
report, and related program products such as guidance book. During this phase,
it is the responsibility of the
consultant to develop the initial questionnaire and the methodology.
the inception stage, the consultant should review the relevant programming
documents, as well as documents shaping the wider strategy/policy framework.
The evaluation consultant will analyses the logical framework. Some programmatic
documents including program reports, newsletter, base-line and end-line report,
logical framework and performance monitoring plan, program achievement tracker,
Mercy Corps Indonesia profile especially program that works in the same
geographical area as SCALE-R phase 2 Program, SCALE-R Phase 1 lessons learned
report, and related program products such as guidance book. During this phase,
it is the responsibility of the
consultant to develop the initial questionnaire and the methodology.
4.2 Desk phase – Finalization
The
finalization phase, the consultant needs to submit list of key questions for
data collection and the methodology. Consultants should identify and present
the list of tools to be applied in the Field Phase. In this finalization phase,
the consultant present evaluation design, including list of key questions,
methodology and interview schedule to the SCALE-R phase 2 Program team. With
input from the SCALE-R phase 2 Program team, consultant finalize detailed work
plan with an indicative list of people to be interviewed or surveys to be
undertaken, dates of visit, itinerary, and name of team members in charge. This
plan has to be applied in a way that is flexible enough to accommodate for any
last-minute difficulties in the field. If any significant deviation from the
agreed work plan or schedule is perceived as creating a risk for the quality of
the evaluation, these should be immediately discussed with the evaluation
manager.
finalization phase, the consultant needs to submit list of key questions for
data collection and the methodology. Consultants should identify and present
the list of tools to be applied in the Field Phase. In this finalization phase,
the consultant present evaluation design, including list of key questions,
methodology and interview schedule to the SCALE-R phase 2 Program team. With
input from the SCALE-R phase 2 Program team, consultant finalize detailed work
plan with an indicative list of people to be interviewed or surveys to be
undertaken, dates of visit, itinerary, and name of team members in charge. This
plan has to be applied in a way that is flexible enough to accommodate for any
last-minute difficulties in the field. If any significant deviation from the
agreed work plan or schedule is perceived as creating a risk for the quality of
the evaluation, these should be immediately discussed with the evaluation
manager.
4.3 Field phase
The
Field Phase should start upon approval of the Desk Phase report by the SCALE-R
phase 2 Program team. The consultant should:
Field Phase should start upon approval of the Desk Phase report by the SCALE-R
phase 2 Program team. The consultant should:
•
Ensure adequate contact and consultation with, and involvement of,
the different stakeholders; working closely with the local government
authorities and agencies during the entire assignment. Use the most reliable
and appropriate sources of information and will harmonize data from different
sources to allow ready interpretation.
Ensure adequate contact and consultation with, and involvement of,
the different stakeholders; working closely with the local government
authorities and agencies during the entire assignment. Use the most reliable
and appropriate sources of information and will harmonize data from different
sources to allow ready interpretation.
•
Summarize its field works at the end of the field phase, discuss
the reliability and coverage of data collection, and present its preliminary
findings in a meeting with.
Summarize its field works at the end of the field phase, discuss
the reliability and coverage of data collection, and present its preliminary
findings in a meeting with.
•
When necessary, the consultant and Team can organize a meeting to
discuss finding from field survey.
When necessary, the consultant and Team can organize a meeting to
discuss finding from field survey.
4.4 Synthesis phase
This
phase is mainly devoted to the preparation of the draft final report. The
consultants will make sure that:
phase is mainly devoted to the preparation of the draft final report. The
consultants will make sure that:
•
The assessments are objective and balanced, affirmations accurate
and verifiable, and recommendations realistic.
The assessments are objective and balanced, affirmations accurate
and verifiable, and recommendations realistic.
•
When drafting the report, the consultant needs to acknowledge
clearly where changes in the desired direction are known to be already taking
place, in order to avoid misleading readers and causing unnecessary irritation
or offence.
When drafting the report, the consultant needs to acknowledge
clearly where changes in the desired direction are known to be already taking
place, in order to avoid misleading readers and causing unnecessary irritation
or offence.
Once
the draft report is developed by the consultant, it needs to be circulated to
the program team member of any comments and feedbacks. On the basis of comments
expressed by the program team member, the consultant has to amend and revise
the draft report.
the draft report is developed by the consultant, it needs to be circulated to
the program team member of any comments and feedbacks. On the basis of comments
expressed by the program team member, the consultant has to amend and revise
the draft report.
4.5 Discussion Meeting
The
consultant has to present the revised draft final report at discussion meeting
with program team member. The purpose of the presentation is to discuss the draft final report, to check
the factual basis of the evaluation, and to discuss the draft findings,
conclusions and recommendations. Any comments and feedback (the final) resulted
from the meeting, will be the final stage of finalizing the report.
consultant has to present the revised draft final report at discussion meeting
with program team member. The purpose of the presentation is to discuss the draft final report, to check
the factual basis of the evaluation, and to discuss the draft findings,
conclusions and recommendations. Any comments and feedback (the final) resulted
from the meeting, will be the final stage of finalizing the report.
4.6 Final Evaluation
Report
Report
With
the agreed format/lay out of the final report from previous phase, when all the
quality content of the final evaluation already checked both sides, team member
and consultant, the consultant needs to prepare and submit the final evaluation
report.
the agreed format/lay out of the final report from previous phase, when all the
quality content of the final evaluation already checked both sides, team member
and consultant, the consultant needs to prepare and submit the final evaluation
report.
5.
KEY LEARNING QUESTIONS
Key
learning questions for the evaluation should include but not be limited to the
following, and the consultant will finalize the questions/questionnaire with
SCALE-R team.
learning questions for the evaluation should include but not be limited to the
following, and the consultant will finalize the questions/questionnaire with
SCALE-R team.
General Questions:
1)
What have been achieved to improve the resiliency of target groups
to natural hazards and the impact of the climate change? Are there any evidences of
changes in the community, local government and relevant actors as the result of
program interventions?
What have been achieved to improve the resiliency of target groups
to natural hazards and the impact of the climate change? Are there any evidences of
changes in the community, local government and relevant actors as the result of
program interventions?
2)
What are the main factors leading to resiliency for community,
local government and other relevant actors?
What are the main factors leading to resiliency for community,
local government and other relevant actors?
3)
Did the program meet the objectives related to the performance
indicators defined in the Performance Monitoring Plan?
Did the program meet the objectives related to the performance
indicators defined in the Performance Monitoring Plan?
4)
Which interventions are most effective in achieving the objectives
and why?
Which interventions are most effective in achieving the objectives
and why?
5)
How efficient was resource management for implementing program
activities? (Including human resource, budget, assets, scheduling)
How efficient was resource management for implementing program
activities? (Including human resource, budget, assets, scheduling)
6)
Are there any limitations or constraints that have limited the
achievements of the program and would be the strategies for future
interventions?
Are there any limitations or constraints that have limited the
achievements of the program and would be the strategies for future
interventions?
7) What are the
overall lessons can be learned to strengthen for future interventions?
overall lessons can be learned to strengthen for future interventions?
6.
DELIVERABLES
The
consultant will be responsible for following deliverables:
consultant will be responsible for following deliverables:
1)
Final evaluation design including finalization of the key
questions and questionnaire (when neceeded), methodology and work plan. The
final evaluation questionnaire (when needed) and methods should be submitted in
English and Bahasa.
Final evaluation design including finalization of the key
questions and questionnaire (when neceeded), methodology and work plan. The
final evaluation questionnaire (when needed) and methods should be submitted in
English and Bahasa.
2)
Data collection on the targeted area including at the national
level.
Data collection on the targeted area including at the national
level.
3)
The consultant to have presentation with the SCALE-R phase 2
Program team to show initial findings and discussions. The consultant should
submit a presentation file to the SCALE-R phase 2 Program team for the purpose
of showing the initial findings.
The consultant to have presentation with the SCALE-R phase 2
Program team to show initial findings and discussions. The consultant should
submit a presentation file to the SCALE-R phase 2 Program team for the purpose
of showing the initial findings.
4)
Consultant submits the draft report
of Final Evaluation in Bahasa
and will be reviewed by SCALE-R phase 2 Program team.
Consultant submits the draft report
of Final Evaluation in Bahasa
and will be reviewed by SCALE-R phase 2 Program team.
5)
Consultant submits the final report
of Final Evaluation in Bahasa and English. Submission of a comprehensive
Consultant submits the final report
of Final Evaluation in Bahasa and English. Submission of a comprehensive
final report in Bahasa Indonesia and English after receiving feedback from the
SCALE-R phase 2 Program team. The final report should include detailed
information on the following:
·
Final evaluation final report, based on agreed outline;
Final evaluation final report, based on agreed outline;
·
Questionnaire development (when needed);
Questionnaire development (when needed);
·
Work plan;
Work plan;
·
Raw data and analysis.
Raw data and analysis.
6) The consultant
should submit the final report in two printed and electronic copies (by email)
of the final report in Indonesian and English.
should submit the final report in two printed and electronic copies (by email)
of the final report in Indonesian and English.
7.
EVALUATION WORK PLAN
The final evaluation would be start on October 26th,
2015 and should be completed in 22 working days with detail as follows:
2015 and should be completed in 22 working days with detail as follows:
|
Activity
|
Place
|
Duration
|
|
Meeting with program team, review
program documents, develop and refine tools, logistics & report framework, field activities schedule completed |
MCI office
|
4 days
|
|
Data collection & management
|
Jakarta, Maluku Tengah, and Pekalongan
|
10 days
|
|
Data analysis and report preparation
|
MCI Office / others
|
3 days
|
|
Initial finding presentation to program
team |
MCI Office
|
1 day
|
|
Report writing & editing
|
MCI Office / others
|
2 days
|
|
Report Finalized
|
MCI Office / others
|
2 days
|
|
TOTAL
|
|
22 days
|
8.
QUALIFICATIONS
The consultant should have
the following skills and competencies:
the following skills and competencies:
1.
Demonstrable extensive
experience of producing high quality and credible evaluations (we require
sample or summary of previous evaluation project).
Demonstrable extensive
experience of producing high quality and credible evaluations (we require
sample or summary of previous evaluation project).
2.
Experience of working
with/evaluating NGO program.
Experience of working
with/evaluating NGO program.
3.
Experience of
working and/or knowledge in Disaster Risk Reduction and Climate Change
Adaptation, in participatory processes, and stakeholder engagement.
Experience of
working and/or knowledge in Disaster Risk Reduction and Climate Change
Adaptation, in participatory processes, and stakeholder engagement.
4.
Experience of
working on coastal and small island community is an advantage.
Experience of
working on coastal and small island community is an advantage.
5.
Excellent
knowledge and skills in research methodology and field survey.
Excellent
knowledge and skills in research methodology and field survey.
6.
Ability to
write concisely, analyze data and information precisely, and present any key
findings in a well-defined and well-articulated structure.
Ability to
write concisely, analyze data and information precisely, and present any key
findings in a well-defined and well-articulated structure.
7.
Excellent
writing and presentation skills in English and Bahasa Indonesia.
Excellent
writing and presentation skills in English and Bahasa Indonesia.
9.
APPLICATION PROCEDURES
Please submit your proposal
and curriculum vitae in English to: [email protected] no later than
October 4th, 2015. Only short listed candidates will be
notified. Applications received after
the deadline will not be considered.
and curriculum vitae in English to: [email protected] no later than
October 4th, 2015. Only short listed candidates will be
notified. Applications received after
the deadline will not be considered.
Thank you,
Mercy Corps Indonesia
Visit Today : 143
This Month : 9367
Hits Today : 454
Total Hits : 563924
Who's Online : 2
