Terms
of Reference

External
Evaluation

ASB
Philippines Community Resilience Programme 2015-2017

 

Introduction

The Arbeiter-Samariter-Bund (ASB) Philippines
Community Resilience Programme was designed to support community resilience
strengthening in Typhoon Haiyan affected areas, contributing to the Typhoon
Haiyan recovery process, and support integration, implementation and
institutionalization of inclusive Disaster Risk Reduction (DRR) and resilience
strengthening from community to regional levels. The Programme started in
December 2014 and will finish in December 2017. The programme has two primary
components: Partner-led projects in Typhoon Haiyan affected areas, and broader
promotion of Disability Inclusive Disaster Risk Reduction (DIDRR) from the
local to regional level through sharing, networking and documentation that
support the implementation of the Sendai Framework for DRR (SfDRR).

The specific objective of the programme is:

·        
To strengthen the resilience of communities,
including most at risk community members, affected by Typhoon Haiyan via local
partner led programming & increased inclusive-DRR practice across different
levels.

This aims
to support the overall objective of:

·        
To contribute to delivering on commitments to
inclusion and resilience under the SfDRR.

 

Purpose of the Evaluation

This
external evaluation will focus on implementation, outcomes and support future
programming. It aims to determine whether the programme has met its identified
objectives and results as per the programme design document and log frame
(outcome level),provide insight and feedback on ASB programming and
partnerships, including approach, management and document the programme
engagement model (implementation level),and provide recommendations to support
future programming and partnerships (future programming level).

The specific objectives
of the evaluation
are: 

1.    Assess the
achievement of programme objectives
and results. 

2.    Evaluate the
effectiveness of current partnerships and ways of working with recommendations
on how ASB can best work with partners in the
future. 

3.    Document the model of partner led programme
engagement.

4.    Make recommendations
to support planning and implementation for future ASB
programming and partnerships. 

 

Scope of Work and Key Questions

a.   
Responsibilities

The evaluation will be undertaken by
an external consultant with management by ASB from the Programme Development
Manager. The evaluation consultant will be responsible for:

–       development
of the evaluation plan, including identifying methods and develop tools,

–       implement
the evaluation, including data analysis and documentation of the partner-led
Programme model,

–       prepare
the draft and final evaluation reports.

 

b.    Key questions

The
evaluation will focus on ASB Philippines Programme partner work and higher level
Programme work led by ASB, including influencing on DIDRR, partner led
Programme engagement, Programme management and monitoring, evaluation and
learning that were undertaken over the period of the programme. The key
evaluation questions to be answered in the evaluation report are:

1)   
To what extent has the programme contributed
to delivering on commitments to inclusion and resilience under the Sendai
Framework for DRR (SfDRR)?

2)   
To what extent have project communities,
inclusive of those most at risk, demonstrated strengthened resilience in focus
areas covered by Partners over the period of the Project?

3)   
To what extent has the Programme results been
achieved (based on the level of MEL data that is currently available)? Were
there any unintended outcomes of the Programme?

4)   
Has the programme supported any positive or
negative changes in attitude, policy and practice related to resilience, DRR,
livelihoods and/or disability inclusion (at the community, government and
partner levels in Philippines and/or regionally)? 

5)   
What were key learnings of the
programme/projects?

6)   
Is there a difference in quality of impact on
inclusion between projects due to partners different project approaches?

7)   
What is the partner-led programme engagement
model? Does the partner-led programme engagement model support longer-term
partnership? Is the partner-led programme engagement model suitable for
replication?

8)   
To what extent has the programme engagement
model supported capacity transfer and learning exchange among partners?

9)   
To what extent does the financial management
processes between partners and ASB support the effectiveness and efficiency of
project implementation?  

10)
What are recommendations for future ASB
programming in the Philippines? How could Programme implementation,
partnerships and the partner-led engagement model be improved?

 

Evaluation Methodology

The evaluation design should
consider the following principles: 

–     A participatory
evaluation with emphasis on approaches that capture a cross-section of views
from program stakeholders including target project
beneficiaries. 

–       Use of purposeful
sampling and qualitative and participatory methods/tools to generate
understanding of why changes have occurred, captures lessons learnt e.g. of possible methods include semi-structured
interviews, focus group discussions, workshops, desk
studies, Participatory Rural Appraisal (PRA) techniques such as Venn diagrams,
ranking and scoring etc. Possible use of random sampling and standardized
questionnaires etc. to capture representative changes.

–       Triangulation and cross checking of data through using multiple

sources and multiple methods.

–       A schedule for
information collection and specify who will be responsible for making the
information available. 

–       Outline the
approaches for analysis and interpretation of
data. 

–       Assess the
underlying assumptions that underpin the program design. 

–       Adhere to ASBs Code
of Conduct.

The
evaluation should capture the perspectives of the various programme target
groups and stakeholders and should include experiences from the following:

–       partner
organizations,

–       representatives
of persons with disabilities/disabled people organizations,

–       direct
beneficiaries of sample projects,

–       national
and sub-national government representatives.

–       Other peer
civil society organisations, 

–       ASB staff
from ASB Indonesia & Philippines and head office.

 

Evaluation Audience

The
primary audience for this evaluation will be ASB Indonesia and Philippines and
ASB Head office staff who are engaged or linked to the Philippines programme,
ASB partners in the Philippines and the back donor Aktion Deutshland Hilft.

A
secondary audience will be other stakeholders that may find the findings of the
evaluation useful, including but not limited to ASB country offices in other
countries, those working in the Disability Inclusive DRR or resilience
strengthening sectors and those interested in learnings from grant/partnership
management.

 

Evaluation Resources

Administration
support will be provided for logistical needs such as booking flights to and
from the evaluation locations. ASB will provide contact details of stakeholders
and partners to be met with, introducing the consultant in advance, provide advice

on local logistics (transport and accommodation) and a suggested timeline. The
consultant will be responsible for organizing times and locations for meetings
and field visits. ASB, or partners, will support with organizing of local
logistics where possible. The consultant will need to use their own computer
and Smart phone for the consultancy and any related software, this should be
taken into account in their daily fee rate.

The
evaluator will be provided with the following (but not limited to) documents to
review:

–       ASB
Philippines Programme Design Document (July 2015 version), including the
programme log frame and theory of change.

–       ASB
Philippines Programme MEL framework and Plan.

–       ASB
Philippines Programme MEL database.

–       ASB
Philippines Programme Phase 1 report.

–       ASB

Philippines Partners baseline/midline/end line assessment.

–       ASB
Philippines Partners capacity assessment.

–       Project
agreements between ASB and partners.

–       ASB
Partner Financial Requirements.

–       ASB
Partner Visibility and Communication Guidelines.

–       ASB
Philippines Partner proposals, narrative and monitoring reports.

–       Regional
and international level outcome documents that have been influenced by ASB
during the course of the programme such as SFDRR Regional planning Asia Pacific
(AMCDRR India) and recent GPDRR Chair’s summary.

–       Links to
ASB and partner related media linked to the programme.

–       Sendai
Framework for DRR

Dissemination of Findings

Key
findings will be presented to ASB prior to finalisation of the evaluation
report for verification and input and to support utilisation of findings. The
final evaluation report will be shared among ASB staff, partners and back
donor, and will be available to the broader public via the ASB Indonesia &
Philippines website. Findings will also be discussed with partners at the
programme’s final sharing and learning workshop. Findings will be utilized for
future ASB programming and partnerships and support improved practice from
learning.

Timeline

The
evaluation is planned to run for 34 days over the period of November- December 2017.The
working period will commence in November 2017.

Days
of the consultancy and tentative plan:

2 ½ days 
–      Inception meeting with ASB
IND & PHL management (Indonesia, including travel days)

4
days –           Desk review of relevant
documents &draft design of evaluation plan.

½
day  –           Review
and discussion finalizing evaluation plan

2 days –           Interviews
with ASB Philippines Programme and head office key staff (Indonesia and Germany
– Skype)

17 days –         Philippines
level data collection – Partners, beneficiaries, Government stakeholders,
Project locations etc (Philippines, including travel days)

5
days –           Data
analysis and report writing

2
days –           Presentation of key
findings to ASB, including travel days

1
day –             Finalization of report
after feedback from ASB

Total
34 days in two months period.

Consultancy Outputs

The
evaluator will be responsible for the quality and timely submission of these
deliverables:

–      
Draft Evaluation Plan end of 1^st
week of consultancy,

–       Final Evaluation
Plan approved by ASB,

–       Draft
Evaluation Report responding to all questions laid out in TOR and documenting
the model of partner-led Programme engagement,

–       Final
Evaluation Report approved by ASB.

Presentation of Results

The
consultant will submit a draft report in English with the following format:

1.   
Title page

2.   
Abbreviations/acronyms list

3.   
Table of contents

4.   
Executive summary (max one page), which
should provide a short project introduction, explain briefly the evaluation
methodology, summary of the finding and recommendations.

5.   
Introduction (one page)

6.   
Objectives and approach/methodology of the
Evaluation (3 pages)

7.   
Evaluation’s results, including quotes from
program beneficiaries and other stakeholders (15 pages)

8.   
Conclusions and Recommendations (2 pages)

9.   
Annexes including photos

Total
length is a minimum of 20 to a maximum of 25 pages (for sections 4-8) plus
annexes.

Please
provide key recommendations that have emerged from the evaluation that will be
useful for developing ASB’s programme strategies and approaches in the future.

Requirements of Experience and Qualifications

–       Extensive
demonstrated experience (proven by previous evaluation report) in undertaking high
quality external evaluations within the international development sector,
ideally in South-East-Asia.

–       A Master degree
or equivalent experience in Evaluation, International Development or relevant
area.

–       Expertise
in the fields of DRR, Livelihoods and/or resilience building ideally in
South-East-Asia.

–       Demonstrated
expertise in Disability Inclusion ideally in South-East-Asia.

–       Extensive
experience in Grant and Partnership management and approaches in international
development settings.

–       Extensive
experience using inclusive and participatory processes in evaluations or
research ideally in South-East-Asia.

–       Knowledge
and experience in applying qualitative evaluation methods.

–       Good cross

cultural communication ability and sensitivity.

–       Familiar
with the Sendai Framework for DRR.

–       Experience
working or living in the Philippines an advantage.

–       Fluent
written and spoken English.

–       Filipino,
Waray or Cebuano language skills an advantage.

–       Ability to
travel independently.

–       Availability
to undertake the consultancy within the desired timeframe.

ASB
will provide all costs for travel, accommodation, per diems and related evaluation
events (as negotiated with the consultant and ASB) during travel undertaken by
the consultant for the consultancy.

The
consultant should budget for a daily rate that is inclusive of insurance, tax
and other costs incurred by the consultant during the consultancy outside of
the above.

 

Application

To
apply consultant must submit an application to ASB that includes:

–       A cover
letter outlining their experience against the consultant requirements.

–       A CV
highlighting relevant experience that is no longer than 2 pages (more than two
pages will not be considered).

–       An example
of an evaluation undertaken by the consultant where the consultant was the lead
evaluator and wrote the final report.

–       Contacts
of 3 references.

–       A proposed
daily rate (in Euro) inclusive of the consultant’s fee, insurance and tax and
any other costs that the consultant will occur, outside of travel costs,

accommodation and per diems during times of travel from the consultant’s home
base for the consultancy.

–       The home
base that the consultant would be travelling from to undertake the consultancy.

–       Availability
of the consultant in November-December 2017.

ASB
encourage persons with disabilities, persons from minority groups and women to
apply.

Applications must be submitted to [email protected] by the 8^th of October 2017.

 

Candidate will be reviewed in the order that their
resume is received, so please apply early.

Also, please note that we only contact shortlisted
candidates.