8:30 - 8:50

Registration

9:00 – 9:15

Opening remarks

9:15 – 9:45

Briefing & Icebreaking

9:45 – 10:10

Pre-test

10:10-10:25

Group Photo& Coffee Break

10:25 – 12:25

Module 1: Introducing Development Evaluation

Ms. Linda Morra-Imas leads this introductory session on the changing development context, the different approaches to evaluation, the origins and history of evaluation science, and the principles and standards for evaluation.

12:25 – 13:30

Lunch

14:00 – 15:30

Module 2: Results-Based Monitoring and Evaluation—Part 1

Mr. Ryan Watkins conducts the RBM session containing four sub-components. In all parts of the world, governments are attempting to address demands and pressures for improving the lives of their citizens. Internal and external pressures and demands on governments and development organizations are causing them to seek ways to improve public management. Improvements might include greater accountability and transparency and enhanced effectiveness of interventions. Results-based monitoring and evaluation (M&E) is a management tool to help track progress and demonstrate the impact of development projects, programs, and policies.

15:30 – 15:45      

Coffee Break

15:45 – 17:30

17:30 – 18:00

Module 2: Results-Based Monitoring and Evaluation—Part 2

As a continuation of the previous session, Mr. Ryan Watkins assists participants with steps one to ten on developing a results-based monitoring and evaluation system. The Ten-Step Method includes the following steps: Conducting a Readiness Assessment, Agreeing on Performance Outcomes to Monitor and Evaluate, Selecting Key Indicators to Monitor Outcomes, Baseline Data on Indicators—Where Are We Today, Planning for Improvement—Setting Realistic Targets, Monitoring for Results, The Role of Evaluations, Reporting Findings, Using Findings, and Sustaining the M&E System within the organization.

Small Group Work – Set-Up and Reading

9:00 – 10:30

Module 3: Understanding the Evaluation Context and Program Theory of Change—Part 1

Linda Morra Imas discusses the background work that needs to be done as part of planning the evaluation. She discusses sources of evaluative information and secondary data sources. She then presents the theory of change, which consists of a graphic depiction of the logic behind an intervention, a set of assumptions about it and contextual factors that may affect it. She shows how it is the heart of front-end planning.

10:30 – 10:45

Coffee Break

10:45– 12:30

Module 3: Understanding the Evaluation Context and Program Theory of Change—Part 2

Linda Morra Imas continues with the theory of change and provides practice in developing it.

12:30 – 13:30

Lunch

14:00 – 15:15

Module 4: Considering the Evaluation Approach—Part 1

Mr. Ryan Watkins provides an introduction to various evaluation approaches for designing and conducting evaluations that are in use. In this module, he also explains when the approaches are most applicable.

15: 15 – 15:30

Coffee Break

15:30 – 17:00

Module 4: Considering the Evaluation Approach—Part 2

Ryan Watkins continues to explain some development evaluation approaches such as prospective evaluation, goal-based evaluation, multi-site evaluation, participatory evaluation, rapid assessment, outcome mapping, and so on

9:00 – 10:30

Module 5: Developing Evaluation Questions & Starting the Design Matrix——Part 1

Ms. Linda Morra Imas discusses evaluation questions– the different types of evaluation questions and when to use each type. She also covers how to write good questions. Knowing the type of questions to ask is important for selecting an appropriate evaluation design to answer the question.

10:30 – 10:45      

Coffee Break

10:45 – 12:30      

Module 5: Developing Evaluation Questions & Starting the Design Matrix——Part 2

Linda Morra then introduces the design matrix—a tool for planning the design of the evaluation that the participants will use in doing their small group work.

12:30 – 13:30

Lunch

14:00 – 15:30

Small Group Work--Identifying the Evaluation Approach, Formulating the Evaluation Questions, and Identifying the Measures or Indicators

15:30– 18:30

Shuttle Bus to Yu Garden

9:00 – 10:30

Module 6: Selecting Designs for Cause-and-Effect, Normative, and Descriptive Evaluation Questions—Part 1

After determining the evaluation questions, the next step will be to select an evaluation design approach that is most appropriate given each question. Ms. Linda Morra Imas shows how descriptive, normative, and cause and effect questions relate to the general design selected-- experimental, quasi-experimental and non-experimental—and options within each design category.

10:30– 10:45

Coffee Break

10:45– 12:30

Module 6: Selecting Designs for Cause-and-Effect, Normative, and Descriptive Evaluation Questions—Part 2

Linda Morra Imas continues and presents some guidelines, along with the strengths and weaknesses of various design options, but it is important to keep in mind that there is no “one and only” way to address an evaluation question.

12:30 – 13:30

Lunch

14:00 –15:15

Module 7: Selecting and Constructing Data Collection Instruments-- Part 1

Mr. Ryan Watkins presents this session designed to provide an overview of data collection methods and their advantages and disadvantages, key issues pertaining to data validity, reliability, and precision.

15:15–15:30

Coffee Break

15:30–16:45

16:45-18:00

Module 7: Selecting and Constructing Data Collection Instruments

—Part 2

Mr. Ryan Watkins introduces participants to key issues on conducting in-person interviews, use of observation, focus group interviews, administered questionnaires, diaries, self-report checklists, and use of expert judgments.

Small Group Work – Developing the Matrix: Selecting Designs and Identifying Data Sources and Collection Methods

9:00 – 10:30

Module 8: Choosing the Sampling Strategy

Ms. Linda Morra Imas covers ways to choose how much data to collect and from whom. She covers when to collect data from all and when to sample. Within sampling, she covers purposive and random sampling and different types of sampling. She also demonstrates use of a table of random numbers and how needed sample size is calculated.

10:30–10:45

Coffee Break

10:45–12:00

Experience Sharing of Performance Evaluation in Korea

Suk-Won Lee, professor of Center of International Development Evaluation (CIDE), Seoul National University, talks about Korea’s experiences on evaluating public policies, programs, and projects. In particular, a case study on the self-assessment of Korea’s Knowledge Sharing Program (KSP) will be shared in the session.

12:15–13:00

Lunch

13:00-17:00

Field Trip: Visit to the Shanghai Chenshan Botanical Garden

Case Analysis on Evaluating the Shanghai Chenshan Botanical Garden

Mr. Chen Li, senior evaluation specialist from Shanghai Finance Bureau, talks about how evaluation of Shanghai Botanical Garden is actually conducted, and shares the experiences and lessons learned from the project evaluation.

9:00–10:30

Presentation on evaluation of IFIs’ projects in China

Mr. Liu Hanyong, Director of Shanghai Finance Bureau will introduce Chinese approach of evaluating IFI’s projects, the methodology, guidelines and the indicator framework.

10:30–10:45

Coffee Break

10:45–12:30

Module 9: Managing an Evaluation—Part 1

Evaluations can be complicated projects. Mr. Ryan Watkins discusses how keeping everyone on task, meeting deadlines, and doing quality work can be challenging. He presents ways that evaluators can plan, manage, meet quality standards, and share results so that their evaluations are used by policy makers to effect change.

12:30–13:30

.Lunch

14:00–15:30

15:30-16:30

Module 9: Managing an Evaluation—Part 2

Mr. Ryan Watkins discusses writing terms of reference and contracting out evaluations

Open Panel on SDG

9:00—10:30

10:30–10:45

Module 10: Presenting Results

Linda Morra-Imas presents this last module which focuses on techniques for structuring the report to communicate easily so that the policy makers get the message and use the evaluation to effect change.

Coffee Break

10:45–11:15

11:15-12:30

Post-Test

Small Group Work –Sampling Strategy &Preparing for Presentation and Finalizing the Design Matrix

12:30–13:30

Lunch

13:30–15:30

Presentations

15:30–15:45

Coffee Break

15:45–16:30

16:30--17:00

Presentations

Wrap-up