中文    English
  Events & Programs
 
Events & Programs > 2015 Shanghai International Program for Development Evaluation Training(Agenda)
 2015 Shanghai International Program for Development Evaluation Training(Agenda) 

2015 Shanghai International Program for Development Evaluation Training

 

November 9November 15   

Shanghai National Accounting Institute 

 

 

SponsorsMinistry of Finance, PRC

    World Bank Group

         Asian Development Bank

                          Centre for Learning on Evaluation and Results

                           Asia-Pacific Finance and Development Institute

 

                Supporter: Center for International Development Evaluation-Seoul National University

 

Core Course Agenda

Day One Monday   November 9  

8:30 - 8:50

Registration

9:00 – 9:15

Opening remarks

9:15 – 9:45

Briefing & Icebreaking

9:45 – 10:10

Pre-test

10:10-10:25

Group Photo& Coffee Break

10:25 – 12:25

Module 1: Introducing Development Evaluation

Ms. Linda Morra-Imas leads this introductory session on the changing development context, the different approaches to evaluation, the origins and history of evaluation science, and the principles and standards for evaluation.

12:25 – 13:30

Lunch

14:00 – 15:30

Module 2: Results-Based Monitoring and Evaluation—Part 1

Mr. Ryan Watkins conducts the RBM session containing four sub-components. In all parts of the world, governments are attempting to address demands and pressures for improving the lives of their citizens. Internal and external pressures and demands on governments and development organizations are causing them to seek ways to improve public management. Improvements might include greater accountability and transparency and enhanced effectiveness of interventions. Results-based monitoring and evaluation (M&E) is a management tool to help track progress and demonstrate the impact of development projects, programs, and policies.

15:30 – 15:45      

Coffee Break

15:45 – 17:30

 

 

 

 

 

 

 

 

 

 

17:30 – 18:00

Module 2: Results-Based Monitoring and Evaluation—Part 2

As a continuation of the previous session, Mr. Ryan Watkins assists participants with steps one to ten on developing a results-based monitoring and evaluation system. The Ten-Step Method includes the following steps: Conducting a Readiness Assessment, Agreeing on Performance Outcomes to Monitor and Evaluate, Selecting Key Indicators to Monitor Outcomes, Baseline Data on Indicators—Where Are We Today, Planning for Improvement—Setting Realistic Targets, Monitoring for Results, The Role of Evaluations, Reporting Findings, Using Findings, and Sustaining the M&E System within the organization.

Small Group Work – Set-Up and Reading

__________________________________________________________________________________

Day Two Tuesday   November 10

 

9:00 – 10:30

Module 3: Understanding the Evaluation Context and Program Theory of Change—Part 1

Linda Morra Imas discusses the background work that needs to be done as part of planning the evaluation. She discusses sources of evaluative information and secondary data sources. She then presents the theory of change, which consists of a graphic depiction of the logic behind an intervention, a set of assumptions about it and contextual factors that may affect it. She shows how it is the heart of front-end planning.

 

10:30 – 10:45

Coffee Break

 

10:45– 12:30

Module 3: Understanding the Evaluation Context and Program Theory of Change—Part 2

Linda Morra Imas continues with the theory of change and provides practice in developing it.

 

12:30 – 13:30

Lunch

 

14:00 – 15:15

Module 4: Considering the Evaluation Approach—Part 1

Mr. Ryan Watkins provides an introduction to various evaluation approaches for designing and conducting evaluations that are in use. In this module, he also explains when the approaches are most applicable.

 

15: 15 – 15:30

Coffee Break

 

15:30 – 17:00

Module 4: Considering the Evaluation Approach—Part 2

Ryan Watkins continues to explain some development evaluation approaches such as prospective evaluation, goal-based evaluation, multi-site evaluation, participatory evaluation, rapid assessment, outcome mapping, and so on

 

17:00 – 17:30      Small Group Work –Developing the Theory of Change

 

Day Three Wednesday   November 11

 

9:00 – 10:30

Module 5: Developing Evaluation Questions & Starting the Design Matrix——Part 1

Ms. Linda Morra Imas discusses evaluation questions– the different types of evaluation questions and when to use each type. She also covers how to write good questions. Knowing the type of questions to ask is important for selecting an appropriate evaluation design to answer the question.

10:30 – 10:45      

Coffee Break

10:45 – 12:30      

Module 5: Developing Evaluation Questions & Starting the Design Matrix——Part 2

Linda Morra then introduces the design matrix—a tool for planning the design of the evaluation that the participants will use in doing their small group work.

12:30 – 13:30

Lunch

14:00 – 15:30

Small Group Work--Identifying the Evaluation Approach, Formulating the Evaluation Questions, and Identifying the Measures or Indicators

15:30– 18:30

Shuttle Bus to Yu Garden

 

 

_______________________________________________________    

Day Four Thursday   November 12

 

9:00 – 10:30

Module 6: Selecting Designs for Cause-and-Effect, Normative, and Descriptive Evaluation QuestionsPart 1

After determining the evaluation questions, the next step will be to select an evaluation design approach that is most appropriate given each question. Ms. Linda Morra Imas shows how descriptive, normative, and cause and effect questions relate to the general design selected-- experimental, quasi-experimental and non-experimental—and options within each design category.

10:30– 10:45

Coffee Break

10:45– 12:30

Module 6: Selecting Designs for Cause-and-Effect, Normative, and Descriptive Evaluation QuestionsPart 2

Linda Morra Imas continues and presents some guidelines, along with the strengths and weaknesses of various design options, but it is important to keep in mind that there is no “one and only” way to address an evaluation question.

12:3013:30

Lunch

14:00 15:15

Module 7: Selecting and Constructing Data Collection Instruments-- Part 1

Mr. Ryan Watkins presents this session designed to provide an overview of data collection methods and their advantages and disadvantages, key issues pertaining to data validity, reliability, and precision.

15:1515:30

Coffee Break

15:3016:45

 

 

 

 

 

16:45-18:00

Module 7: Selecting and Constructing Data Collection Instruments

Part 2

Mr. Ryan Watkins introduces participants to key issues on conducting in-person interviews, use of observation, focus group interviews, administered questionnaires, diaries, self-report checklists, and use of expert judgments.

Small Group Work – Developing the Matrix: Selecting Designs and Identifying Data Sources and Collection Methods

 

Day Five Friday   November 13  

9:00 – 10:30

Module 8: Choosing the Sampling Strategy

Ms. Linda Morra Imas covers ways to choose how much data to collect and from whom. She covers when to collect data from all and when to sample. Within sampling, she covers purposive and random sampling and different types of sampling. She also demonstrates use of a table of random numbers and how needed sample size is calculated.

10:30–10:45

Coffee Break

10:45–12:00

 

Experience Sharing of Performance Evaluation in Korea

Suk-Won Lee, professor of Center of International Development Evaluation (CIDE), Seoul National University, talks about Korea’s experiences on evaluating public policies, programs, and projects. In particular, a case study on the self-assessment of Korea’s Knowledge Sharing Program (KSP) will be shared in the session.

12:15–13:00

Lunch

13:00-17:00

Field Trip: Visit to the Shanghai Chenshan Botanical Garden

Case Analysis on Evaluating the Shanghai Chenshan Botanical Garden

Mr. Chen Li, senior evaluation specialist from Shanghai Finance Bureau, talks about how evaluation of Shanghai Botanical Garden is actually conducted, and shares the experiences and lessons learned from the project evaluation.

 

 

     

Day Six Saturday   November 14

9:00–10:30

Presentation on evaluation of IFIs’ projects in China

Mr. Liu Hanyong, Director of Shanghai Finance Bureau will introduce Chinese approach of evaluating IFI’s projects, the methodology, guidelines and the indicator framework.

10:30–10:45

Coffee Break

10:45–12:30

 

Module 9: Managing an Evaluation—Part 1

Evaluations can be complicated projects. Mr. Ryan Watkins discusses how keeping everyone on task, meeting deadlines, and doing quality work can be challenging. He presents ways that evaluators can plan, manage, meet quality standards, and share results so that their evaluations are used by policy makers to effect change.

12:30–13:30

.Lunch

14:00–15:30

 

 

15:30-16:30

Module 9: Managing an Evaluation—Part 2

Mr. Ryan Watkins discusses writing terms of reference and contracting out evaluations

Open Panel on SDG

Day Seven Sunday   November 15  

9:00—10:30

 

 

 

10:30–10:45

Module 10: Presenting Results

Linda Morra-Imas presents this last module which focuses on techniques for structuring the report to communicate easily so that the policy makers get the message and use the evaluation to effect change.

Coffee Break

10:45–11:15

11:15-12:30

Post-Test

Small Group Work –Sampling Strategy &Preparing for Presentation and Finalizing the Design Matrix

12:30–13:30

Lunch

13:30–15:30

Presentations

15:30–15:45

Coffee Break

15:45–16:30

16:30--17:00

Presentations

Wrap-up

 

 

Copyright © Asia-Pacific Finance and Development Center. All Rights Reserved.
Address: 200 Panlong Road, Qingpu District, Shanghai, China.  Postcode: 201702  Tel:86-21-69768000