TYPES

OF
EVALUATION
Dr. N. Ramroop
2024
Use of Evaluations
▪Improving performance (evaluation for learning): this aims to provide feedback
to programme managers.
▪Evaluation for improving accountability
▪Evaluation for generating knowledge: increasing knowledge about what works
and what does not with regards to a public policy, or programme, which allows
governments to build an evidence base for future policy development.
▪Decision-making
▪If the evaluation shows that the programme or policy is not formulated correctly
to achieve the desired objectives, a good evaluation report should lead to a
change in policy.
Each evaluation cycle builds upon previous findings, allowing for continuous
learning, adaptation and improvement over time.
Types of Evaluation
▪Projects and programmes need to be evaluated in different aspects
▪Therefore, types of evaluation that will be conducted to determine success and achievement of
the policy objectives.
There are several types of evaluations that can be conducted:
1. Formative evaluation
2. Process evaluation
3. Outcome evaluation
4. Economic evaluation
5. Impact evaluation
6. Summative evaluation
7. Goal-based evaluation
Formative Evaluation
▪Conducted during the early stages of program development or
implementation to provide feedback – this is necessary to identify
strengths and weaknesses and also guide improvements

▪Assessing the process of program implementation and the extent to

which program activities are being conducted as planned.

▪Primary purpose
▪ inform decision-making and enhance the quality, relevance and effectiveness of a
program before its full-scale implementation or rollout.
Why is formative evaluation conducted during
the early stages of program implementation?
▪It allows for adjustments and refinements to be
made based on feedback and insights gathered from
stakeholders.
▪It focuses on the process i.e. implementation of
program, delivery of activities, abiding to
implementation plans and also the engagement of
the stakeholders.
How is formative evaluation conducted?
▪Use of qualitative methods such as interviews, focus
groups, observations and document analysis
▪This provides in-depth insights into program
implementation processes and stakeholders' experiences.
▪Identify underlying issues and challenges. Continuous
feedback loop, formative evaluation involves ongoing
feedback and communication between evaluators and
program implementers.
▪formative evaluation is action-oriented - generates
actionable recommendations and suggestions for program
improvement.
▪It emphasizes collaborative problem-solving and
participatory decision-making, involving stakeholders in
the evaluation process to ensure buy-in and ownership of
recommendations.
Process Evaluation
▪ also known as ‘activity monitoring’
▪Its sole purpose is to track the use of inputs and resources, along with examining how
activities and outputs are delivered
▪Assesses the implementation processes and procedures of a program or intervention.
Process evaluation looks at whether program activities have been implemented as
intended
i.e. Process evaluation assesses whether program activities are delivered according to
predetermined protocols, guidelines or standards.
▪Focuses on understanding the activities and methods used in the implementation of
the program, and how well they were carried out.
There are different aspects to Process
Evaluation:
▪Process evaluation examines program implementation quality
including staff skills and competence, resource availability and
program content delivery.

▪Process evaluation looks at various key aspects i.e.

➢Implementation
➢Quality
➢Reach
➢insights
Implementation: procedures and the decisions undertaken are
identified in developing the program. It describes how the program
operates, the services it delivers, and the functions it carries out.

Quality: Process evaluation assesses the quality and accuracy of the

delivered intervention to participants, providing opportunities for
future improvements in theories, methods, and intervention.
Reach: It also takes into consideration the use of intervention
materials, level of participation, the dose delivered, and the
influence of external factors affecting the intervention delivery.
Insights: provides insight into the links between theories that are
essential for the success of the intervention and the final study
outcomes.
Outcome Evaluation
Outcome evaluation or effectiveness evaluation measures
program effects on the target population by assessing the
progress in the outcomes or outcome objectives that the
program is to achieve.
It measures the results/outcomes of the program to determine
if the goals and objectives of the program have been achieved.
The focus is on the impact the program has had on participants
and the larger community – whether it has been beneficial to
the target population.
What are the key aspects of outcome
evaluation?
Accountability: Outcome evaluation provides evidence-based information on the effectiveness
of a program, which can be used to demonstrate accountability to stakeholders, such as funders,
policymakers, and program participants.
Continuous Improvement: By measuring outcomes and identifying areas for improvement,
outcome evaluation can help program managers and stakeholders to continuously improve
program performance and achieve better results.
Resource Allocation: Outcome evaluation can help stakeholders to determine the most effective
and efficient ways to allocate resources, by identifying programs and interventions that are
achieving their intended outcomes and providing the greatest benefits to the target population.
Learning and Knowledge Sharing: Outcome evaluation can generate new knowledge and
insights about what works and what doesn’t work in programs and interventions, which can be
shared with other stakeholders and used to inform future program design and implementation.
Importance of Outcome Evaluation
▪Assesses the progress on the sequence of outcomes the program
is to address.
▪The different phases within a programs can be assessed i.e. short-
term, intermediate, and long-term outcomes.
▪Outcome evaluation is an essential tool for program managers,
policymakers, and other stakeholders to assess the effectiveness
and impact of programs and interventions, and to make informed
decisions about resource allocation and program improvement.
Impact Evaluation
▪Impact evaluation provides information about the impacts
produced by an intervention.
▪Impact evaluation assesses program effectiveness in achieving its
ultimate goals.
▪Measures the program’s immediate effects and aligns with
program objectives.
▪It evaluates the long-term effects of the program and measures
changes that can be attributed to it.
Importance of Impact Evaluation
▪Impact evaluation provides information about
whether a program is achieving its intended goals
and whether it is making a positive difference in the
lives of its beneficiaries.
▪It allows program developers to understand the
strengths and weaknesses of their programs and to
make data-driven decisions about how to improve
them.
Goal-based Evaluation
Goal-based evaluation is a method used to determine
the actual outcome of a program, project, or
organization development when compared to the
goals of the original plan
…cont.. Goal-based Evaluation
▪Provides an understanding of the planning process,
explains how and why decisions are made and activities
undertaken.
▪Goal-based evaluation is a tool for recording and
documenting salient ideas, concerns, activities,
administrative and management structures, staffing
patterns, products, and resources.
▪It is essential for interventions implemented at multiple
locations, among different target groups.
Economic Evaluation
Evaluates the financial aspects of the program and determines
whether the benefits outweigh the costs.
It tracks the real expenditure involved in a project in comparison to
the allocated budget.
Identifies the value gained from resources used to implement a
policy, program, or intervention.
It helps to determine how effectively resources are being used and
whether there are better ways of using them.
Cost-benefit analysis - the potential rewards expected from a
situation are added and the total costs associated with taking that
action are subtracted
Importance of Economic Evaluation
In essence, economic evaluation is a powerful tool
that can help users make the most of resources,
decide between promising program options, and
demonstrate the benefits of a program.
Summative Evaluation
▪Summative evaluation is conducted at the end of a program or
project, with the goal of assessing its overall effectiveness.

▪The primary focus of summative evaluation is to determine

whether the program or project achieved its goals and objectives.

▪Summative evaluation is often used to inform decisions about

future program or project development, as well as to determine
whether or not to continue funding a particular program or project.
Importance of Summative Evaluation
❑It provides a comprehensive assessment of the overall effectiveness of
a program or project, which can help to inform decisions about future
development and implementation.
❑It can help to identify areas where improvements can be made in
program delivery, such as in program design or implementation.
❑It can also help to determine whether the program or project is a
worthwhile investment, and whether it is meeting the needs of
stakeholders.
❑It promotes accountability, transparency, and effectiveness in program
or project implementation.
 Benefits obtained from evaluations
❖Learning and feedback into policy and implementation;
❖Ensuring policy and management decisions are based on evidence;
❖Better understanding of which programmes are cost-effective;
❖Saving money;
❖Improving understanding and so being better able to overcome institutional bottlenecks to improved impact
(adapting policies and programmes).
Ultimately these should result in:
➢Strengthening the culture of use of evidence to improve performance;
➢Better policy and planning;
➢Better resource allocation;
➢Minimising negative unintended consequences of policy;
➢The public being aware of what government does (public accountability).