SlideShare a Scribd company logo
Evaluation case study
August 2021
Dr Glenn O’Neil
2
There are currently 28 million
smokers aged 24-35 in
28 Member States of the EU
In 2011, the EU launched a
€ 33 million EU wide anti-smoking
campaign targeting young people
across Europe for 3 years
I was part of the evaluation team
that evaluated the campaign in 2015
Background
3
Campaign approach
“Ex-smokers are unstoppable” campaign
emphasized the benefits of becoming an ex-
smoker; it was not a prevention campaign
The campaign focused less on negative
“shock” tactics used in anti-smoking
campaigns
4
5
1. Highlight the benefits of giving up smoking
and encourage and assist citizens to help
them quit;
2. Raise awareness of the dangers of tobacco;
3. Contribute to ensuring that new generations
live longer and healthier lives in a smoke-
free Europe
Campaign objectives
6
Activities
7
What should we evaluate?
How should we evaluate?
8
What should we evaluate?
Did the campaign reach its
objectives?
Effectiveness
Reach Awareness Attitudes Action Change
9
What should we evaluate?
What worked well?
Efficiency
Cost-efficiency Activities Future campaigns
10
Why should we evaluate?
Prove and improve
11
How should we evaluate?
Monitoring data:
web, media,
social media,
iCoach
Stakeholder
surveys and
interviews
Focus groups
and surveys of
smokers and
ex-smokers
iCoach users
interviews
Analysis of
campaign
financial reports
Evaluation matrix
KPI Methods Sources
To what extent
did the campaign
achieve its
objectives?
Evaluation question
No. of smokers
reached
No. of smokers
aware of
campaign
No. of Smokers
registering on
iCoach
No. of registered
users stopping
smoking
Which campaign
channel was the
most cost-efficient?
Cost of user
reached per
channel
Financial analysis Campaign
financial reports
and reach data
Media monitoring
Surveys
Interviews
iCoach monitoring
data
Media / social
media
Smokers
iCoach users
Etc. Etc. Etc. Etc.
13
Key findings – reach to action
19 million smokers
reached
450,000 signed
up to iCoach
65,000 reported
quitting smoking
69% 1.6% 0.2%
It cost €500 for each smoker who quit
14
Key findings – role of campaign
19 million smokers
reached
450,000 signed
up to iCoach
65,000 reported
quitting smoking
Role of:
• Nicotine
replacements
• E-cigarettes
• Self-help literature
• Already decided to
stop smoking
• Only one-third of
smokers seek
support or
assistance to stop
Role of:
• Influence of family
and friends
• Cost of smoking
15
Advantages of stopping
smoking
Financial benefits from
stopping smoking
Better physical shape from
stopping smoking
Better life from stopping
smoking
Positive messaging was
appreciated by audiences
Key findings - Messaging
Most successful with Southern
Europe, men, those already
decided to stop smoking
16
Key findings – cost per channel
Print
Digital
TV
€ 8 million
€ 7.4 million
€ 2.3 million
5.4 million
43.7 million
6.3 million
€ 1.49
€ 0.17
€ 0.37
Cost
No. of
smokers
25-34 years
reached
Cost per
smoker
reached
17
1. Highlight the benefits of giving up smoking
and encourage and assist citizens to help
them quit;
2. Raise awareness of the dangers of tobacco;
3. Contribute to ensuring that new generations
live longer and healthier lives in a smoke-
free Europe
Campaign objectives – achieved?
18
Recommendations
What would you recommend based
on these findings for future EU
campaigns on smoking and other
health issues?
19
Recommendations
1. Repeat and reuse the campaign concept,
messaging and tools
2. Adopt a more targeted approach:
Southern and Eastern European countries
and women
3. Use a mix of digital and TV channels
4. Improve objective setting and
measurement
5. Build evaluation into future campaigns
from the start
20
Conclusions
• All communicators have a role in
monitoring and evaluation
• Thinking about evaluation before you start
helps you map out activities to change
desired
• Showing the results of communications is
feasible
• Value is focusing on the outcome level –
what did your communications change?
21
Q&A
Report & contact details
oneil@owlre.com
glennoneil
www.owlre.com
@glenn_oneil
www.intelligentmeasurement. net
Contacts:
http://publications.europa.eu/resource/cellar
/4c008831-cef9-11e5-a4b5-
01aa75ed71a1.0001.01/DOC_1

More Related Content

PPT
PPTX
Tobacco addiction awareness ppt
PPTX
World tobacco day may 31 2019
PPTX
Drugs abuse
PPT
Drug Use, Abuse And Misuse 2004
PPTX
Tobacco in hindi
PPTX
Drug abuse
Tobacco addiction awareness ppt
World tobacco day may 31 2019
Drugs abuse
Drug Use, Abuse And Misuse 2004
Tobacco in hindi
Drug abuse

What's hot (17)

PPTX
Anti tobacco counceling
PDF
Drugs used in disorders of the respiratory system
PPT
Tobacco 101 powerpoint
PPTX
DRUG ABUSE EDUCATION AND PREVENTION.pptx
PPTX
Vaping and Tobacco Harm Reduction
PPTX
substance and alcohol abuse
PPTX
ورشة عمل (لا للتدخين)
PPTX
Hazards of Smoking
PPTX
Smoking cessation
PPTX
Tobacco and effects
PPTX
Drug abuse
PPTX
smoking cessation
PPTX
Drug addiction
PPTX
Drug Addiction
PPTX
Tobacco awareness ppt smoking ppt
PPTX
The use and misuse of drugs
Anti tobacco counceling
Drugs used in disorders of the respiratory system
Tobacco 101 powerpoint
DRUG ABUSE EDUCATION AND PREVENTION.pptx
Vaping and Tobacco Harm Reduction
substance and alcohol abuse
ورشة عمل (لا للتدخين)
Hazards of Smoking
Smoking cessation
Tobacco and effects
Drug abuse
smoking cessation
Drug addiction
Drug Addiction
Tobacco awareness ppt smoking ppt
The use and misuse of drugs
Ad

Similar to Case study on evaluating a smoking cessation campaign (20)

PPT
Plenary 4 g steffes
PDF
Gambling Harm Marketing - lets not reinvent the wheel
PPT
Recent developments in alcohol policy in the EU (large file)
PPTX
Opportunit strategy marlboro
PDF
Workshop2 r.khoury
PPTX
world no tobacco day.pptx july 2025 pptx
PPTX
E-Cigarettes - how should Public Health respond - Martin Dockrell
PPTX
06Mar24 Mental health EU roundtable slides.pptx
PPTX
06Mar24 Mental health EU roundtable slides.pptx
PPTX
SMOKING HAZARDS AMONG YOUGSTERS AND ADULTS
PDF
22 years on the impact and relevance of the UK No Smoking Day.pdf
PPT
The tobacco products directive: an opportunity for a generation
PPTX
Slideshare presentations from esrc seminar three
PPTX
The past, present and future of the tobacco control scale
PDF
European Alcohol and Health Forum: NGO Resignation Briefing Document
PPTX
Competent or careless? Directions in European policy on low-risk nicotine pr...
PPTX
Hooked for Life – How Big Tobacco Companies Seduce Youth
PPTX
Tobacco harm reduction in the UK: e-cigarettes (EC) are making a difference
PPTX
The role of local authorities in reducing smoking, and e cigarettes
PPTX
NATIONAL TOBACCO CONTROL PROGRAMME [Autosaved].pptx
Plenary 4 g steffes
Gambling Harm Marketing - lets not reinvent the wheel
Recent developments in alcohol policy in the EU (large file)
Opportunit strategy marlboro
Workshop2 r.khoury
world no tobacco day.pptx july 2025 pptx
E-Cigarettes - how should Public Health respond - Martin Dockrell
06Mar24 Mental health EU roundtable slides.pptx
06Mar24 Mental health EU roundtable slides.pptx
SMOKING HAZARDS AMONG YOUGSTERS AND ADULTS
22 years on the impact and relevance of the UK No Smoking Day.pdf
The tobacco products directive: an opportunity for a generation
Slideshare presentations from esrc seminar three
The past, present and future of the tobacco control scale
European Alcohol and Health Forum: NGO Resignation Briefing Document
Competent or careless? Directions in European policy on low-risk nicotine pr...
Hooked for Life – How Big Tobacco Companies Seduce Youth
Tobacco harm reduction in the UK: e-cigarettes (EC) are making a difference
The role of local authorities in reducing smoking, and e cigarettes
NATIONAL TOBACCO CONTROL PROGRAMME [Autosaved].pptx
Ad

More from Glenn O'Neil (20)

PDF
Evaluating Advocacy: Challenges, Methodologies and Solutions
PDF
Integrating communications in evaluation
PDF
Humanitarian advocacy
PDF
Use of evaluation findings; types and influences
PDF
Tracking Use of Campaign Evaluation Findings of Two International Organisations
PDF
Communication evaluation: Challenges and complexities
PDF
Communicating evaluation findings: challenges and opportunities
PDF
Evaluation inforgraphics
PDF
Insights into global advocacy: Oxfam's GROW campaign
PDF
Surveys for communicators
PDF
Evaluating conferences and events: new approaches and initiatives
PDF
Evaluation of communication activities of international and non-governmental ...
PDF
Seven new ways to present evaluation findings
PDF
Pres sawi goneil_2012
PDF
Conference evaluation at a glance
PDF
Suivi et évaluation - projet de communauté
PDF
Lift10 Geneva - Survey results
PDF
Lift09 Asia Feedback Survey Results
PDF
Evaluating Communication Programmes, Products and Campaigns: Training workshop
PDF
Measuring Communications
Evaluating Advocacy: Challenges, Methodologies and Solutions
Integrating communications in evaluation
Humanitarian advocacy
Use of evaluation findings; types and influences
Tracking Use of Campaign Evaluation Findings of Two International Organisations
Communication evaluation: Challenges and complexities
Communicating evaluation findings: challenges and opportunities
Evaluation inforgraphics
Insights into global advocacy: Oxfam's GROW campaign
Surveys for communicators
Evaluating conferences and events: new approaches and initiatives
Evaluation of communication activities of international and non-governmental ...
Seven new ways to present evaluation findings
Pres sawi goneil_2012
Conference evaluation at a glance
Suivi et évaluation - projet de communauté
Lift10 Geneva - Survey results
Lift09 Asia Feedback Survey Results
Evaluating Communication Programmes, Products and Campaigns: Training workshop
Measuring Communications

Recently uploaded (20)

PPTX
CARDIOVASCULAR AND RENAL DRUGS.pptx for health study
PDF
OSCE SERIES ( Questions & Answers ) - Set 3.pdf
PPTX
Hearthhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
PDF
Lecture on Anesthesia for ENT surgery 2025pptx.pdf
PDF
The Digestive System Science Educational Presentation in Dark Orange, Blue, a...
PDF
The_EHRA_Book_of_Interventional Electrophysiology.pdf
PPTX
Approach to chest pain, SOB, palpitation and prolonged fever
PDF
Comparison of Swim-Up and Microfluidic Sperm Sorting.pdf
PPTX
Vaccines and immunization including cold chain , Open vial policy.pptx
PPT
nephrology MRCP - Member of Royal College of Physicians ppt
PDF
04 dr. Rahajeng - dr.rahajeng-KOGI XIX 2025-ed1.pdf
PPTX
Manage HIV exposed child and a child with HIV infection.pptx
PPTX
NRP and care of Newborn.pptx- APPT presentation about neonatal resuscitation ...
PPTX
09. Diabetes in Pregnancy/ gestational.pptx
PDF
OSCE SERIES ( Questions & Answers ) - Set 5.pdf
PPTX
thio and propofol mechanism and uses.pptx
PDF
focused on the development and application of glycoHILIC, pepHILIC, and comm...
PPTX
Wheat allergies and Disease in gastroenterology
PPT
Rheumatology Member of Royal College of Physicians.ppt
PPT
neurology Member of Royal College of Physicians (MRCP).ppt
CARDIOVASCULAR AND RENAL DRUGS.pptx for health study
OSCE SERIES ( Questions & Answers ) - Set 3.pdf
Hearthhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhhh
Lecture on Anesthesia for ENT surgery 2025pptx.pdf
The Digestive System Science Educational Presentation in Dark Orange, Blue, a...
The_EHRA_Book_of_Interventional Electrophysiology.pdf
Approach to chest pain, SOB, palpitation and prolonged fever
Comparison of Swim-Up and Microfluidic Sperm Sorting.pdf
Vaccines and immunization including cold chain , Open vial policy.pptx
nephrology MRCP - Member of Royal College of Physicians ppt
04 dr. Rahajeng - dr.rahajeng-KOGI XIX 2025-ed1.pdf
Manage HIV exposed child and a child with HIV infection.pptx
NRP and care of Newborn.pptx- APPT presentation about neonatal resuscitation ...
09. Diabetes in Pregnancy/ gestational.pptx
OSCE SERIES ( Questions & Answers ) - Set 5.pdf
thio and propofol mechanism and uses.pptx
focused on the development and application of glycoHILIC, pepHILIC, and comm...
Wheat allergies and Disease in gastroenterology
Rheumatology Member of Royal College of Physicians.ppt
neurology Member of Royal College of Physicians (MRCP).ppt

Case study on evaluating a smoking cessation campaign

  • 1. Evaluation case study August 2021 Dr Glenn O’Neil
  • 2. 2 There are currently 28 million smokers aged 24-35 in 28 Member States of the EU In 2011, the EU launched a € 33 million EU wide anti-smoking campaign targeting young people across Europe for 3 years I was part of the evaluation team that evaluated the campaign in 2015 Background
  • 3. 3 Campaign approach “Ex-smokers are unstoppable” campaign emphasized the benefits of becoming an ex- smoker; it was not a prevention campaign The campaign focused less on negative “shock” tactics used in anti-smoking campaigns
  • 4. 4
  • 5. 5 1. Highlight the benefits of giving up smoking and encourage and assist citizens to help them quit; 2. Raise awareness of the dangers of tobacco; 3. Contribute to ensuring that new generations live longer and healthier lives in a smoke- free Europe Campaign objectives
  • 7. 7 What should we evaluate? How should we evaluate?
  • 8. 8 What should we evaluate? Did the campaign reach its objectives? Effectiveness Reach Awareness Attitudes Action Change
  • 9. 9 What should we evaluate? What worked well? Efficiency Cost-efficiency Activities Future campaigns
  • 10. 10 Why should we evaluate? Prove and improve
  • 11. 11 How should we evaluate? Monitoring data: web, media, social media, iCoach Stakeholder surveys and interviews Focus groups and surveys of smokers and ex-smokers iCoach users interviews Analysis of campaign financial reports
  • 12. Evaluation matrix KPI Methods Sources To what extent did the campaign achieve its objectives? Evaluation question No. of smokers reached No. of smokers aware of campaign No. of Smokers registering on iCoach No. of registered users stopping smoking Which campaign channel was the most cost-efficient? Cost of user reached per channel Financial analysis Campaign financial reports and reach data Media monitoring Surveys Interviews iCoach monitoring data Media / social media Smokers iCoach users Etc. Etc. Etc. Etc.
  • 13. 13 Key findings – reach to action 19 million smokers reached 450,000 signed up to iCoach 65,000 reported quitting smoking 69% 1.6% 0.2% It cost €500 for each smoker who quit
  • 14. 14 Key findings – role of campaign 19 million smokers reached 450,000 signed up to iCoach 65,000 reported quitting smoking Role of: • Nicotine replacements • E-cigarettes • Self-help literature • Already decided to stop smoking • Only one-third of smokers seek support or assistance to stop Role of: • Influence of family and friends • Cost of smoking
  • 15. 15 Advantages of stopping smoking Financial benefits from stopping smoking Better physical shape from stopping smoking Better life from stopping smoking Positive messaging was appreciated by audiences Key findings - Messaging Most successful with Southern Europe, men, those already decided to stop smoking
  • 16. 16 Key findings – cost per channel Print Digital TV € 8 million € 7.4 million € 2.3 million 5.4 million 43.7 million 6.3 million € 1.49 € 0.17 € 0.37 Cost No. of smokers 25-34 years reached Cost per smoker reached
  • 17. 17 1. Highlight the benefits of giving up smoking and encourage and assist citizens to help them quit; 2. Raise awareness of the dangers of tobacco; 3. Contribute to ensuring that new generations live longer and healthier lives in a smoke- free Europe Campaign objectives – achieved?
  • 18. 18 Recommendations What would you recommend based on these findings for future EU campaigns on smoking and other health issues?
  • 19. 19 Recommendations 1. Repeat and reuse the campaign concept, messaging and tools 2. Adopt a more targeted approach: Southern and Eastern European countries and women 3. Use a mix of digital and TV channels 4. Improve objective setting and measurement 5. Build evaluation into future campaigns from the start
  • 20. 20 Conclusions • All communicators have a role in monitoring and evaluation • Thinking about evaluation before you start helps you map out activities to change desired • Showing the results of communications is feasible • Value is focusing on the outcome level – what did your communications change?
  • 22. Report & contact details [email protected] glennoneil www.owlre.com @glenn_oneil www.intelligentmeasurement. net Contacts: http://publications.europa.eu/resource/cellar /4c008831-cef9-11e5-a4b5- 01aa75ed71a1.0001.01/DOC_1