Helen Kara - Use Your Questionnaire Data - Little Quick Fix-SAGE Publications LTD (2019)
Helen Kara - Use Your Questionnaire Data - Little Quick Fix-SAGE Publications LTD (2019)
QUICK FIX:
USE YOUR
QUESTIONNAIRE
DATA
#LittleQuickFix
Sara Miller McCune founded SAGE Publishing in 1965 to support
the dissemination of usable knowledge and educate a global
community. SAGE publishes more than 1000 journals and over
800 new books each year, spanning a wide range of subject areas.
Our growing selection of library products includes archives, data,
case studies and video. SAGE remains majority owned by our
founder and after her lifetime will become owned by a charitable
trust that secures the company’s continued independence.
Helen
Kara
SAGE Publications Ltd © Helen Kara 2019
1 Oliver’s Yard
55 City Road First published 2019
London EC1Y 1SP
Apart from any fair dealing for the purposes of
SAGE Publications Inc. research or private study, or criticism or review, as
2455 Teller Road permitted under the Copyright, Designs and Patents
Thousand Oaks, California 91320 Act, 1988, this publication may be reproduced, stored
or transmitted in any form, or by any means, only with
SAGE Publications India Pvt Ltd the prior permission in writing of the publishers, or in
B 1/I 1 Mohan Cooperative Industrial Area the case of reprographic reproduction, in accordance
Mathura Road with the terms of licences issued by the Copyright
New Delhi 110 044 Licensing Agency. Enquiries concerning reproduction
outside those terms should be sent to the publishers.
SAGE Publications Asia-Pacific Pte Ltd
3 Church Street
#10-04 Samsung Hub
Singapore 049483
At SAGE we take sustainability seriously. Most of our products are printed in the UK using responsibly
sourced papers and boards. When we print overseas we ensure sustainable papers are used as
measured by the PREPS grading system. We undertake an annual audit to monitor our sustainability.
Contents
2
Everything in this book!������������������������������ 4
Glossary��������������������������������������������������� 114
3
2
MIN
summar
y
Everything in
this book!
4
Section 4 Descriptive statistics are straightforward calculations
that help you to describe and summarize your data. They include
frequencies, percentages, averages, and ranking.
5
Find out what your
data can tell you
6
Section
7
8
What Is Data
Analysis?
10
SEC
summary
10
60
SEC
summary
The process of analysing data includes several steps. You have to:
Fortunately you can take this one step at a time. This book is
structured to help you.
This may all sound very complex, but you can take it one step at a time.
12
WHAT KINDS OF
DATA DO I HAVE?
13
ISN’T DATA
ANALYSIS
REALLY HARD?
Some researchers find data analysis quite difficult, while others think it
is the easiest part of research. Some people find quantitative analysis
easy and qualitative analysis difficult; others are the other way around.
Everyone is different and you won’t know whether data analysis is hard
for you until you give it a try.
This book sets out clear procedures for using your questionnaire data.
Your best chance of finding data analysis as easy as possible is to
follow the procedures carefully, step by step.
THE ETHICS OF
DATA ANALYSIS
Researchers generally analyse data alone. Even so, they may be aware
of all the people who have an interest in their findings: their participants,
tutors, families and friends. Also researchers have their own biases and
pressures. I think it is a rare researcher who has never been tempted
to tweak their data or their findings to fit their own or someone else’s
agenda. Yet doing this is highly unethical.
15
IS
DATA ANALYNSG
AND WRITI
Writing is inextricably linked with data analysis; you can’t do one and
then the other. As you analyse your data, you need to write down what
you find out, as well as any thoughts that arise about your research
question. This writing doesn’t need to be neat. It could be on sticky
notes, electronic memos, even voice clips on your phone: whatever
works best for you. However, it is a good idea to keep all your writing in
one place, and to make sure it’s legible (or audible). Then you will find it
easier to use your analytic notes to help construct your assignment or
report.
16
17
CHECKPOINT
Get it?
Q: How can I be sure my
data analysis will be
ethical?
Got it!
A: Analyse your data
thoroughly and fairly.
Write down what you find
out, and don’t tweak your
findings!
Section
20
Data preparation
must be meticulous
21
What
Is Data
Preparation?
10
SEC
summary
24
60
SEC
summary
Accuracy is paramount
25
HOW CAN
I PREPARE
MY DATA?
How you prepare your data for coding depends on how you
administered your questionnaire. The most common methods are
on paper, online, by SMS, or using an electronic device such as a
tablet. Data from questionnaires administered electronically should be
prepared by the software you use, which should provide the data in a
format such as a ready-to-code spreadsheet.
26
NTER
HOW DO I EA
THE DAT ?
Entering quantitative data will involve making some initial coding
decisions. For example, suppose you asked, ‘Which gender do you
identify with most?’ and gave the answer options:
1 Male
2 Female
3 Both
4 Either
5 Neither
You could enter the initial letters M, F, B, E and N into your spreadsheet,
or you could use the numbers 1–5. It doesn’t matter which; they both
enable sorting and counting, which is useful at the analysis stage.
You will need to enter any qualitative data as it stands for coding later
on. (See Section 5.)
27
AKE
WHAT IF I ME
A MISTAK ?
It is essential to ensure that your data is accurate. This means
being meticulous – and that can be very boring. It’s important, though,
because a single error could completely change your findings, such as if
you put a zero or a decimal point in the wrong place.
There are various kinds of errors you could make, such as:
• A typographical error, where you intend to type one thing but in fact
type another.
28
H O W W O U L D I
W I F I ’ D M A D E
KNO
A MISTAKE?
You need to look through your prepared data to check that it seems
plausible. Data collected online is most likely to be accurate, but
mistakes can still creep in. (In fact, with this type of data, you may never
know for sure whether it is accurate!)
Even if you have entered the data yourself and been very careful, you
still need to check it for mistakes.
IS DATA PREPARATION
AS BORING AS IT
SOUNDS?
30
31
CHECKPOINT
Fill in the
missing words
making ………… and this involves …………. to make sure your data
accurate checking
bored little
carefully mistakes
prepare
32
33
ANSWERS
Data preparation can make you feel quite …………
bored but it
is important to work carefully. You need to do all you can to avoid
making mistakes and this involves checking to make sure your data
seems accurate. A good way to reduce boredom is to prepare your
data a …………
little at a time.
Section
34
Assign a number,
letter, word or phrase
to each piece of data
35
What Is
Quantitative
Data Coding?
10
SEC
summary
38
60
SEC
summary
Some data can be auto-coded, which means you can choose the
response itself to become the code. This can be done with questions
that have numerical answers, such as scaled questions.
You will need to assign a code to any piece of data that cannot be auto-
coded. You will also need to assign a special code to missing data and
know how to deal with contradictory or unsolicited data.
39
WHY ARE QUANT
AND QUALITATIV ITATIVE
E
CODED DIFFEREN DATA
TLY?
41
WHEN AND HOW
DO I ASSIGN
CODES TO DATA?
42
HOW CAN I DEAL
WITH MISSING DA
TA?
Which housework activities do you enjoy? Please tick all that apply.
A few people may tick all of these, but most will tick some or maybe
only one. This means that the others will be classed as ‘missing data’.
A good approach to missing data is to use one code for data from
skipped questions and another for data from multiple-choice questions.
They should be codes you couldn’t possibly use for anything else, such
as XXX or 9999.
43
WHAT ABOUT
CONTRADICTORY
DATA?
44
The respondent has said they are not at all satisfied with the teaching
because it was really good. This is contradictory, and you don’t know
why. The respondent could have made a mistake, or it could have been
a mischievous prank. Maybe there was some other reason; you will
never know. Therefore you need to remove their data from your dataset
because it is unreliable. This can be a blow, particularly if you have
found it difficult to recruit respondents, but it is the only ethical course
of action.
D
AND UNSOLICITE
DATA?
46
47
HOW TO CODE
DO IT YOURSELF QUANTITATIVE DATA
Answer
48
DO IT YOURSELF
Answer
49
HOW FAR HAVE
YOU COME?
Think about the questions below and tick any you can honestly answer
with a ‘yes’. If there are any where you don’t feel able to answer with a
‘yes’, check back to see what you still need to do.
50
CHECKPOINT
51
52
Congratulations!
You have prepared
and coded all of your
quantitative data!
53
Describe and analyse
quantitative data
54
Section
55
How can
I analyse
quantitative
data?
10
SEC
summary
58
60
SEC
summary
Some people feel anxious about statistics, fearing they may be too
difficult. It’s true that some statistical calculations can be complex but
descriptive statistics are straightforward. This section explains when
to use frequencies, percentages, averages and ranking, and how to
work them out. If you follow the instructions carefully you will soon be a
descriptive statistics wizard.
59
S
AREN’T STATISTIC
REALLY HARD?
Statistics can be very complicated but they don’t have to be. The more
complex statistical calculations can only be used with data from a truly
random sample. As a student researcher, you are more likely to use a
different kind of sample. This might be a:
Purposive sample – people who fit the purpose of your research. For
example, if you were studying people’s opinions of cinema facilities, you
would need people who visited cinemas
60
WHAT ARE
DESCRIPTIVE
STATISTICS?
61
Here’s a little dataset we can work with. It is answers to the question,
‘What is the maximum number of minutes in a day you would spend
vacuum-cleaning your home?’ Respondents were able to type in a
whole number of their choice.
1 5 8 5 15 2
2 7 9 8 16 12
3 10 10 10 17 10
4 5 11 5 18 15
5 20 12 15 19 10
6 0 13 5 20 0
7 3 14 8
62
FREQUENCIES
Response Frequency
0 2
2 1
3 1
5 5
7 1
8 2
10 4
12 1
15 2
20 1
If you make the table using spreadsheet software such as Excel, you
can convert it into a graph or chart, which is useful for presenting your
data.
63
PERCENTAGES
The word ‘percent’ comes from the Latin ‘per centum’ meaning ‘of
the hundred’. So if you hear that 25% of people like cabbage, you
know that means twenty-five of every hundred people. Percentages
represent proportions and can often be simplified. Twenty-five of
every hundred people is challenging to visualize, but you can simplify it
to one in four, which is the same proportion.
64
Proportions can be useful for describing your data, not least because
they are linked to probability. However, it is important not to use
percentages to make big claims from your research. If you have
only heard from 20 people, you can’t claim that 20 percent of all people
spend 10 minutes a day vacuum-cleaning their home. You can only
claim that this is the case for 20 percent of your sample.
AVERAGES
Mean
(common average)
Median
(central value)
Mode
(value found most often)
66
MEAN
To calculate the mean, add all the numbers then divide by how many
numbers you have. For our dataset, this would look like:
(5+7+10+5+20+0+3+5+8+10+5+15+5+8+2+12+10+15+10+0)
÷ 20 = 7.75
This suggests that the average person from your sample spends 7.75
minutes a day vacuum-cleaning their home. This type of average is
most useful where there are no outliers, or unusual responses, as with
our dataset.
MEDIAN
To calculate the median, put all the numbers in order and choose the
central one. Here are our numbers in order:
0 0 2 3 5 5 5 5 5 7 8 8 10 10 10 10 12 15 15 20
(7 + 8 ) ÷ 2 = 7.5
With this dataset, the median and the mean are close together. The
median is most useful where there are outliers. For example, imagine
the respondent who said they spent 20 minutes a day vacuum-cleaning
had said instead they spent 180 minutes doing so. That would change
the mean to 15.75, while the median would stay the same. So where
there are a small number of outliers the median can be a more reliable
average.
68
MODE
With our dataset the mode is not particularly useful. However, imagine
that 16 respondents had each said they spent five minutes a day
vacuum-cleaning. In this case the mode would be a helpful way to
describe the data.
69
RANKING
Frequency Response
5 5
4 10
2 0
2 8
2 15
1 2
1 3
1 7
1 12
1 20
70
With the frequencies ranked, it is easier to make sense of the data.
You may also notice that I have ranked responses that were given with
the same frequency. Two people each responded with 0, 8 and 15, so I
have put those in ascending order. They could equally be in descending
order, though it is important to be consistent: use one approach or the
other, not both. Therefore, I have also ranked the five responses given
by one person each in ascending order.
71
HOW TO CALCULATE
DO IT YOURSELF DESCRIPTIVE STATISTICS
1 1 8 3 15 2
2 4 9 1 16 30
3 0 10 2 17 4
4 1 11 1 18 1
5 2 12 4 19 4
6 0 13 1 20 1
7 1 14 0
Response Frequency
72
DO IT YOURSELF
73
74
ANSWERS DO IT YOURSELF
Check your
Answers
Response Frequency
0 3
1 8
2 3
3 1
4 4
30 1
Mean: 3.75
Median: 0 0 0 1 1 1 1 1 1 1 1 2 2 2 3 4 4 4 4 30 = 1
Mode: 1
The median and the mode are the same so you could use either or both.
The mean is affected by the outlier i.e. the one person who says they
clean their oven 30 times each month.
USING DESCRIPTIVE
STATISTICS TO ANALYSE
QUANTITATIVE DATA
Their functions are given below; can you match each one with the
correct type of calculation?
Representation
Ordering
Counting
Proportions
Ranking is about
ranking – ordering.
Answer: frequencies – counting; percentages – proportions; averages – representation;
75
Section
76
Use your own
experience and
knowledge in a
systematic way
77
How can I
code and
analyse
qualitative
data?
10
SEC
summary
80
60
SEC
summary
Qualitative data coding and analysis is all about words. The data
is made up of words and coded with words and phrases. Analysis
involves rearranging data and codes and writing new words to record
insights you experience and conclusions you draw.
While the process varies depending on how much data you have, it is
always systematic and methodical. If you have only a little data you
can skip the coding and go straight to creating categories for analysis.
If you have a lot of data you will need to code it before you can create
categories and identify themes.
81
WHAT’S THE
H
DIFFERENCE WITA?
QUALITATIVE DAT
82
HOW CAN I
ANALYSE DATA
?
I HAVEN’T CODED
You can group the answers into categories. If you spot any answers
that say the same kind of thing, group them together. If you are working
electronically you can copy each piece of data into a list with others that
say the same or something similar. If you are working from hard copies,
you can write each piece of data on a separate piece of paper or sticky-
note and put it with others that say the same, or something similar. Each
group then forms a category. It is a good idea to name each category
for ease of reference.
83
If your qualitative data proves impossible to group, don’t panic. This
is a finding in itself. Think about what it might mean in the context of
your research. Could it reflect the diversity of your participants? Is it
in response to a question that is likely to elicit a wide range of views?
Maybe it’s because you have a small number of responses. Or is there
some other reason? Write down whatever you conclude and any other
insights.
RE NO
WHAT IF THERE ADATA?
GROUPS IN MY
84
If you have more data than just a few short answers you will probably
need to code your data. There are no hard-and-fast rules about how
much data you need to use coding. A useful rule of thumb is that if
your data feels like too much to group into categories straight
away, you probably need to use coding. Another is that if you only
have short answers, even if there are a lot of them, you can probably go
straight to grouping. Conversely, if your respondents have written whole
paragraphs you will probably need to code that data.
E N S H O U L D I C ODE
WH A?
QUALITATIVE DAT
85
To code qualitative data, you need to read it carefully, one line at a
time. The easiest way to do this is to gather all the responses to each
question. Put them into a new worksheet or document and then read
them through. As you read, code whatever you perceive within the data
with any words or phrases you choose. Highlight each piece of data and
attach the code as a comment in the margin. Keep a list of the codes
you create and re-use them when appropriate.
This process can feel difficult at first but keep going and, as you build
your list of codes, it will get easier. When you have read through once,
read through your codes and your data again to ensure you haven’t
missed anything.
HOW DO I CODE
QUALITATIVE DAT
A?
86
There are two main ways of analysing coded qualitative data: content
analysis and thematic analysis. Which you use will depend on your
research question and the quantity of data you have. In some cases you
might use both.
87
CONTENT
ANALYSIS
There are no hard-and-fast rules about whether you should count how
many respondents mention something or the total number of mentions.
You may need to do both before you decide which is the best measure
to report.
88
THEMATIC
ANALYSIS
Thematic analysis is the most thorough form of analysis but you can
only do this if you have quite a lot of qualitative data. A theme is an
idea or concept. Themes are the top or broadest level of analysis,
with categories in the middle and codes as the first level. This means
you will have more codes than categories and more categories than
themes. A theme may be derived from categories (alone or combined),
or from relevant literature you have reviewed, or from a combination of
categories and literature.
To identify categories and themes, re-read the coded data. Ask yourself
questions such as:
seems
d ow n an y thing that
Write ugh.
va n t as y ou read thro
rele
89
HOW TO IDENTIFY
DO IT YOURSELF
CATEGORIES
AND THEMES IN
QUALITATIVE DATA
Here’s an example of some qualitative data in response to the question
‘What is your overall view of housework?’ How would you group these
answers into categories?
I like ironing and making beds, but I don’t like the rest.
I like when my Dad does it because the house gets clean and tidy.
Hate it.
90
DO IT YOURSELF
estion s on
e h av e g iv en our sugg
W ge.
the next pa
91
DO IT YOURSELF
Suggested categories:
I like ironing and making beds, but I don’t like the rest.
I don’t mind housework except for cleaning the toilet.
I only enjoy sweeping floors (yeah, I know; weird)
Dislike
Not optional
92
DO IT YOURSELF
Can you see any themes developing? Identify some possible themes
here.
estions on
e h av e m ad e some sugg
W ge.
the next pa
93
DO IT YOURSELF
Suggested themes:
Emotion
94
MATCH THEM UP
A code is
A category is
A theme is
Definitions:
95
96
ANSWERS
A code is a number, letter, word or phrase assigned to a
piece of data.
A category is a group of items of data.
A theme is a central idea arising from data.
Congratulations!
equipped
You are now fully
your
to code and analyse
qualitative data!
#LittleQuickFix
97
98
Make your findings
accessible to others
6
Sec
tion
6 99
How can I
interpret my
findings?
10
SEC
summary
102
60
SEC
summary
You need to use your findings to find the story your data would tell if it
could speak. This is the act of interpretation, and it involves:
• Thinking about how your findings relate to the literature you have
reviewed
• Working out how to weave your findings and the literature into a
narrative
104
HOW DO I IDENTIF
MY KEY FINDING Y
S?
This involves considering each of your findings in turn in the light of
your other findings and the literature you have reviewed. Not all of your
findings will be noteworthy. However, be sure to note:
Strong findings are not necessarily key findings, though they may be.
A strong finding that you did not expect is more likely to be a key
finding. As so often with research, there are no hard-and-fast rules
about what is and what isn’t a key finding. It’s a matter of judgement
and the final judgement is yours.
105
HOW DO I CREAT
E
A NARRATIVE?
Once you have identified your key findings, write each one out as a
sentence. If you are writing by hand, it will help if you write each finding
on a separate piece of paper or sticky note. Then think about the
order of your findings. Can you arrange them into some kind of logical
progression? Examples include:
• chronological order
• small to large
• first to last.
106
WHAT DO YOU M
E
I MIGHT HAVE TO AN,
MORE RESEARCHDO
?
When you’re interpreting your findings, other questions may occur to
you. It is worth noting down these questions for two reasons. First,
you may be able to answer them quickly by doing a little fact-finding.
Second, they might lead to ideas for further research to mention in your
assignment.
If you interpret your findings thoroughly, and meet the needs of your
audience(s), you give your research the best opportunity to make a
difference. You may feel that your student research project has no hope
of creating change but some truly do. Even if it doesn’t – even if you
hate doing research and can’t wait to finish – it is still worth doing your
project as well as you can. There are two reasons for this.
First, obviously, you will get better marks for thorough rather than
slapdash work. Second, you will inevitably use research during your
career. You will be better placed to assess the quality of research if you
have done a good piece of work yourself.
108
WHAT DO I DO NEXT?
Your next job is to write your assignment! Some people are confident
writers, others less so. If you feel you need help with writing, check
out The Quick Fix Guide to Academic Writing by Phillip C. Shon, or
Writing Successful Reports and Dissertations by Lucinda Becker.
These books cover the most common questions and problems students
have about writing.
CHECKPOINT
Get it?
Q: How do I interpret
my findings?
Have you:
Understood the process of data analysis, its ethical aspects, and its
relationship with writing? If not, go back to page 11.
Coded your quantitative data and, if you have enough of it, your
qualitative data? If not, go back to page 40 for quantitative data
and 81 for qualitative data.
HOW TO KN
OW
YOU
ARE
DONE
112
CHECKPOINT
Identified your key findings and used them to tell a story? If not, go
back to page 104.
If you can agree with each statement – then you are done!
113
Glossary
Analysis a systematic way of working with your data to
produce findings.
114
Data the responses from your questionnaires.
115
Percentage proportion of one hundred.
116