Artigo - Availability A Heuristic For Judging (TVERSKY e KAHNEMAN 1973)
Artigo - Availability A Heuristic For Judging (TVERSKY e KAHNEMAN 1973)
I. INTRODUCTION
Much recent research has been concerned with the validity and con-
sistency of frequency and probability judgments. Little is known, how-
ever, about the psychological mechanisms by which people evaluate the
frequency of classes or the likelihood of events.
We propose that when faced with the difficult task of judging prob-
ability or frequency, people employ a limited number of heuristics which
reduce these judgments to simpler ones. Elsewhere we have analyzed
in detail one such heuristic-representativeness. By this heuristic, an
event is judged probable to the extent that it represents the essential
features of its parent population or generating process. Evidence for rep-
resentativeness was obtained in several studies. For example, a large
majority of naive respondents believe that the sequence of coin tosses
HTTHTH is more probable than either HHHHTH or HHHTTT, al-
though all tlrree sequences, of course, are equally likely. The sequence
which is judged most probable best represents both the population pro-
portion (%) and the randomness of the process (Kahneman & Tversky,
1972). Similarly, both naive and sophisticated subjects evaluate the
likelihood that an individual will engage in an occupation by the degree
to which he appears representative of the stereotype of that occupation
(Kahneman & Tversky, 1973). Major biases of representativeness have
also been found in the judgments of experienced psychologists concern-
ing the statistics of research (Tversky & Kahneman, 1971).
When judging the probability of an event by representativeness, one
compares the essential features of the event to those of the structure from
which it originates. In this manner, one estimates probability by assess-
ing similarity or connotative distance. Alternatively, one may estimate
probability by assessing availability, or associative distance. Life-long
experience has taught us that instances of large classes are recalled better
and faster than instances of less frequent classes, that likely occurrences
are easier to imagine than unlikely ones, and that associative connections
are strengthened when two events frequently co-occur. Thus, a person
could estimate the numerosity of a class, the likelihood of an event, or
the frequency of co-occurrences by assessing the ease with which the
relevant mental operation of retrieval, construction, or association can
be carried out.
For example, one may assess the divorce rate in a given community by
recalling divorces among one’s acquaintances; one may evaluate the
probability that a politician will lose an election by considering various
ways in which he may lose support; and one may estimate the probability
that a violent person will “see” beasts of prey in a Rorschach card by
assessing the strength of association between violence and beasts of prey.
In all these cases, the estimation of the frequency of a class or the prob-
ability of an event is mediated by an assessment of availability., A person
is said to employ the availability heuristic whenever he estimates fre-
quency or probability by the ease with which instances or associations
could be brought to mind. To assess availability it is not necessary to
perform the actual operations of retrieval or construction. It suffices to
assess the ease with which these operations could be performed, much
as the difficulty of a puzzle or mathematical problem can be assessed
without considering specific solutions.
That associative bonds are strengthened by repetition is perhaps the
oldest law of memory known to man. The availability heuristic exploits
3The present use of the term “availability” does not coincide with some usagesof
this term in the verbal learning literature (see, e.g., Horowitz, Norman, & Day, 1966;
Tulving & Pearlstone, 1966).
INFORMATION AVAILABILITY AND JUDGMENT 209
the inverse form of this law, that is, it uses strength of association as a
basis for the judgment of frequency. In this theory, availability is a
mediating variable, rather than a dependent variable as is typically the
case in the study of memory. Availability is an ecologically valid clue for
the judgment of frequency because, in general, frequent events are easier
to recall or imagine than infrequent ones. However, availability is also
affected by various factors which are unrelated to actual frequency. If
the availability heuristic is applied, then such factors will affect the
perceived frequency of classes and the subjective probability of events.
Consequently, the use of the availability heuristic leads to systematic
biases.
This paper explores the availability heuristic in a series of ten studies.-l
We first demonstrate that people can assess availability with reasonable
speed and accuracy (Section II). Next, we show that the judged fre-
quency of classes is biased by the availability of their instances for con-
struction (Section III), and retrieval (Section IV). The experimental
studies of this paper are concerned with judgments of frequencies, or of
probabilities that can be readily reduced to relative frequencies. The
effects of availability on the judged probabilities of essentially unique
events (which cannot be reduced to relative frequencies) are discussed
in the fifth and final section,
Study 1: Construction
The subjects (N = 42) were presented with a series of word-construc-
tion problems. Each problem consisted of a 3 X 3 matrix containing nine
letters from which words of three letters or more were to be constructed.
In the training phase of the study, six problems were presented to all
subjects. For each problem, they were given 7 set to estimate the number
of words which they believed they could produce in 2 min. Following
each estimate, they were given two minutes to write down (on numbered
lines) as many words as they could construct from the letters in the
matrix. Data from the training phase were discarded. In the test phase,
the construction and estimation tasks were separated. Each subject esti-
mated for eight problems the number of words which he believed he
Study 2: Retrieval
The design and procedure were identical to Study 1, except for the
nature of the task. Here, each problem consisted of a category, e.g.,
fl0u~r.s or Russian novelists, whose instances were to be recalled. The
subjects (N = 28) were given 7 set to estimate the number of instances
they could retrieve in 2 min, or two minutes to actually retrieve the in-
stances. As in Study 1, the production and estimation tasks were com-
bined in the training phase and alternated in the test phase.
Results. The mean number of instances produced varied from 4.1 (city
names beginning with F) to 23.7 (four-legged animals), with a grand
mean of 11.7. The mean number estimated varied from 6.7 to 18.7 (for
the same two categories), with a grand mean of 10.8. The product-
moment correlation between production and estimation over the 16
categories was 0.93.
Discussion
In the above studies, the availability of instances could be measured
by the total number of instances retrieved or constructed in any given
problem.5 The studies show that people can assess availability quickly
and accurately. How are such assessments carried out? One plausible
mechanism is suggested by the work of Bousfield and Sedgewick ( 1944),
who showed that cumulative retrieval of instances is a negatively ac-
celerated exponential function of time. The subject could, therefore, use
the number of instances retrieved in a short period to estimate the number
of instances that could be retrieved in a much longer period of time.
Alternatively, the subject may assess availability without explicitly re-
You will be given several letters of the alphabet, and you will
be asked to judge whether these letters appear more often in the
first or in the third position, and to estimate the ratio of the
frequency with which they appear in these positions.”
Study 4: Permutations
“Consider the two structures, A and B, which are displayed below.
(A) t B)
x x x x x x x x x x
x x x x x x x x x x
x x x x x x x x x x
x x
x x
x x
x x
x x
x x
Most readers will probably share with us the immediate impression that
there are more paths in A than in B. Our subjects agreed: 46 of 54 re-
spondents saw more paths in A than in B (p < 601, by sign test). The
median estimates were 40 paths in A and I8 in B. In fact, the number
of paths is the same in both structures, for S3 = 2g = 512.
Why do people see more paths in A than in B? We suggest that this
result reflects the differential availability of paths in the two structures.
There are several factors that make the paths in A more available than
those in B. First, the most immediately available paths are the columns
of the structures. There are 8 columns in A and only 2 in B. Second,
among the paths that cross columns, those of A are generally more dis-
tinctive and less confusable than those in B. Two paths in A share,
on the average, about ?i of their elements, whereas two paths in B share,
on the average, half of their elements. Finally, the paths in A are shorter
and hence easier to visualize than those in B.
Study 5: Combinations
Consider a group of ten people who have to form committees of r mem-
bers, where r is some number between 2 and 8. How many different
committees of T members can they form? The correct answer to this
10
problem is given by the binomial coefficient which reaches a
0 r
214 TVERSKY AND KAHNEMAN
zso-
200-
150 -
s ,oo-
s a-
Q ‘O-
c 60-
2 so-
g 40-
8 30-
20-
SIZE OF SET (0
FIG. 1. Correct values and median judgments (on a logarithmic scale) for the
Committees problem and for the Stops problem.
INFORMATION AVAILABILITY AND JUDGMENT 215
“In the drawing below, there are ten stations along a route be-
tween Start and Finish. Consider a bus that travels, stopping at
exactly r stations along this route.
~----- -----
START 1 [ FINISH
10
The number of different patterns of T stops is again given by T .
0
Here too, of course, the number of patterns of two stops is the same as
the number of patterns of eight stops, because for any pattern of stops
there is a unique complementary pattern of non-stops. Yet, it appears
as though one has more degrees of freedom in constructing patterns
of two stops where “one has many stations to choose from” than in con-
structing patterns of eight stops where “one must stop at almost every
station.” Our previous analysis suggests that the former patterns are
more available: more such patterns are seen at first glance, they are
more distinctive, and they are easier to visualize.
Four new groups of subjects (total N = 178) answered this question,
forr=2, . . ., 8, following the same design as above. Median esti-
mates of the number of stops are shown in Fig. 1. As in the committee
problem, the apparent number of combinations generally decreases with
T, in accordance with the prediction from the availability hypothesis, and
in marked contrast to the correct values. Further, the estimates of the
number of combinations are very similar in the two problems. As in other
combinatorial problems, there is marked underestimation of all correct
values, with a single exception in the most available case, where T = 2.
The underestimation observed in Experiments 4 and 5 occurs, we
suggest, because people estimate combinatorial values by extrapolating
from an initial impression. What a person sees at a glance or in a few
steps of computation gives him an inadequate idea of the explosive rate
of growth of many combinatorial expressions. In such situations, extrapo-
lating from an initial impression leads to pronounced underestimation.
This is the case whether the basis for extrapolation is the initial avail-
ability of instances, as in the preceding two studies, or the output of an
initial computation, as in the following study.
Study 6: Extrapolation
We asked subjects to estimate, within 5 set, a numerical expression
that was written on the blackboard, One group of subjects (N = 87)
estimated the product 8 X 7 X 6 X 5 X 4 X 3 X 2 X 1, while another
group (N = 114) estimated the product 1 X 2 x 3 x 4 x 5 x 6 x 7 x
216 TVERSKY AND KAHNEMAN
8. The median estimate for the descending sequence was 2,250. The
median estimate for the ascending sequence was 512. The difference
between the estimates is highly significant (p < ,001, by median test).
Both estimates fall very short of the correct answer, which is 40,320.
Both the underestimation of the correct value and the difference be-
tween the two estimates support the hypothesis that people estimate 81
by extrapolating from a partial computation. The factorial, like other
combinatorial expressions, is characterized by an ever-increasing rate
of growth. Consequently, a person who extrapolates from a partial com-
putation will grossly underestimate factorials. Because the results of the
first few steps of multiplication (performed from left to right) are
larger in the descending sequence than in the ascending sequence, the
former expression is judged larger than the latter. The evaluation of
the descending sequence may proceed as follows: “8 times 7 is 56 times
6 is already above 300, so we are dealing with a reasonably large num-
ber.” In evaluating the ascending sequence, on the other hand, one may
reason: “1 times 2 is 2 times 3 is 6 times 4 is 24, and this expression
is clearly not going very far. . . .-
Note that these include all possible path-types and hence your
estimates should add to 160%”
The actual distribution of path-type is binomial with p = 516 and
n = 6. People, of course, can neither intuit the correct answers nor
enumerate all relevant instances. Instead, we propose, they glance at
the diagram and estimate the relative frequency of each path-type by the
ease with which individual paths of this type could be constructed.
Since, at every stage in the construction of a path (i.e., in each row of
the diagram) there are many more X’s than O’s, it is easier to con-
struct paths consisting of six X’s than paths consisting of, say, five X’s
and one 0, although the latter are, in fact, more numerous. Accordingly,
we predicted that subjects would erroneously judge paths of 6 X’s and
no 0 to be the most numerous.
Median estimates of the relative frequency of all path-types are pre-
sented in Fig. 2a, along with the correct binomial values. The results
confirm the hypothesis. Of the 73 subjects, 54 erroneously judged that
there are more paths consisting of six X’s and no 0 than paths consisting
40%
30X-
::
=Y 20%-
::
k
10x-
NUMBER OF X IN A SSMPLE OF 6
of five X’s and one 0, and only 13 regarded the latter as more numerous
than the former (p < .OOl, by sign test). The monotonicity of the sub-
jective distribution of path-types is apparently a general phenomenon.
We have obtained the same result with different values of p (4/5 and
5/6) and n (5, 6 and lo), and different representations of the population
proportions (e.g., four X’s and one 0 or eight X’s and two O’s in each
row of the path diagram).
To investigate further the robustness of this effect, the following ad-
ditional test was conducted, Fifty combinatorially naive undergraduates
from Stanford University were presented with the path problem. Here,
the subjects were not asked to estimate relative frequency but merely
to judge “whether there are more paths containing six X’s and no 0, or
more paths containing five X’s and one 0.” The subjects were run indi-
vidually, and they were promised a $1 bonus for a correct judgment. The
significant majority of subjects (38 of 50, p < .OOl, by sign test) again
selected the former outcome as more frequent. Erroneous intuitions, ap-
parently, are not easily rectified by the introduction of monetary payoffs.
We have proposed that when the binomial distribution is represented
as a path diagram, people judge the relative frequency of the various
outcomes by assessing the availability of individual paths of each type.
This mode of evaluation is suggested by the sequential character of the
definition of a path and by the pictorial representation of the problem.
Consider next an alternative formulation of the same problem.
“Six players participate in a card game. On each round of the
game, each player receives a single card drawn blindly from a
well-shuffled deck. In the deck, 5/6 of the cards are marked X
and the remaining l/6 are marked 0. In many rounds of the
game, what is the percentage of rounds in which
6 players receive X and no player receives 0 -!%
5 players receive X and 1 player receives 0 -%
plicit. In the card problem, on the other hand, the population proportion
is explicitly stated and no mention is made of individual instances. Con-
sequently, we hypothesize that the outcomes in the card problem will be
evaluated by the degree to which they are representative of the com-
position of the deck rather than by the availability of individual in-
stances. In the card problem, the outcome “five X’s and one 0” is the
most representative, because it matches the population proportion (see
Kahneman & Tversky, 1972). H ence, by the representativeness heuristic,
this outcome should be judged more frequent than the outcome “six x’s
and no 0,” contrary to the observed pattern of judgments in the path
problem. The judgments of 71 of 82 subjects who answered the card
problem conformed to this prediction. In the path problem, only 13 of
73 subjects had judged these outcomes in the same way; the difference
between the two versions is highly significant (p < .OOl, by a x2 test).
Median estimates for the card problem are presented in Fig. 2b. The
contrast between Figs. 2a and 2b supports the hypothesis that different
representations of the same problem elicit different heuristics. Specifically,
. card data
407
303
=:
2
= 20%
v
z
n.
10%
NUMBER OF X IN 1 SAMPLE OF 6
group were asked to judge whether the list contained more names of men
or of women.
Results. (a) Recall. On the average, subjects recalled 12.3 of the 19
famous names and 8.4 of the 20 less famous names. Of the 86 subjects in
the four recall groups, 57 recalled more famous than nonfamous names,
and only 13 recalled fewer famous than less famous names (p < .OOL
by sign test).
(b) Frequency. Among the 99 subjects who compared the frequency
of men and women in the lists, 80 erroneously judged the class consist-
ing of the more famous names to be more frequent (p < .OOl, by sign
test).
Frequency of Repetitions
The preceding study supported the notion that people judge the fre-
quency of a class by assessed availability, i.e., by the ease with which the
relevant instances come to mind. In that study, subjects judged the fre-
quency of classes which consisted of distinct instances, e.g., female enter-
tainers or male politicians. Most research on judged frequency, in con-
trast, has been concerned with the frequency of repetitions, e.g., the
number of times that a particular word was repeated in a list.
When the number of repetitions is relatively small, people may attempt
to estimate the frequency of repetitions by recalling specific occurrences.
There is evidence (see, e.g., Hintzman & Block, 1971) that subjects
retain some information about the specific occurrences of repeated items.
There are situations, however, in which occurrences cannot be retrieved,
e.g., when the total number of items is large, when their distinctiveness
is low, or when the retention interval is long. In these situations, subjects
may resort to a different method for judging frequency.
When an item is repeated several times in a list, the association be-
tween the item and the list is strengthened. Thus, a subject could use the
strength of this association as a clue to the frequency of the item. Hence,
one could judge the frequency of repetitions either by assessing the avail-
ability of specific occurrences or by a more global assessment of the
strength of the item-list association. As a consequence, factors which
either enhance the recallability of specific occurrences or strengthen the
association between item and list should increase the apparent frequency
of the item. This analysis of frequency judgments is closely related to
the theoretical treatments proposed by Hintzman and Block ( 1971) and
by Anderson and Bower ( 1972). A somewhat different analysis has been
offered by Underwood (1969a).
The general notion that factors which affect availability have a cor-
responding effect on the apparent frequency of repetitions has been
222 TVEXSKY AND KAHNEMAN
All subjects (IV = 98) were instructed to listen attentively to the mes-
sage, Following the recording, one group of 30 subjects was asked for
cued recall: each subject was given a list of all twenty stimulus words
(in one of four random orders) and was asked to write the corresponding
response words. A second group of 68 subjects was asked for frequency
judgments: each subject was given a list of all twenty pairs (again, in
one of four random orders) and was asked to judge whether each of the
pairs had appeared twice or three times in the message.
Results. (a) Cued recall. For each subject, the number of response
words correctly recalled was counted, separately for the HR and the UR
pairs under each of the two repetition levels (i.e., 2 and 3). Table la
presents the mean probability of recall for each of the four conditions.
A 2 x 2 analysis of variance showed that subjects recalled significantly
more words from the HR pairs than from the UR pairs (t = 9.4, 29 df,
p < .OOl), and that they recalled significantly more words from the pairs
that had been repeated more often (t = 2.44, 29 df, p < .05). The in-
teraction between the two factors was not significant.
(b) Judgedf re quency. Table lb presents the mean judged frequency
of the HR and the UR pairs for the two levels of actual frequency. A
2 X 2 analysis of variance showed that the HR pairs were judged more
frequent than the UR pairs (t = 4.62, 67 df, p < .OOl), although they
were, in fact, equally frequent. The effect of actual frequency was also
significant (t = 7.71, 67 df, p < .OOl). Th e interaction between the two
factors was not.
Further analyses showed that the differences between HR and UR
pairs, in both cued recall and judged frequency, were significant sep-
arately for the natural associates and for the phonetically similar pairs.
Study 10: illusory Correlation in Personality Traits
Chapman’s original study, as well as Study 9, employed a correlational
design where each response was paired with more than one stimulus. Ac-
TABLE I
Xean Prob:thililp of I:ecall and hfenu Judged Frrqueucy
Relatedness lielatedness
Low High Low High
‘J .41 .85 n
Actuxl frequency ACtllal frcqwcy
2 .31 .7T 2
4
226 TVERSKY AND KAHNEMAN
0 HR pairs
l UR pairs
I I I
0 1 2 3 4
ACTUAL FREQUENCY
approach leads to serious biases. The clinician who notes that nearly all
suicidal patients he can think of were severely depressed may conclude
that a patient is likely to commit suicide if he shows signs of severe de-
pression. Alternatively, the clinician may conclude that suicide is unlikely
if “this patient does not look like any suicide case I have met.” Such
reasoning ignores the fact that only a minority of depressed patients at-
tempt suicide and the possibility that the present patient may be quite
unlike any that the therapist has ever encountered.
Finally, a clinician might think only of patients who were both de-
pressed and suicidal, He would then evaluate the likelihood of suicide
by the ease with which such cases come to mind or by the degree to
which the present patient is representative of this class. This reasoning,
too, is subject to a serious flaw. The fact that there are many depressed
patients who attempted suicide does not say much about the probability
that a depressed patient will attempt suicide, yet this mode of evaluation is
not uncommon. Several studies (Jenkins & Ward, 1963; Smedslund, 1963;
Ward & Jenkins, 1965) showed that contingency between two binary
variables such as a symptom and a disease is judged by the frequency
with which they co-occur, with little or no regard for cases where either
the symptom or the disease was not present.
Some events are perceived as so unique that past history does not seem
relevant to the evaluation of their likelihood. In thinking of such events
we often construct scenarios, i.e., stories that lead from the present situa-
tion to the target event. The plausibility of the scenarios that come to
mind, or the difficulty of producing them, then serve as a clue to the
likelihood of the event. If no reasonable scenario comes to mind, the
event is deemed impossible or highly unlikely. If many scenarios come
to mind, or if the one scenario that is constructed is particularly com-
pelling, the event in question appears probable.
Many of the events whose likelihood people wish to evaluate depend on
several interrelated factors. Yet it is exceedingly difficult for the human
mind to apprehend sequences of variations of several interacting factors.
We suggest that in evaluating the probability of complex events only the
simplest and most available scenarios are likely to be considered. In par-
ticular, people will tend to produce scenarios in which many factors do
not vary at all, only the most obvious variations take place, and interact-
ing changes are rare. Because of the simplified nature of imagined
scenarios, the outcomes of computer simulations of interacting processes
are often counter-intuitive (Forrester, 1971). The tendency to consider
only relatively simple scenarios may have particularly salient effects in
situations of conflict. There, one’s own moods and plans are more avail-
able to one than those of the opponent. It is not easy to adopt the op-
230 TVEIRSKY AND KAHNEMAN
A Final Remark
lost important decisions men make are governed by beliefs concern-
ing the likelihood of unique events. The “true” probabilities of such
events are elusive, since they cannot be assessed objectively. The subjec-
tive probabilities that are assigned to unique events by knowledgeable
and consistent people have been accepted as all that can be said about
the likelihood of such events.
Although the “true” probability of a unique event is unknowable, the
reliance on heuristics such as availability or representativeness, biases
subjective probabilities in knowable ways. A psychological analysis of
the heuristics that a person uses in judging the probability of an event
may tell us whether his judgment is likely to be too high or too IOW.We
believe that such analyses could be used to reduce the prevalence of
errors in human judgment under uncertainty.
REFERENCES
ANDERSON, J. R., & BOWER, G. H. Recognition and retrieval processes in free recall.
Psychological Review, 1972, 79, 97-132.
BOUSFIELD, W. A., & SEDGEWICK, C. H. An analysis of sequences of restricted associa-
tive responses. Journal of General Psychology, 1944, 30, 149-165.
BRUNER, J. S., & POTTER, M. C. Interference in visual recognition. Science, 1969,
144, 424425.
CHAPMAN, L. J. Illusory correlation in observational report. Journal of Verbal Learn-
ing and Verbal Behavior, 1967, 6, 151-155.
CHAPMAN, L. J., & CHAPMAN, J. P. Genesis of popular but erroneous psychodiag-
nostic observations. Journal of Abnormal Psychology, 1967, 73, 193-204.
CHAPMAN, L. J., & CHAPMAN, J. P. Illusory correlation as an obstacle to the use
of valid psychodiagnostic signs. Journal of Abnormul Psychology, 1969, 74,
271-280.
FORRESTER, J. W. World dynamics. Cambridge, Mass.: Wright-Allen, 1971.
GOLDING, S. L., & RORER, L. G. “Illusory correlation and the learning of clinical judg-
ment.” Journal of Abnormal Psychology, 1972, SO, 249-260.
HART, J. T. Memory and the memory-monitoring process. Journal of V&al Learn-
ing and Verbal Behavior, 1967, 6, 689-691.
HINTZMAN, D. L. Apparent frequency as a function of frequency and the spacing
of repetitions. Journal of Experimental Psychology, 1969, 80, 1X1-145.
HINTZMAN, D. L., & BLOCK, R. A. Repetition and memory: Evidence for a multiple-
trace hypothesis. Journal of Experimental Psychology, 1971, 88, 297306.
HOPKINS, R. H., BOYLAN, R. J., & LINCOLN, G. L. Pronunciation and apparent fre-
quency. Journal of Verbal Learning and Verbal Behavior, 1972, 11, 105-113.
HOROWITZ, L. M., NORMAN, S. A., & DAY, R. S. Availability and associative synl-
metry. Psychological Review, 1966, 73, l-15.
HOWELL, W. C. Intuitive “counting” and “tagging” in memory. Journal of ~~~~~~
mental Psychology, 1970, 85, 210-215.
JENKINS, H. M., & WARD, W. C. Judgment of contingency between responsesand
outcomes.Psychological Monographs, 1965, 79, ( 1, Whole No. 594).
232 ‘WEFtSKY AND KAHNEMAN
JONES, E. E., & NISBETT, R. E. The actor and the observer: Divergent perceptions
of the causes of behavior. In E. E. Jones, D. Kanouse, H. H. Kelley, R. E.
Nisbett, S. Valins, & B. Weiner. Attribution: Perceiving the causes of behavior.
General Learning Press, 1971.
KAHNEMAN, D., & TVERSKY, A. Subjective probability: A judgment of representa-
tiveness. Cognitive Psychology, 1972, 3, 430-454.
KAHNEMAN, D., & TVERSKY, A. On the psychology of prediction. Psychological Re-
view, 1973, in press.
KATES, R. W. Hazard and choice perception in flood plain management. Department
of Geography Research Paper No. 78, University of Chicago, 1962.
LEICHT, K. L. Recall and judged frequency of implicitly occurring words. Journal
of Verbal Learning and Verbal Behavior, 1968, 7, 918-923.
MAYZNER, M. S., & TRESSELT, M. E. Tables of single-letter and bigram frequency
counts for various word-length and letter-position combinations. Psychonomic
Monograph Supplements, 1965, l( 2), 1332.
PHILLIPS, L. D. Some components of probabilistic inference. Technical Report No. 1,
Human Performance Center, University of Michigan, 1966.
SMEDSLUND, J. Note on learning, contingency, and clinical experience. Scandinavian
Journal of Psychology, 1966, 7, 265-266.
TULVING, E., & PEARLSTONE, Z. Availability versus accessibility of information in
memory for words. Journal of Verbal Learning and Verbal Behavior, 1966, 5,
381391.
TVERSKY, A., & KAHNEMAN, D. Belief in the law of small numbers. PsychologicaE
Bulletin, 1971, 76, 105-110.
UNDERWOOD, B. J. Attributes of memory. Psychological Review, 1969, 76, 559-
573. (a)
UNDERWOOD, B. J. Some correlates of item repetition in free-recall learning. Journal
of Verbal Learning and Verbal Behavior, 1969, 8, 83-94. (b)
UNDERWOOD, B. J., ZIMMERMAN, J., & FREUND, J. S. Retention of frequency informa-
tion with observations on recognition and recall. Journal of Expe&nental Psy-
chology, 1971, 87, 149-162.
VLEK, C. A. J. Multiple probability learning: Associating events with their probabd-
ities of occurrence. Acta Psychologica, 1970, 33, 207-232.
WARD, W. C., & JENKINS, H. M. The display of information and the judgment of
contingency. Canadian ~ournd of Psychology, 1965, 19, 231-241.