Collective Action in Game Theory
Collective Action in Game Theory
Prelude
So far we have considered games with only two or three players interacting
with each others. But, many social, economic, and political interactions are
strategic situations in which numerous players participate at the same
time.
Problem – too many players (too many students, investors, and commuters
crowding just where you wanted to be); too few willing volunteers for some
worthy cause
2
Collective Action
In the most general form, such many-player games concern problems of
collective action.
The aims of the whole society or collective are best served if its members
take some particular action or actions, but these actions are not in the best
private interests of those individual members.
We must examine how the game can be modified to lead to the optimal
outcome or at least to improve on an unsatisfactory Nash equilibrium
They come in three forms, all of them familiar to you by now: the prisoners’
dilemma, chicken, and assurance games
3
Collective-action Games with Two Players
Imagine that you are a farmer.
The two of you can join together to undertake this project, or one of you
might do so on your own.
However, after the project has been constructed, the other automatically
benefits from it.
Therefore, each is tempted to leave the work to the other (free ride).
Second, its benefits are non-rival: any one person’s benefits are not
diminished by the mere fact that someone else is also getting the
benefit.
5
Collective-action Games with Two Players
In contrast, a pure private good is fully excludable and rival: non-
payers can be excluded from its benefits, and if one person gets the
benefit, no one else does. A loaf of bread is a good example of a pure
private good.
6
Collective Action as a Prisoners’ Dilemma
The costs and the benefits associated with building the irrigation project
depend, as do those associated with all collective actions, on which players
participate.
In turn, the relative size of the costs and benefits determine the structure of
the game that is played
The irrigation project can be finished in 7 weeks if you work alone, whereas
if the two of you acted together, it would take only 4 weeks of time from
each.
The two-person project is also of better quality; each farmer gets benefits
worth 6 weeks of work from a one-person project (whether constructed by
you or by your neighbor) and 8 weeks’ worth of benefit from a two-person
project.
7
Collective Action as a Prisoners’ Dilemma
More generally, we can write benefits and costs as functions of the number of
players participating.
Similarly benefits can be written as B(n); in this case B(1) = 6 and B(2) = 8
The benefits are the same for each farmer regardless of participation due to
the public-good nature of this particular project.
Each farmer has to decide whether to work toward the construction of the
project or not—that is, to shirk (free ride)
8
Collective Action as a Prisoners’ Dilemma
Payoffs are determined on the basis of the difference between the cost and
the benefit associated with each action
So the payoff for choosing Build will be B(n) - C(n) with n = 1 if you build
alone and with n = 2 if your neighbor also chooses Build.
The payoff for choosing Not is just B(1) if your neighbor chooses Build,
because you incur no cost if you do not participate in the project.
9
Best responses and NE
If neighbour doesn’t participate then best response is not to participate as
your benefit from completing the project by yourself (6) is less than your
cost (7) with a net benefit of (-1) as compared to (0) when you don’t
participate
IF neighbour participates then best response is to free ride and get the
benefit (6) from his work at no cost to yourself
Though both will be benefitted if they work together and get (4) each, the
NE is not building for both the players – PD game
Individually optimal choices (in this case, not to build regardless of what the
other farmer chooses) may not be optimal from the perspective of society as
a whole, even if the society is made up of just two farmers.
10
Social Optimum and NE
The social optimum in a collective-action game is achieved when the sum
total of the players’ payoffs is maximized; in this prisoners’ dilemma, the
social optimum is the (Build, Build) outcome.
Suppose we have a different social optimal (let’s assume 1 person project has
the same quality as 2 person project and if built, each farmer saves 6.3 weeks
of work)
11
Social Optimum and NE
The social optimum is one person building and the other free riding (with a
joint payoff of 5)
The game is still a prisoners’ dilemma and leads to the equilibrium (Not,
Not)
Achieving the social optimum in this case then poses a new problem: Who
should build and suffer the payoff of -1 while the other is allowed to be a free
rider and enjoy the payoff of 6?
12
Collective Action as Chicken
Suppose the cost of the work is reduced so that it becomes better for you to
build your own project if your neighbor does not.
13
Collective Action as Chicken
Best response is to shirk when your neighbor works and to work when
he shirks.
In form, this game is just like a game of chicken, where shirking is the
Straight strategy (tough or uncooperative), and working is the Swerve
strategy (conciliatory or cooperative)
14
Collective Action as Chicken
That is, neither of the Nash equilibria provides so much benefit to
society as a whole as that of the coordinated outcome, which entails
both farmers’ choosing to build
15
Collective Action as Chicken
If the outcome of the chicken game is its mixed-strategy equilibrium,
the two farmers will fare even worse than in either of the pure-
strategy equilibria
16
Collective Action as Chicken (II)
Suppose each farmer’s benefit from the two-person project, B(2), is only
6.3, whereas each still gets a benefit of B(1) = 6 from the one-person project
17
Collective Action as Chicken (II)
18
Collective Action as Assurance
Suppose the benefit of a one-person project to B(1) = 3 and everything same
as the PD game [B(2) = 8, C(2) = 4; C(1) = 7]
This change reduces your benefit as a free rider so much that now if your
neighbor chooses Build, your best response also is Build.
This is now an assurance game with two pure-strategy equilibria: one where
both of you participate and the other where neither of you does
19
Assurance Vs Chicken
As in the chicken II version of the game, the socially optimal outcome
here is one of the two Nash equilibria.
In chicken II, the two players differ in their preferences between the
two equilibria, either of which achieves the social optimum (B, NB) or
(NB, B).
In the assurance game, both of them prefer the same equilibrium, (B,
B) and (NB, NB) and out of which (B, B) is the socially optimal
outcome.
In such games, society as a whole prefers that some or all of the individual
players do not participate or do not act.
The difficulty associated with not being able to reach the social optimum in
such games is known as the “tragedy of the commons”
What if the outcome of both farmers’ building was that the project used so
much water that the farms had too little water for their livestock?
22
Tragedy of the Commons
Then each player’s payoff could be negative when both choose Build, lower
than when both choose Not Build
If one farmer’s activity causes harm to the other, as would happen if the only
way to prevent one farm from being flooded is to divert the water to the
other. Then each player’s payoffs could be negative if his neighbor chose
Build.
Again, one variant of chicken could also arise. In this variant, each of you
wants to build when the other does not, whereas it would be collectively
better if neither of you did
23
Collective-action Problems in Large Groups
We extend our irrigation-project example to a situation in which a
population of N farmers must each decide whether to participate
C(n) representing the cost each participant incurs when n of the N total
farmers have chosen to participate
Similarly, B(n) and payoff for each participant is P(n) = B(n) - C(n); whereas
each nonparticipant, or shirker, gets the payoff S(n) = B(n)
In general, you will have to make your decision when the other (N - 1)
players consist of n participants and (N - 1 - n) shirkers
24
Collective-action Problems in Large Groups
If you decide to shirk – the number of participants in the project is still n, so
you get a payoff of S(n).
This comparison holds true for every version of the collective-action game
25
Collective-action Problems in Large Groups
The above game is a PD if – P(2) < S(1); P(1) < S(0) and P(2) > S(0)
The dilemma is of type I if 2P(2) > P(1) + S(1), so the total payoff is higher
when both build than when only one builds
26
Multiplayer Prisoners’ Dilemma
Version of the irrigation project: an entire village of 100 farmers must
decide which action to take
If you are not working on the project, you can enjoy this benefit and
use your time to earn an extra 4 in some other occupation, so S(n) =
2n + 4
27
Multiplayer Prisoners’ Dilemma
28
Multiplayer Prisoners’ Dilemma
Full range of n is from 0 to (N – 1)
High number of participants, right hand side of the graph and vice-versa
The curve S(n) lies entirely above the curve P(n + 1) as (2n+4)>2n for
all n≥0
Therefore, the Nash equilibrium of the game entails everyone shirking, and
the project is not built
Also, S(0) < P(N) implying if everyone including you shirks, your payoff is
less than if everyone including you participates
Everyone would be better off than they are in the Nash equilibrium of the
game if the outcome in which everyone participates could be sustained – PD
30
Multiplayer Prisoners’ Dilemma
How to compare NE with Social Optimum in this case?
The total payoff to society when there are n participants consists of the
value P(n) for each of the n the value S(n) for each of the (N - n)
shirkers:T(n) = nP(n) + (N - n) S(n).
If the second term does not increase too fast as n increases—as would
be the case if the shirker’s extra benefit, [S(n) - P(n)], is small and
constant—then the effect of the first term dominates in determining
the value of T(n).
But payoffs are such that each farmer has an individual incentive to
shirk.
33
Multiplayer Prisoners’ Dilemma
If the gap between S(n) and P(n) widens sufficiently fast as n increases,
then the negative effect of the second term in the expression for T(n)
outweighs the positive effect of the first term as n approaches N; then
it may be best to let some people shirk—that is, the socially optimal
value for n may be less than N.
For large values of n, P(n +1) < S(n), so if many others are
participating, your choice is to shirk
More generally, the chicken case occurs when you are given a choice
between two actions, and you prefer to do the one that most others
are not doing
36
Multiplayer Chicken: Equilibrium
This location where P(n +1) and S(n) intersects, represents the
equilibrium value of n.
If, P(n +1) and S(n) doesn't intersect, strictly speaking the game has no
Nash equilibrium
37
Multiplayer Chicken
What is the socially optimal outcome in the chicken form of collective
action?
38
Multiplayer Assurance
If P(n + 1) = 4n + 4 and S(n) = 2n + 100; NE n=48
But P(n + 1) > S(n) for large values of n, so if many others are
participating, then you want to participate too.
40
Multiplayer Assurance: Equilibrium?
If n were exactly 48, we would see an outcome in which there were some
participants and some shirkers.
If any one farmer accidentally joined the wrong group, his choice would alter
the incentives for everyone else, driving the game to one of the endpoint
equilibria.
41
Externalities
We delve further into the differences between the individual (or
private) incentives in such games and the group (or social) incentives
42
Commuting and Spillovers
A large group of 8,000 commuters who drive every day from a suburb to the
city and back
One can take either the expressway (action P) or a network of local roads
(action S)
Local-roads route takes a constant 45 minutes, no matter how many cars are
going that way
The expressway takes only 15 minutes when uncongested. But every driver
who chooses the expressway increases the time for every other driver on the
expressway by 0.005 minutes
What if one more car adds up? (You, a local-road driver, might therefore
decide to switch from driving the local roads to driving on the expressway)
44
Commuting and Spillovers
Hence, if there are 4001 cars in the expressway, then,
P(4000) = 45 - 0.005(4001) = 24.995 > 15 = S(4001)
This payoff is still higher than the 15 from driving on the local roads.
Thus, you have a private incentive to make the switch, because for you,
P(n + 1) > S(n)
Your switch yields you a private gain (equal to the difference between your
payoffs before and after the switch); this private gain is P(n+1) - S(n) = 9.995
minutes
You a small part of the whole group, the gain in payoff that you receive in
relation to the total group payoff is small, or marginal.
45
Commuting and Spillovers
We call your gain the marginal private gain associated with your switch.
Your action, switching from local roads to expressway, has caused this effect
on the others’ payoffs.
Whenever one person’s action affects others like this, it is called a spillover
effect, external effect, or externality.
Because you are but a very small part of the whole group, we should actually
call your effect on others the marginal spillover effect.
46
Commuting and Spillovers
Taken together, the marginal private gain and the marginal spillover
effect are the full effect of your switch on the group of commuters, or the
overall marginal change in the whole group’s or the whole society’s payoff.
We call this the marginal social gain associated with your switch.
This “gain” may actually be positive or negative, so the use of the word gain is
not meant to imply that all switches will benefit the group as a whole.
In fact, in our commuting example, the overall marginal social gain is 9.995 -
20 = -10.005 (minutes).
Thus, the overall social effect of your switch is bad; the social payoff is
reduced by a total of just over 10 minutes.
47
Commuting and Spillovers
Solving for P(n+1) = S(n), we get at n=6000, you become indifferent
48
Spillovers: The General Case
For the generalised version we resort to total social payoff function, T(n),
where n represents the number of people choosing P, so (N – n) is the
number of people choosing S.
Suppose that initially n people have chosen P and that one person switches
from S to P.
49
Spillovers: The General Case
⇒ T(n + 1) - T(n) = [P(n + 1) - S(n)] +
n [P(n + 1) - P(n)] +
[N - (n + 1)] [S(n + 1) - S(n)]
First term [P(n + 1) - S(n)] is the marginal private gain enjoyed by the person
who switches – which drives a person’s choice, and all such individual
choices then determine the Nash equilibrium
The second and third terms are the quantifications of the spillover effects of
one person’s switch on the others in the group
The 2nd term captures – for the n other people choosing P, each sees his
payoff change by the amount [P(n + 1) - P(n)] when one more person
switches to P
50
Spillovers: The General Case
The 3rd term captures – There are also (N - n - 1) others still choosing S after
the one person switches, and each of these players sees his payoff change by
[S(n + 1) - S(n)]
The effect that one driver’s switch has on the time for any one driver on
either route is very small, but, when there are numerous other drivers (that
is, when N is large), the full spillover effect can be substantial
51
Solving using calculus
If N is large, then we can assume n as infinitesimally small and hence treat n
as a continuous variable and apply calculus
52
Negative Externalities
A negative externality exists when the action of one person lowers
others’ payoffs
individual who changes his route to work does not take the spillover
(the externality) into account when making his choice
53
Negative Externalities
But society would be better off if the commuter’s decision were
governed by the marginal social gain.
Recall that if n people are already using the expressway and another
driver is contemplating switching from the local roads to the
expressway
54
Negative Externalities
He stands to gain from this switch if P(n + 1) > S(n)
⇒ 45 - (n + 1) × 0.005 > 15
⇒ n < 5999
Therefore, commuters will crowd onto the expressway until there are
almost 6,000 of them, but all crowding beyond 3,000 reduces the total
social payoff
55
Negative Externalities
56
How to achieve social optimum?
Different cultures and political groups use different systems
The society could simply restrict access to the expressway to 3,000 drivers.
But how would it choose those 3,000?
First-come, First-served Rule: but then drivers would race each other to
get there early and waste a lot of time
57
How to achieve social optimum?
Corrupt Society: bribery
Make P(n) - t = S(n) and plugging n=3000 in the equation get t=15.
But t is in minutes. So, assume minimum wage is $5 per hour, so, 15 minutes
is equivalent to $1.25 – put a tax of $1.25 and achieve social optimum –
internalizing the externility
58
Positive Spillovers
A person’s private benefits from undertaking activities with positive
spillovers are less than society’s marginal benefits from such activities.
As the number of Unix users rises, the better it will be to purchase such a
computer.
The system will have fewer bugs because more users will have detected those
that exist, more application software will be available, and more experts will
be available to help with any problems that arise.
60
Positive Spillovers
61
Positive Spillovers
current population has only a small number of Unix users -
Left of I -
each individual user finds it better to choose Windows
62
Positive feedback and lock-in
Production is more profitable the higher the level of demand in the
economy, which happens when national income is higher.
In turn, income is higher when firms are producing more and are
therefore hiring more workers.
64
The Case of Easter Island
Renowned for its massive stone faces that stoically gaze over the Pacific, the
moai statues, carved by the native Rapanui half a millennium ago [if
interested NatGeo documentary [Link]
65
The Case of Easter Island
This thriving island civilization of perhaps 10,000–15,000 inhabitants once
survived on cultivation of sweet potatoes, yams, bananas, domesticated
chickens and fishing.
Trees and timber had been vital to the ancient Rapanui. Trees prevented soil
erosion and provided a native habitat for birds and animals important for
supplementing the local diet. Wood provided raw materials for hand tools,
logs used in the erection of the moai statues, fuel for warmth during cool
and rainy nights, and most importantly, for constructing fishing canoes
66
The Case of Easter Island
Careful study by archaeologists of the ancient Rapanui’s rubbish dumps has
shown that by the time island forests began to disappear around 1500, fish
likewise began to disappear from diet of natives.
Large trees, once used for canoe-making, had vanished. Crop yields began to
fall from soil erosion, so that nuts, apples, and other wild fruits dwindled as a
food source. Lacking a natural habitat, native birds and animals became
extinct on the island.
By 18th century, the Rapanui were reduced to feeding on rodents and, later,
to cannibalism
67
Environment, Development and Collective
Action
Since Easter Island receives only 50 inches of rainfall per year (scanty
by tropical standards), trees grow slowly, leaving the island’s
inhabitants more vulnerable to the “tragedy of the commons”
68
Environment, Development and Collective
Action
However, in the initial phases of economic development, significant
degradation of the environment can occur as population pressure and
modern technology induce society to sacrifice natural resources and
environmental quality for higher income.
This pattern occurs regularly across most parts of the developing world.
69
Environment, Development and Collective
Action
A rich society becomes increasingly eager to pay for a clean environment,
and it begins to demand that the state take a leading institutional role in
natural resource regulation and protection.
70
Environment, Development and Collective
Action
The depth of the environmental plunge in the intermediate phases of
development depends on the health of local institutions that exist to
govern the environmental commons.
71
Environment, Development and Collective
Action
The outcome in the real world, resulting from the interplay of these different
human and environmental factors, is far from straight forward.
72
CPRs
Focus on the use (and abuse) of environmental resources such as forests,
water, fisheries, and grazing lands.
74
CPRs and Tragedy of Commons
The combination of rivalry and non-excludability is what creates the
individual incentive to exploit a common-pool resource for
personal gain, collectively leading to a Pareto inefficient outcome
for society – often called the “tragedy of the commons.”
Zeke and Deke story – Zeke offers Deke a deal: He will never plunder
the lake if Deke never plunders, but if Deke ever does, Zeke will
plunder in response for n days thereafter
81
The top-down approach
What happens when CPR use involves a large number of parties with
short-term interests in resource exploitation?
83
Self Governance
The primary problem with top-down CPR regulation, especially in
developing countries, is nearly always the monitoring problem: It is
often too costly for the state to hire enough monitors to catch
violators often enough such that plundering the commons doesn’t pay.
84
Self Governance
Let, e be the cost of monitoring shared by the two players
Thus sometimes the CPR dilemma can be resolved if one Big Player
exists with a lot to lose if everything falls apart (Leadership)
The Big Player may have an incentive to shoulder the entire burden of
solving the CPR dilemma for the entire group
86
Exploitation of the strong by the weak
87
Herd Behavior and the Commons
In the real world, the incentives that affect how people relate to the
natural environment are in a significant way shaped by the behavior of
others
In many instances the tragedy of the commons may not always be best
represented as a Prisoners’ Dilemma, but as a Coordination game,
where the incentives to Conserve depend on how many others
Conserve
88
Herd Behavior and the Commons
A sense of social norms changing the internal psychological costs to
players from engaging in behavior contrary to the common good
Assume the payoff to Conserve is constant at 10, but that the payoff to
Plunder declines as the number of Conserving players increases, so
that the payoff to Plunder is, say, equal to 17 –2n
89
Herd Behavior and the Commons
Here the leader can convince a critical mass of CPR users that
sustainable practices will be followed, the resource use settles into the
Pareto efficient Nash equilibrium of Conservation
90
Assignment Rules in CPR Usage
Consider the example of a fishery with a number of discrete fishing
spots, where some of the spots are more alluring than others from the
perspective of a fish.
Even if there are an equal number of fishers as fishing spots, fights are
likely to break out over who gets the best spot, and who is stuck with
the worst.
91
Assignment Rules in CPR Usage
The fisherman who wants the best spot the most, will be willing to pay
the highest price to secure it.
92
Assignment Rules in CPR Usage
Suppose that there are two desirable fishing spots on the lake of our
Appalachian fishermen, but of the two best spots, the fishing spot “on
top of the Granite Rock” enjoys a higher yield than the spot “near the
Mud Hole.”
93
Assignment Rules in CPR Usage
If both fight over the Granite Rock they split the high yield, kG
If both fight over the Mud Hole they split the low yield, kM
Note (kG > kM)
Option 1: kM > ½ kG
Option 2: kM < ½ kG
94
Privatization of Rights over CPRs
Because ambiguities and conflicts sometimes remain with informal
assignment rules over a natural resource, in some instances the state
has encouraged privatization of CPRs.
95
Privatization of Rights over CPRs
Second, many economists advocate privatization of resources on
Pareto efficiency grounds – Coase Theorem – Pareto efficiency in
resource use can be achieved if private property rights over the
resource can be created and if bargaining between parties is costless
Two villages share use of a river. The first village, Alto, lies upstream,
and Alto residents use the river to bathe and wash their clothes (using
soap). The unfortunate downstream village, Bajo, tries to use the river
to fish, despite declining levels of fish in the sudsy water.
Suppose the value to Alto of using the river for washing is X, the value
to Bajo of fishing in a clean river is Y, and the cost to Alto of using a
pollution-free soap is Z
96
Privatization of Rights over CPRs
If Y is greater than either X or Z, then no matter which village starts
out with river rights, the Coase Theorem says that the two villages will
end up with a pollution-free outcome.
For example, if rights over the river are given to Alto, then Bajo can
pay Alto X or Z (whichever is less) to eliminate the pollution, and Bajo
ends up better off while Alto is no worse off. If Bajo has river rights,
Alto is forced to pay the lesser of X and Z to clean up its act.
98
Privatization of Rights over CPRs
Even if the multinational has been granted property rights to pollute,
it may be impossible for local residents to purchase rights to the lake
from the multinational if they are extremely poor – even if lake
pollution results in a tremendous local welfare loss for them.
99
References
100