The Prisoner's Dilemma: Game Theory & Rational Decision-Making

The iterated prisoner's dilemma is a repeated version of the classic game where players interact multiple times, fundamentally changing outcomes compared to the one-shot version; in this repeated context, the tit-for-tat strategy—cooperating on the first move and then mirroring the opponent's previous action—proves evolutionarily stable because it can invade populations of defectors while maintaining cooperation with other cooperators, demonstrating that cooperation can evolve when individuals interact repeatedly with the same neighbors.

The Iterated Prisoner's Dilemma is a repeated version of the Prisoner's Dilemma where players can condition their actions on past behavior. The video explains that strategies like Tit-for-Tat (cooperate first, then copy the opponent's previous move) can sustain cooperation in repeated games. The video demonstrates how Tit-for-Tat works: if the opponent cooperates, you cooperate; if they defect, you defect in the next round. This strategy is forgiving, competitive, and can lead to mutually beneficial outcomes in repeated interactions.

Several key strategies have been developed for the Iterated Prisoner's Dilemma: (1) Tit-for-Tat: Cooperate first, then copy the opponent's previous move. Simple but highly effective. (2) Defect-First (Méchante): Always defect. Exploits naive cooperators but loses against other defectors. (3) Tit-for-Tat variants: Tit-for-Tat-2 (retaliates twice for each defection), Tit-for-Tat-3 (retaliates three times), etc. (4) Gradual: Gradually increases retaliation for repeated defection. (5) Majority: Cooperates if opponent cooperated more than defected in history. (6) Tit-for-Tat-2: Retaliates twice for each defection. (7) Tit-for-Tat-3: Retaliates three times for each defection. (8) Tit-for-Tat-4: Retaliates four times for each defection. (9) Tit-for-Tat-5: Retaliates five times for each defection. (10) Tit-for-Tat-6: Retaliates six times for each defection. (11) Tit-for-Tat-7: Retaliates seven times for each defection. (12) Tit-for-Tat-8: Retaliates eight times for each defection.

The Prisoner's Dilemma appears everywhere in nature and human society. Impalas grooming each other face the same dilemma: grooming costs vital resources but provides essential tick removal. If impalas only interact once, rationality dictates defection. However, since they interact repeatedly, this changes the problem. In 1980, Robert Axelrod held a computer tournament inviting game theorists to submit strategies. Each strategy played 200 rounds against every other strategy. The simplest program won: Tit for Tat, which starts by cooperating and then copies the opponent's last move. This strategy succeeded because it could cooperate with nice strategies while punishing nasty ones, demonstrating that cooperation can emerge through repeated interactions.

Rapoport's entry 'Tit-for-Tat' won a computer tournament in the 1980s based on Robert Axelrod's work on the evolution of cooperation. The program, which only required four lines of code, operated on simple rules: it opened by cooperating, then mirrored the opponent's previous move (cooperating if the opponent cooperated, defecting if the opponent defected), but only defected for one game. This strategy proved exceptionally effective at promoting cooperation by rewarding cooperative behavior and punishing selfish behavior, demonstrating how simple reciprocal strategies can foster cooperation in repeated interactions.

The Prisoner's Dilemma framework applies to many real-world situations: ad wars where firms spend millions on TV ads that cancel each other out; OPEC member countries trying to act as a cartel but frequently breaking agreements; arms races between military superpowers where both would be better off disarming but each has incentive to arm; and common resources like oceans where overuse by individuals leads to depletion. In each case, self-interest prevents cooperation even when mutual cooperation would be better for all parties.

The Prisoner's Dilemma applies to arms races where both nations produce weapons, increasing costs for both. In negative political campaigns, both candidates attack each other, reducing voter participation. These examples demonstrate how individual incentives to compete lead to collectively worse outcomes. The equilibrium outcome in oligopoly is worse for society than if firms had cooperated: higher prices, lower production, and reduced consumer welfare. This represents a fundamental tension between individual rationality and collective welfare in competitive markets.

The Prisoner's Dilemma explains numerous real-world phenomena: (1) Arms races—nations build weapons because if neighbors don't, they gain advantage; if neighbors do, they must follow, wasting resources on education and healthcare. (2) Market competition—companies like Apple and Samsung continue expensive marketing because stopping while competitors advertise means losing market share. (3) Roommate chores—each person free-rides on the other, resulting in no one cleaning. (4) Public goods—people litter because others do, creating collective harm. (5) Sports doping—athletes use performance enhancers not because they want to, but because they fear others will cheat. Solutions require binding agreements, transparency, enforcement mechanisms, or changing payoff structures to align individual incentives with collective welfare.

The tragedy of the commons describes how shared resources get depleted when individuals act in self-interest without regulation. Using a public fishing lake as an example, each fisherman thinks 'if I don't fish more, someone else will,' leading to overfishing and resource exhaustion. This concept applies to all public goods, including free cakes, schools, and hospitals. When goods appear free, demand becomes infinite, causing overuse and quality deterioration. The solution is privatization, where owners have incentives to preserve resources for long-term use. The São Mateus cake incident demonstrates this principle: without pricing or ownership, people rush to consume before others, destroying the resource entirely.

The tragedy of the commons is a situation where individuals acting in their own self-interest deplete or spoil shared resources through collective action, as first described by British economist William Forster Lloyd in 1833; this phenomenon can be addressed through three main solutions: social norms (established traditions and mutual agreements), privatization (giving owners incentives to ensure sustainability), and state regulation (implementing rules like fishing quotas and pollution taxes); for complex global problems like ocean plastic pollution, a combination of all three approaches is typically needed.

Social dilemmas can be solved through institutions and social norms. Institutions (like laws and regulations) can enforce cooperation by punishing defectors. Social norms (shared expectations about behavior) can encourage cooperation by making selfish behavior socially unacceptable. The speaker argues that effective solutions to social dilemmas require both institutional and normative approaches working together.

Social dilemmas—situations where individual rationality conflicts with collective rationality—can be resolved through several mechanisms. Binding agreements are most effective in modern market economies, where legal frameworks enforce compliance. Peer punishment allows group members to penalize free-riders, working well in smaller communities. Social preferences and reciprocity naturally encourage cooperation in close-knit groups. For problems with many players and complex coordination needs like climate change, binding international agreements are necessary but difficult to achieve due to the large number of participants and varying national interests. Effective solutions require mechanisms that align individual incentives with collective goals.

Empirical studies show that binding rules can effectively solve social dilemmas. In the case of mask wearing during the pandemic, studies showed that before mask mandates, very few people wore masks in public places. After mandates were introduced, mask wearing rates increased to 80-90%. This demonstrates that when individual rationality leads to suboptimal outcomes, binding rules that change incentives can achieve better collective outcomes. The key insight is that people respond to incentives, and changing the incentive structure can align individual and collective interests.

Institutional arrangements describe regulations, agreements, and punishment systems that help solve social dilemmas. These include: (1) Household agreements between couples about sharing tasks, such as one person bringing out garbage while another cleans dishes; (2) Coaches in sports teams who determine tactics to prevent every player from trying to score individually; (3) Control mechanisms to prevent bribery payments; (4) International organizations like the UN that try to restrict each country's CO2 emissions. While institutional arrangements help solve social dilemmas, there is no single solution (silver bullet), and some people will always cooperate while others do not.

Social norms often emerge because of underlying social dilemmas—tensions between what individuals would do selfishly and what benefits the collective. When such tensions exist, social norms provide the necessary push to behave in socially appropriate ways. Without social norms, people would simply follow descriptive norms (imitating others) which might not align with collective welfare. This explains why social norms often include punishment or reward mechanisms to enforce compliance.