Black Mirror Nosedive: Social Credit & Rating Systems Explored

Surveillance capitalism is a rogue economic logic where companies unilaterally claim private human experience as free raw material. Through computational factories powered by AI, they extract predictive behavioral signals from user data—linguistic patterns, facial expressions, and online activities—to create products that predict and influence behavior. This model began with Google and Facebook but has now spread throughout the entire economy, including insurance, education, healthcare, and manufacturing. The system operates through hidden supply chains where companies sell behavioral insights to business customers, creating products that enhance corporate control over populations.

Shoshana Zuboff defines 'surveillance capitalism' as beginning with the unilateral claim on human experience—private lives, conversations, and behaviors become free raw material. When users access free services, they provide 'excess behavioral' data (dwell times, routes, speed) processed through machine intelligence to create prediction products. This explains phenomena like products appearing across websites after brief searches. The system creates unprecedented knowledge asymmetry: corporations know everything about individuals while individuals know nothing about corporations. The goal is not just prediction but modeling future behavior to guarantee profits, exploiting vulnerabilities like eating disorder histories by serving targeted advertisements.

Surveillance capitalism is an economic system where major technology companies like Google and Facebook collect vast amounts of personal behavioral data from users' online activities, then use sophisticated algorithms to predict and manipulate human behavior for profit, effectively treating users as raw material (minerals) rather than autonomous individuals, thereby undermining genuine human agency and free will.

Surveillance capitalism is a new dominant mode of production where companies like Google and Facebook extract vast amounts of behavioral data from users (called 'data exhaust' or 'digital breadcrumbs') to create predictive models about human behavior, which are then sold to advertisers as 'behavioral futures,' fundamentally transforming users from customers into raw materials for profit generation through behavioral prediction and modification.

In modern work, emotions have become commodified. Workers must display certain emotions (like friendliness, enthusiasm) as part of their job, even when these emotions don't naturally arise. This represents a fundamental change in the nature of work where inner states become external performances. The book argues that this represents a regression to pre-Reformation conditions where external authority controlled inner life, as workers lose the freedom of authentic self-expression.

Affective or emotional labor refers to the management of one's feelings and expressions based on the emotional requirements of a job, where workers must induce or suppress feelings to sustain outward appearances that produce proper emotional states in others; this form of labor is fundamentally gendered, as emotion and emotionality are culturally constructed as women's natural domain, making emotional labor primarily performed by women across service jobs, care work, and intimate industries, which raises important questions about rights, agency, and exploitation in the commodification of care and intimacy.

Marx analyzed romantic love as one of capitalism's emotional devices, examining how it operates within bourgeois family structures where jealousy treats love as private property. Mid-20th century capitalism destabilized Marx's distinction between use value and exchange value, as advertisers recognized goods must possess emotional value. Contemporary capitalism constructs consumers as emotional beings and makes consumption itself an emotional act, creating emotional commodities. Arlie Hochschild's research on flight attendants revealed emotional labor as value extraction: workers perform somatic work processing emotions according to company rules, creating affective dissonance when suppressing actual feelings. This demonstrates how emotional labor constitutes unpaid labor that brings profits, extending exploitation beyond traditional physical labor into affective dimensions.

The globalization of affect refers to the phenomenon where women from developing countries migrate to wealthy nations to work as caregivers, creating 'worldwide chains of affection' where their emotional labor—originally meant for their own children—is redirected toward the children and elderly of their employers; this process operates through mechanisms of emotional displacement (Freud) and fetishization of care (Marx), generating what Giddens calls 'emotional plusvalía' where the first world imports not just labor but also affection, while the third world exports both workers and their emotional capacities, resulting in significant psychological costs for all parties involved.

Intimacy is 'a fantastic space where most of us reveal ourselves or are terrified to reveal ourselves.' In intimate relationships, so much is revealed about race, power, and how we lie to ourselves. Affective labor or emotional labor is one of the primary extracts of exploitation in society. Women do enormous amounts of affective labor - carrying the nervous systems of others. Immigration is 'profoundly racialized' and part of why societies demand gratitude from immigrants is because they want them to do affective labor. The speaker connects this to the enslavement period where enslaved women had enormous affective labor to perform, noting this continues today. In situations where communities lack parity of power, there can be no real affective relationships.

The EU is moving fastest in platform governance with two key legislations: (1) Digital Market Act (DMA) - competition policy targeting 'gatekeepers' (large platforms) with sweeping powers for a European digital commissioner and penalties up to 10% of global revenue; (2) Digital Services Act (DSA) - content policy harmonizing takedown mechanisms across Europe with European Commission enforcement. The EU AI Act demonstrates differential regulation for different AI use cases (banned, high-risk, low-risk). These acts have their own life and play out over time, as seen with GDPR court rulings years later changing platform operations.

Biometrics—facial images, fingerprints, DNA profiles—are seen as perfect standardized identity because they're unique, permanent, and irreversible. The EU AI Act addresses three high-risk categories: remote biometric identification (RBI), biometric categorization, and emotion recognition. RBI creates chilling effects—citizens adjust behavior knowing persistent monitoring, staying home from protests fearing digital logs could harm prospects. Regulatory gaps exist between real-time and retroactive searching—both enable vast detailed profiles of movements and associations. Algorithmic bias emerges from non-diverse training data, causing higher misidentification rates for non-white individuals and wrongful arrests. Biometric categorization attempts assigning ethnic origin or political orientation from physical data—scientifically dubious and ethically problematic. Exemptions for systems like SIS, EuroDAC, and VIS create blind spots prioritizing administrative legibility over democratic oversight.

The EU has established two landmark regulations—the Digital Services Act (DSA) and Artificial Intelligence Act (AI Act)—to govern the digital economy. The DSA creates safer, fairer, and more transparent online environments by regulating intermediary service providers including transmission services, caching services, hosting services (online platforms and marketplaces), and search engines. Platforms with over 45 million EU users face amplified scrutiny. The AI Act is the world's first comprehensive AI regulation, applying to any entity using AI systems in the EU regardless of size, with extraterritorial scope. AI systems are categorized into prohibited (social scoring, exploitation), high-risk (biometric identification, law enforcement), limited-risk (chatbots, emotion recognition), and low-risk categories. The Cambridge Analytica scandal demonstrates how AI misuse can cause societal harm, illustrating the need for these regulations.

Algorithmic governance serves two purposes: making policymaker work easier and addressing European regulatory priorities. According to Agrawal, Goldfarb, and Benkler (2022), decision-making confers power through prediction (algorithms) and judgment (policymakers). Katzenbach and Ulbricht (2019) define algorithmic governance as coordination between actors based on rules, including unintentional coordination. Two diverging narratives exist: dystopian (governance becomes intrusive like Skynet) and utopian (governance becomes more inclusive). The Hague Center for Digital Governance claims algorithms improve efficiency but warn of increased biases. Privacy concerns persist, particularly regarding digital interactions. Citizen trust in companies and governments forms the foundation of effectiveness. The 2021 European Tech Insights survey shows 57% believe AI brings meaningful jobs, yet most believe AI needs legal limits. The term 'gouvernance algorithmique' appeared in 2009, with 2013 discussions framing it as coordination mechanisms versus social governance. Tim O'Reilly (2013) argued algorithmic governance provides efficiency through 0 and 1 systems without nuances. Morozov (2014) warned about delegating controversial issues to algorithms, potentially allowing politicians to 'wash their hands' of responsibility. The EU Artificial Intelligence Act categorizes AI into three risk levels: safe applications, high-risk applications (like biased CV ranking tools), and unacceptable risks (like governmental social scoring).

The three major EU digital regulation themes are: (1) Surveillance capitalism - the power of major platforms (Google, Apple, Facebook, Amazon, Microsoft) over users' digital lives, affecting privacy, employment, and union organizing; (2) Digital Services Act and Digital Markets Act - proposals to reform platform governance, content moderation, and competition law to curb dominant tech companies; (3) Facial recognition and biometric data - concerns about mass surveillance systems being implemented across EU member states, threatening privacy and civil liberties.