Feb 21st 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir


Sam Ben-Meir is an assistant adjunct professor of philosophy at City University of New York, College of Technology.

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity.

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019), that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1849. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.”

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized.

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018).

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation.

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.”

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.”

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.”

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.”

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers.

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.



Sam Ben-Meir is a professor of philosophy and world religions at Mercy College in New York City.
 

 

Browse articles by author

More Current Affairs

Aug 20th 2023
EXTRACT: "Since the end of World War II, the United Nations has been the cornerstone of the international rules-based order. While numerous other international agreements address issues such as chemical weapons, biological warfare, and regional stability, the UN has been entrusted with the overarching role of maintaining global peace and stability. What made it effective, at least for a while, was the support of the world’s liberal democracies and, crucially, the unwavering commitment of both Democratic and Republican administrations in the United States." ---- "That all changed with the Bush administration’s decision to invade Iraq, a sovereign country, in the face of fierce international opposition and without the UN Security Council’s approval. In doing so, the US severely damaged its own credibility and undermined the global rules-based system,... "Many of America’s current domestic political divisions grew out of the Iraq War. Whereas presidents like Franklin Roosevelt, Harry Truman, and Dwight Eisenhower demonstrated that effective leaders can make the world a safer and better place, even in the face of great adversity, Bush’s presidency showed that the opposite is equally true."
Aug 20th 2023
EXTRACTS: "a period of parliamentary history between 1719 and 1772 called 'the age of liberty'. This marked the end of autocratic monarchy and the beginning of an era of parliamentary power " ---- "This was a period of large-scale legislative projects and freedom of speech became central to the idea of freedom from tyranny. The most important piece of legislation was the Freedom of the Press Act of 1766, a law that aimed to protect freedom of information as a means of promoting democracy. It has been amended since but its tenets remain the same. " ---- "Describing Muslims, to allude to the situation of the Qur’an burnings, as criminals would be criminal. But to burn the Qur’an is in itself not, according to the current formulation of the law, an attack on Muslims. It is rather seen as an attack on the religion of Islam. Such attacks are not illegal because the aim of the attack is not directed against a protected group of people but against a belief – an idea. That is not illegal."
Aug 18th 2023
EXTRACTS: "But if the dollar should lose its privileged place, what could replace it? At present, the euro, which accounts for 20% of global central-bank reserves, is the only currency that could realistically serve as a substitute. Its appeal, however, is undermined by the fragmentation of Europe’s national sovereign-debt markets, as well as lingering doubts about the European Union’s long-term viability in the wake of the UK’s departure.'" ---- "The Chinese renminbi, which accounts for less than 3% of global reserves, is not a serious threat to dollar hegemony. "
Aug 12th 2023
EXTRACT: "Around the world, supply is struggling to keep up with demand. Inflation remains stubbornly high, despite aggressive interest-rate hikes. The global workforce is aging rapidly. Labor shortages are ubiquitous and persistent. These are just some of the forces behind the productivity challenge facing the global economy. And it has become increasingly clear that we must harness artificial intelligence to address that challenge."
Aug 2nd 2023
EXTRACTS: "What explains the tenacity of Trump’s support? The force of his arguments is unlikely to be the key, because he makes few coherent arguments." ---- "The Trumpist bubble is deeply mired in pessimism. Some 89% of the GOP think the US is in steep decline, ...." ---- "There are several reasons for popular anxiety. Many American industrial workers feel left behind in a global economy where cheaper labor is sought overseas." --- "Trump has been a master at manipulating these conspiratorial anxieties," ---- "What is perhaps most important is that Trump, despite his success in stacking the Supreme Court with religious radicals, has not captured most of the elites, as Hitler did. "
Jul 19th 2023
EXTRACTS: "Little wonder then that Crimea has been heavily militarised since Russia’s illegal annexation of the peninsula in March 2014 – or that Russian troops there have increasingly been threatened by different anti-Putin partisan groups. These include both Russian volunteers and indigenous Crimean Tatars who have become more active since the start of the Ukrainian counteroffensive."
Jul 19th 2023
EXTRACT: "Prigozhin’s fighters would not have been able to travel almost a thousand kilometers (621 miles) within Russian territory in less than a day without help from members of Putin’s inner circle or the military. Rumors are swirling that the billionaire brothers Yuri and Mikhail Kovalchuk may have played a role. The Kovalchuks, close associates of Putin, reportedly share Prigozhin’s belief that Russia has not been forceful enough in the war or in its broader confrontation with the West. Another possible collaborator is General Sergei Surovikin. Like Prigozhin, Surovikin has reportedly advocated a far more brutal war effort than Defense Minister Sergei Shoigu seems willing to conduct. Since the mutiny, he has not been seen in public, and is said to be “resting.” "
Jul 19th 2023
EXTRACTS:" While Western experts continue to view Russia as a modern state, they overlook the fact that Putin’s cronies, who represent the mingling of the security services – particularly the FSB, the successor to the Soviet-era KGB – and organized crime, control most state functions as their private domains." .... "The existence of multiple private armies will make these power games more destabilizing. As a commentator on RIA Novosti, Russia’s official news agency, put it after documenting the private armies of several oil companies: “[W]e are on the verge of a major increase in corporate and other paramilitary structures, as well as major changes in the very approach to the use of military force.” Against this backdrop, the Russian army has become another gang vying for power and property. But as the Kremlin’s grip on power slips, Russia’s generals will likely organize a putsch against Putin and his KGB/FSB cronies – the army’s historical rival."
Jul 16th 2023
EXTRACTS: "The fuel inside nuclear reactors needs continuous, active cooling for many months after a reactor shutdown" ..... "The world saw in dramatic fashion in Fukushima, Japan, in 2011 what can happen when continuous, active cooling of nuclear reactors is disrupted. More than 70% of the total radioactivity at the Fukushima power plant was in the spent fuel ponds" .... "In his classic 1981 book Nuclear Radiation in Warfare, Nobel Peace Prize-winning physicist Joseph Rotblat documented how 'in a pressurised water reactor, the meltdown of the core could occur within less than one minute after the loss of coolant'. The radioactivity released from damaged spent fuel ponds could be even greater than from a meltdown at the reactor itself, he wrote. His study makes clear that a military attack on a reactor or spent fuel pond could release more radioactivity – and longer-lasting radioactivity – than even a large (megaton range) nuclear weapon."
Jul 6th 2023
EXTRACT: "The closer we get to the endgame, the greater the risk that the Kremlin will resort to some irrational act like ordering the use of a nuclear weapon. Prigozhin’s revolt offers a preview of the chaos that awaits. Almost anything is conceivable now, from the disintegration of the Russian Federation to the rise of another ultra-nationalist regime with neo-czarist dreams of imperial restoration. Like Putin’s Russia, this one would remain locked in the past, far removed from any prospect of social, political, or economic modernization. It would pose a permanent threat to Europe’s eastern flank, and to global stability more broadly. We will have to arm ourselves against it, and our grandchildren and great-grandchildren will most likely have to do the same."
Jun 27th 2023
EXTRACT: "So, who might seize the throne? Two obvious possibilities are Nikolai Patrushev, the secretary of Russia’s Security Council, and his son Dmitry, the minister of agriculture. Another is Prime Minister Mikhail Mishustin, who deliberately appeared on television hard at work during the crisis, while Putin reportedly flew to safety in Valdai, far from the Kremlin. Then there is Dyumin, as well as Moscow’s Mayor Sergei Sobyanin, who controls his own powerful armed force."
Jun 25th 2023
EXTRACT: "......because Prigozhin and his men enjoy the supportof many Russians. For them, Prigozhin is a hero, not a traitor, because he is one of the only public figures who dares to speak the truth about the Kremlin’s incompetent management of the war. And they also see in him a fatherly commander standing up for the soldiers whose lives are being thrown away needlessly by Putin’s clumsy, corrupt generals. People who think this way may well make up a very large part of Russian society. Whether Prigozhin ultimately is imprisoned, executed, or victorious, he will remain an icon for them."
Jun 25th 2023
EXTRACT: "While it might be tempting to conclude that the gut microbes identified as being associated with signs of preclinical Alzheimer’s are also contributing to developing the disease, the study does not provide any evidence of a cause-and-effect relationship. However, if a connection can be established, it opens up an exciting possibility that future treatments for Alzheimer’s might target the microbes in our gut."
Jun 18th 2023
EXTRACT: "When it comes to sustainability, however, US fiscal policy receives a low score. Amid the short-term fluctuations, it is often easy to lose sight of the long-term trajectory. Public debt, as a share of GDP, peaked at the end of World War II and then gradually declined until the Reagan tax cuts of the 1980s, which led to record deficits. Since then, the debt-to-GDP ratio has steadily risen, almost reaching its 1946 record in 2020. Only during the period 1996-2000, under President Bill Clinton, did this trend temporarily reverse."
Jun 14th 2023
EXTRACT: "It is by no means clear that the latest banking crisis has run its course. There are concerns about the so-called shadow banking system, largely unregulated financial institutions that now make up half of all global financial assets. For example, in the US many people invest in money market funds, which pay higher interest than banks, but provide no deposit insurance."
Jun 9th 2023
EXTRACT: "Given the scale of the ECB’s bond holdings, however, its approach to quantitative tightening (QT) seems downright homeopathic. At the current rate, bringing the asset-purchase program to zero will take roughly 15 years (and this does not even account for the fact that the ECB continues to reinvest all maturing assets purchased under the Pandemic Emergency Purchase Program). "
Jun 9th 2023
EXTRACT: "Hardly a week goes by without various pioneers in artificial intelligence issuing dire warnings about the technology that they introduced to the world." ---- " I have my doubts. Since the start of my professional life in the 1980s (and of course for much longer), technological progress has repeatedly been held up as a major threat to jobs in key industries such as automobile manufacturing. Yet...."
May 31st 2023
EXTRACT: "In discussions about the implications of artificial intelligence (AI), someone almost always evokes the ancient Greek myth of Pandora’s box. In the modern fairytale version of the story, Pandora is depicted as a tragically curious young woman who opens a sealed urn and inadvertently releases eternal misery on humankind. Like the genie that has escaped the bottle, the horse that has fled the barn, and the train that has left the station, the myth has become a cliché. And yet the actual story of Pandora is far more apropos to debates about AI and machine learning than many realize. What it shows is that it is better to listen to “Prometheans” who are concerned about humanity’s future than “Epimetheans” who are easily dazzled by the prospect of short-term gains. One of the oldest Greek myths, the story of Pandora was first recorded more than 2,500 years ago, in the time of Homer. In the original telling, Pandora was not some innocent girl who succumbed to the temptation to open a forbidden jar. Rather, as the poet Hesiod tells us, Pandora was “made, not born.” Having been commissioned by all-powerful Zeus and designed to his cruel specifications by Hephaestus, the god of invention, Pandora was a lifelike android created to look like a bewitching maiden. Her purpose was to entrap mortals as a manifestation of kalos kakon: “evil hidden in beauty.”
May 31st 2023
EXTRACT: "Specifically, many believe that the arrival of artificial general intelligence (AGI) – an AI that can teach itself to perform any cognitive task that humans can do – will pose an existential threat to humanity. A carelessly designed AGI (or one governed by unknown “black box” processes) could carry out its tasks in ways that compromise fundamental elements of our humanity. After that, what it means to be human could come to be mediated by AGI."
May 29th 2023
EXTRACT: "In his 2018 book Destined For War, political scientist Graham Allison observes that the US and China are headed toward what he called the “Thucydides’ Trap,” a reference to the ancient Greek historian’s account of Sparta’s efforts to suppress the rise of Athens, which ultimately culminated in the Peloponnesian War. A better analogy, however, is the message sent by the Athenians to the inhabitants of the besieged island of Melos before executing the men and enslaving the women and children: “The strong do what they can and the weak suffer what they must." ---- Allowing China and other authoritarian countries to shape the rules would result in a world order based solely on this “realist” principle. It is a nightmare scenario that the G7 countries and other liberal democracies must strive to prevent. ---- China’s assertions about the decline of the West reveal an underlying anxiety. After all, if liberal democracy is failing, why do Chinese officials consistently express their fear of it? The fact that leaders of the Communist Party of China have instructed rank-and-file members to engage in an “intense struggle” against liberal-democratic values indicates that they view open societies as an existential threat."