Feb 12th 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir


Sam Ben-Meir is an assistant adjunct professor of philosophy at City University of New York, College of Technology.

 

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity. 

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019) that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”   

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1749. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”  

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.” 

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized. 

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018). 

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation. 

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.” 

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.” 

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.” 

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.” 

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers. 

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.   

 

 

Browse articles by author

More Essays

Sep 11th 2023
EXTRACT: "Many people have dipped their toe into the lazy gardener’s life through “no mow May” – a national campaign to encourage people not to mow their lawns until the end of May. But you could opt to extend this practice until much later in the summer for even greater benefits. Allowing your grass to grow longer, and interspersing it with pollen-rich flowers, can benefit many insects – especially bees. Research finds that reducing mowing in urban and suburban environments has a positive effect on the amount and diversity of insects. Your untamed lawn won’t only benefit insects. It will also encourage more birds, such as goldfinches, to use your garden to feed on the seeds of common wildflower species such as dandelions."
Aug 30th 2023
EXTRACT: "Eliot remarked that Shakespeare's greatness not only grew as the writer aged, but that his development became more apparent to the reader as he himself aged: 'No reader of Shakespeare... can fail to recognize, increasingly as he himself grows up, the gradual ripening of Shakespeare's mind.' "
Aug 25th 2023
EXTRACTS: "I moved here 15 years ago from London because it was so safe. Bordeaux was then known as La Belle au Bois Dormant (The Sleeping Beauty). It's the wine capital of France and the site of beautiful 18th century architecture arrayed along the Garonne river." ---- "What’s new is that today lawlessness is spreading into the more comfortable neighborhoods. The favorite technique is to defraud elderly retirees by dressing up as policemen, waterworks inspectors or gas meter readers. False badges including a photo ID are easy to fabricate on a computer printer. Once inside, they scoop up most anything shiny as they tip-toe through the house."
Aug 20th 2023
EXTRACT: "The 1953 coup d'etat in Iran ushered in a period of exploitation and oppression that has continued – despite a subsequent revolution that led to huge changes – for 70 years. Each year on August 19, the anniversary of the coup, millions of Iranians ask themselves what would have happened if the US and UK had not conspired all those years ago to overthrow Iran’s democratically elected leader."
Aug 18th 2023
EXTRACT: "Edmundo Bacci: Energy and Light, curated by Chiara Bertola, and currently on view at the Peggy Guggenheim Collection in Venice, is the first retrospective of the artist in several decades. Bacci was a native of Venice, a city with a long and illustrious history of painting, going back to Giorgione and Titian, Veronese and Tiepolo. As a painter, he was thoroughly immersed in this great past – as an artist he was determined to transform and remake that tradition in the face of modernity and its vicissitudes, what he called “the expressive crisis of our time.” That he has slipped into obscurity affords us, at the very least, an opportunity to see Bacci’s work essentially for the first time, without the burden of over-determined interpretations or categories."
Aug 12th 2023
EXTRACT: "Is Oppenheimer a movie for our time, reminding us of the tensions, dangers and conflicts of the old Cold War while a new one threatens to break out? The film certainly chimes with today’s big power conflicts (the US and China), renewed concern about nuclear weapons (Russia’s threats over Ukraine), and current ideological tensions between democratic and autocratic systems. But the Cold War did not just rest on the threat of the bomb. Behind the scientists and generals were many other players, among them the economists, who clashed just as vigorously in their views about how to run postwar economies."
Aug 5th 2023
EXTRACT: "I have a modest claim to make: we need Bruno today more than ever. This is because he represents an intellectual antidote to the prevailing ideology of today which tells us that we are doomed to finitude, which comes down politically to the assertion that there is no alternative to the reign of global capitalism. Of course, Bruno did not know about capitalism, globalization or neoliberalism. What he did know however is that humanity is infinite. That we are limited only by our own narrowness of vision."
Jul 26th 2023
EXTRACT: "We studied 55,000 people’s dietary data and linked what they ate or drank to five key measures: greenhouse gas emissions, land use, water use, water pollution and biodiversity loss. Our results are now published in Nature Food. We found that vegans have just 30% of the dietary environmental impact of high-meat eaters. The dietary data came from a major study into cancer and nutrition that has been tracking the same people (about 57,000 in total across the UK) for more than two decades."
Jul 26th 2023
EXTRACT: "Art historians have never understood economics, and as a result they believe they can ignore markets: in their view, the production of art can be treated in isolation from its sale.  This is of course disastrously wrong.  But their ignorance has led to a neglect of the economic history of art. "
Jul 13th 2023
EXTRACT: ".....art purchases and prices have plateaued. The prevailing mood at this year’s Art Basel was one of anxiety, as dealers roamed the halls searching for answers. Some speculate that the state of the art market indicates declining confidence among the world’s richest people. When the economy is booming, collectors are more inclined to invest in art and take on leverage, especially when borrowing costs are low. But these dynamics can shift quickly during downturns. The 2008 crisis, for example, caused art prices to fall by 60%."
Jul 13th 2023
EXTRACT: "But even if you’re having trouble motivating yourself to exercise, many types of physical activity may be helpful as long as you do them regularly. For example, walking, gardening and household chores (such as cooking, hoovering and dusting) may prevent symptoms worsening and improve quality of life. And, these activities may be easier to incorporate into your daily routine than a gym workout."
Jul 12th 2023
EXTRACTS: "Insect populations are declining worldwide at a rate of almost 1% per year. This decline is alarming. Insects play a crucial role in pollinating crops, controlling crop pests and maintaining soil fertility. In the UK alone, pollination provided by bees and other insects adds over £600 million to crop production every year. That’s about 10% of the country’s total annual crop value. Through pollination, insects also make sure that fruit and vegetables are packed full of the vitamins and minerals needed for healthy human diets. Insufficient pollination would result in lower-quality foods, less choice and higher food prices." .... "Just like fertiliser and water, these insects should be considered a legitimate agricultural input that needs to be protected and managed sustainably."
Jul 6th 2023
EXTRACT: "But whatever the truth may turn out to be, the Lindemann affair raises a question that has been hotly debated over the past few years, especially in the United States, but more and more in Europe, too: must art be judged by the private behavior of its creator? It has become fairly common for critics to denounce Pablo Picasso’s paintings because he made women in his life suffer. A well-known movie critic declared that he could no longer view Woody Allen’s films in the same way after the director was accused, without any evidence, of abusing his seven-year-old adoptive daughter. Roman Polanski’s movies are no longer distributed in the US, because he drugged and raped a 13-year-old girl in 1977."
Jun 25th 2023
EXTRACT: "There’s a great deal of research showing that people with negative personality traits, such as narcissism, ruthlessness, amorality or a lack of empathy and conscience, are attracted to high-status roles, including politics. In a representative democracy, therefore, the people who put themselves forward as representatives include a sizeable proportion of people with disordered personalities – people who crave power because of their malevolent traits. And the most disordered and malevolent personalities –the most ruthless and amoral – tend to rise to the highest positions in any political party, and in any government. This is the phenomenon of “pathocracy”, which I discuss at length in my new book DisConnected."
Jun 11th 2023
EXTRACT: "Although there’s still much we don’t know about flavanols – such as why they have the effect they do on so many aspects of our health – it’s clear from the research we do have that they are very likely beneficial to both memory and heart health."
May 4th 2023
EXTRACT: "My recent book on them 25 Unforgettable French Faces covers a wide range of individuals, from an aging Brigitte Bardot to architect Gustave Eiffel. Both of them changed the face of France. In the upcoming sequel, 25 More Unforgettable French Faces, I have completed my collection of 50 examples. The new book, now in progress, ranges from The Bad Boy of the 18th Century (Voltaire) to A Man of Principle (Jean-Paul Sartre) and Big Dark Eyes, (the actress Audrey Tautou)."
May 4th 2023
EXTRACT: "Silicon solar cells are an established technology for the generation of electricity from the sun. But they take a lot of energy to produce, are rigid and can be fragile. However, a new class of solar cell is matching their performance. And what’s more, it can now be printed out using special inks and wrapped flexibly around uneven surfaces."
Apr 21st 2023
EXTRACT: "You learn from your mistakes. At least, most of us have been told so. But science shows that we often fail to learn from past errors. Instead, we are likely to keep repeating the same mistakes." .... "Sometimes we stick with certain behaviour patterns, and repeat our mistakes because of an “ego effect” that compels us to stick with our existing beliefs. We are likely to selectively choose the information structures and feedback that help us protect our egos." ..... "....there are simpler things we can do. One is to become more comfortable with making mistakes. We might think that this is the wrong attitude towards failures, but it is in fact a more positive way forward."
Mar 17th 2023
EXTRACTS: "The intensifying concentration of wealth, and unjustifiable level of income inequality is proving disastrous in many ways. Here are just a few of them. First, less equal societies typically have more unstable economies, and this country is no exception." --- "Second, there is an incontrovertible link between economic inequality and violent crime. The fact is that rates of violence are higher in more unequal societies." --- "Third, the undeniable fact is that the greater the economic inequality that exists, the worse it is for general health outcomes. What is sometimes overlooked is that income inequality is bad for health outcomes across economic strata, not just for those in poverty. To be sure, poor health and poverty are closely linked; but the epidemiological research shows that high levels of economic inequality “negatively affect the health of even the affluent, mainly because… inequality reduces social cohesion, a dynamic that leads to more stress, fear, and insecurity for everyone.” People live longer in countries with lower levels of inequality, as the World Bank reports. In the United States, for example, “average life expectancy is four years shorter than in some of the most equitable countries.” "
Mar 10th 2023
EDITOR: "Quantum mechanics, the theory which rules the microworld of atoms and particles, certainly has the X factor. Unlike many other areas of physics, it is bizarre and counter-intuitive, which makes it dazzling and intriguing. When the 2022 Nobel prize in physics was awarded to Alain Aspect, John Clauser and Anton Zeilinger for research shedding light on quantum mechanics, it sparked excitement and discussion. But debates about quantum mechanics – be they on chat forums, in the media or in science fiction – can often get muddled thanks to a number of persistent myths and misconceptions. Here are four."