Feb 12th 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir

Sam Ben-Meir is professor of philosophy and world religions at Mercy Collage in New York.

 

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity. 

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019) that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”   

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1749. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”  

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.” 

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized. 

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018). 

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation. 

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.” 

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.” 

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.” 

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.” 

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers. 

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.   

 

 

Browse articles by author

More Essays

Nov 27th 2019
EXTRACT: "Jay Willis at GQ reports that Secretary of Energy Rick Perry said on Fox and Friends that Trump is God’s Chosen One. He said he told Trump, “If you’re a believing Christian, you understand God’s plan for the people who rule and judge over us on this planet and our government.” Perry also said that he had written a memo for Trump about how God uses imperfect people, comparing Trump to biblical figures such as Solomon, Saul and David, who were also flawed. This evangelical discourse that a providential God controls political power goes back to old West Semitic Religion"
Nov 7th 2019
Extract: "The PSA test is done using a small amount of blood to detect raised levels of prostate specific antigen (PSA). Yet, despite its relatively low cost and ease of administering, it is not offered for routine screening in many countries, including the UK. This is because a significant proportion of those testing positive have no disease (a false-positive result), slow-growing cancer that doesn’t need treatment, or positive results caused by a relatively benign condition, such as a urinary tract infection. Detecting prostate cancer early is important and saves lives. But many of those identified by the PSA test as having elevated levels of the antigen could potentially undergo painful treatment with significant life-altering side effects, which were unnecessary. Also, up to 15% of men with prostate cancer have normal PSA levels (a false-negative result), meaning that many men would receive unwarranted reassurance from this test. Guidelines in most countries, therefore, note that the possible benefits of testing are outweighed by the potential harms of over-diagnosis and over-treatment, making it unsuitable for screening everyone."
Nov 5th 2019
Extract: "Ken Loach’s film, Sorry We Missed You, tells the harrowing tale of Ricky, Abby and their family’s attempts to get by in a precarious world of low paid jobs and the so-called “gig economy”. But how realistic is it? Can Loach’s film be accused of undue pessimism?"
Nov 3rd 2019
Extract: "Travel to Prague, Kyiv, or Bucharest today and you will find glittering shopping malls filled with imported consumer goods: perfumes from France, fashion from Italy, and wristwatches from Switzerland. At the local Cineplex, urbane young citizens queue for the latest Marvel blockbuster movie. They stare at sleek iPhones, perhaps planning their next holiday to Paris, Goa, or Buenos Aires. The city center hums with cafés and bars catering to foreigners and local elites who buy gourmet groceries at massive hypermarkets. Compared to the scarcity and insularity of the communist past, Central and Eastern Europe today is brimming with new opportunities.......In these same cities, however, pensioners and the poor struggle to afford the most basic amenities. Older citizens choose between heat, medicine, and food. In rural areas, some families have returned to subsistence agriculture."
Nov 3rd 2019
EXTRACTS: "Genetic clustering has existed in all past societies. People have typically been relatively genetically similar to others nearby. But most of this was because of limited mobility."........."But in the 19th and 20th centuries, people started to move about more. Societies opened up geographically, and socially. This new mobility has created a new kind of clustering – what the American author Thomas Friedman called a “great sorting out”.".........".....this is now visible at the genetic level too."
Oct 9th 2019
EXTRACT: "The idea that we are living in an entrepreneurial age, experiencing rapid disruptive technological innovation on a scale amounting to a new “industrial revolution” is a pervasive modern myth. Scholars have written academic papers extolling the coming of the “entrepreneurial economy”. Policymakers and investors have pumped massive amounts of funding into start-up ecosystems and innovation. Business schools, universities and schools have moved entrepreneurship into their core curricula. The only problem is that the West’s golden entrepreneurial and innovation age is behind it. Since the 1980s entrepreneurship, innovation and, more generally, business dynamics, have been steadily declining – particularly so in the US. "
Aug 28th 2019
EXTRACT: ". But today, the impulse to gain attention on social media has produced a discourse of extreme defamation and scorched-earth tactics aimed at destroying one’s opponents. We desperately need a broad-based movement to stand up against this type of political discourse. American history is replete with examples of people who worked together to solve – or at least defuse – serious problems, often against great odds and at significant personal risk. But the gradual demise of fact-based history in schools seems to have deprived many Americans of the common ground and optimism needed to work through challenges in the same way they once did."
Aug 8th 2019
Consider the following facts as you wend your way to the Guggenheim Museum and its uppermost gallery, where you will presently find The Death of Michael Stewart (1983), Basquiat’s gut-punching tribute to a slain artist, and the centerpiece for an exhibition that could hardly be more timely.
Jul 22nd 2019
It’s worth remembering, then, that we are not designed to be consistently happy. Instead, we are designed to survive and reproduce. These are difficult tasks, so we are meant to struggle and strive, seek gratification and safety, fight off threats and avoid pain. The model of competing emotions offered by coexisting pleasure and pain fits our reality much better than the unachievable bliss that the happiness industry is trying to sell us. In fact, pretending that any degree of pain is abnormal or pathological will only foster feelings of inadequacy and frustration. Postulating that there is no such thing as happiness may appear to be a purely negative message, but the silver lining, the consolation, is the knowledge that dissatisfaction is not a personal failure. If you are unhappy at times, this is not a shortcoming that demands urgent repair, as the happiness gurus would have it. Far from it. This fluctuation is, in fact, what makes you human.
Jul 10th 2019

 

The eight-mile ‘river of flowers’ that grows alongside a motorway nea
Jul 5th 2019
"........since World War II, 97% of unimproved grassland habitats have vanished from the UK. This has contributed to the loss of pollinating insects – and the distribution of one third of species has shrunk since 1980."
Jun 25th 2019
"For many of us, eating a meal containing meat is a normal part of daily life. But if we dig deeper, some sobering issues emerge. Every year, 66 billion terrestrial animals are slaughtered for food. Predictions are that meat consumption will rise, with increasing demand for meat from China and other Asian countries as their standards of living increase. The impact of grazing animals on the environment is devastating. They produce 18% of the world’s greenhouse gases, and livestock farming is a major contributor to species extinctions."
Jun 22nd 2019
"Throughout history, people who have gained positions of power tend to be precisely the kind of people who should not be entrusted with it. A desire for power often correlates with negative personality traits: selfishness, greed and a lack of empathy. And the people who have the strongest desire for power tend to be the most ruthless and lacking in compassion."
Jun 21st 2019
"In this era of Trump, it should perhaps come as no surprise to find supposed experts lacking in historical perspective. Yet it is still disappointing to find this deficit in the New York Times, which prides itself on clinging to a pursuit of the truth. So it is a bit sad to read the plaintive cry of Allison Schrager’s op-ed of May 17, lamenting that the domination of art markets by the super-rich will somehow force smaller galleries to go out of business, and imperil the careers of young artists."
Jun 17th 2019
Extract: "ust as an earlier generation resisted the limiting post-War era "white middle class" definition of being American by giving birth to an awakening of cultural pluralism and ethnic pride, it falls to our generation to fight for an expanded view of the idea of being American that rejects the narrow view projected by Trump and white nationalists. The idea of America isn't theirs. It's bigger than they are and unless our national cohesion is to unravel, this challenge must be met by projecting an inclusive vision of America that celebrates our inclusive national identity in an increasingly globalized world."
May 28th 2019
Whatever other attributes Homo sapiens may have – and much is made of our opposable thumbs, upright walking and big brains – our capacity to impact the environment far and wide is perhaps unprecedented in all of life’s history. If nothing else, we humans can make an almighty mess.
Apr 29th 2019
A century ago, unspeakable horrors took place on every continent that were known only to the victims and the perpetrators. Not so today. As a result of advances in communications – from the telegraph and radio to satellite television and the internet – the pain and loss of global tragedies are brought home to us in real time.   Because of this expanding consciousness, the post-World War II era has witnessed the rise of visionary leaders and the birth of countless organizations dedicated to alleviating suffering and elevating the causes of peace, human rights, and tolerance among peoples. Individually and collectively, they have championed the rights of peoples in far-flung corners of the world, some of which had been previously unknown to those who became their advocates. These same leaders and groups have also fought for civil rights and for economic, social, political, and environmental justice in their own countries. 
Apr 23rd 2019

 

“Cursed be that mortal inter-indebtedness which will not do away with ledgers. I would be free as air; and I’m down in the whole world’s books. I am so rich… and yet I owe for the flesh in the tongue I brag with” (Moby Dick, chapter cviii). 

Apr 20th 2019
Economists speak in numbers only, clinging to statistical data and quantitative models. We do so in the hope of looking objective. But this is counter-productive – “data” cannot tell us everything. Other social sciences such as sociology and anthropology use a broader range of methods, and consequently have a broader perspective on society. If we take our societal role of adviser on economic matters seriously, we will need to open up and adopt the insights that these other disciplines bring us about how the economy works.Politics and economics are inextricably intertwined, as Adam Smith, David Ricardo, Karl Marx knew all too well. Somehow this has been forgotten. This does not mean economists need to get political or choose sides. But it does mean that we ignore politics at our own peril – by blindsiding ourselves or dismissing it as “external stuff”, we hamper our understanding of the very system we study.