Feb 12th 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir

Sam Ben-Meir is professor of philosophy and world religions at Mercy Collage in New York.

 

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity. 

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019) that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”   

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1749. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”  

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.” 

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized. 

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018). 

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation. 

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.” 

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.” 

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.” 

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.” 

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers. 

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.   

 

 

Browse articles by author

More Essays

Oct 9th 2019
EXTRACT: "The idea that we are living in an entrepreneurial age, experiencing rapid disruptive technological innovation on a scale amounting to a new “industrial revolution” is a pervasive modern myth. Scholars have written academic papers extolling the coming of the “entrepreneurial economy”. Policymakers and investors have pumped massive amounts of funding into start-up ecosystems and innovation. Business schools, universities and schools have moved entrepreneurship into their core curricula. The only problem is that the West’s golden entrepreneurial and innovation age is behind it. Since the 1980s entrepreneurship, innovation and, more generally, business dynamics, have been steadily declining – particularly so in the US. "
Aug 28th 2019
EXTRACT: ". But today, the impulse to gain attention on social media has produced a discourse of extreme defamation and scorched-earth tactics aimed at destroying one’s opponents. We desperately need a broad-based movement to stand up against this type of political discourse. American history is replete with examples of people who worked together to solve – or at least defuse – serious problems, often against great odds and at significant personal risk. But the gradual demise of fact-based history in schools seems to have deprived many Americans of the common ground and optimism needed to work through challenges in the same way they once did."
Aug 8th 2019
Consider the following facts as you wend your way to the Guggenheim Museum and its uppermost gallery, where you will presently find The Death of Michael Stewart (1983), Basquiat’s gut-punching tribute to a slain artist, and the centerpiece for an exhibition that could hardly be more timely.
Jul 22nd 2019
It’s worth remembering, then, that we are not designed to be consistently happy. Instead, we are designed to survive and reproduce. These are difficult tasks, so we are meant to struggle and strive, seek gratification and safety, fight off threats and avoid pain. The model of competing emotions offered by coexisting pleasure and pain fits our reality much better than the unachievable bliss that the happiness industry is trying to sell us. In fact, pretending that any degree of pain is abnormal or pathological will only foster feelings of inadequacy and frustration. Postulating that there is no such thing as happiness may appear to be a purely negative message, but the silver lining, the consolation, is the knowledge that dissatisfaction is not a personal failure. If you are unhappy at times, this is not a shortcoming that demands urgent repair, as the happiness gurus would have it. Far from it. This fluctuation is, in fact, what makes you human.
Jul 10th 2019

 

The eight-mile ‘river of flowers’ that grows alongside a motorway nea
Jul 5th 2019
"........since World War II, 97% of unimproved grassland habitats have vanished from the UK. This has contributed to the loss of pollinating insects – and the distribution of one third of species has shrunk since 1980."
Jun 25th 2019
"For many of us, eating a meal containing meat is a normal part of daily life. But if we dig deeper, some sobering issues emerge. Every year, 66 billion terrestrial animals are slaughtered for food. Predictions are that meat consumption will rise, with increasing demand for meat from China and other Asian countries as their standards of living increase. The impact of grazing animals on the environment is devastating. They produce 18% of the world’s greenhouse gases, and livestock farming is a major contributor to species extinctions."
Jun 22nd 2019
"Throughout history, people who have gained positions of power tend to be precisely the kind of people who should not be entrusted with it. A desire for power often correlates with negative personality traits: selfishness, greed and a lack of empathy. And the people who have the strongest desire for power tend to be the most ruthless and lacking in compassion."
Jun 21st 2019
"In this era of Trump, it should perhaps come as no surprise to find supposed experts lacking in historical perspective. Yet it is still disappointing to find this deficit in the New York Times, which prides itself on clinging to a pursuit of the truth. So it is a bit sad to read the plaintive cry of Allison Schrager’s op-ed of May 17, lamenting that the domination of art markets by the super-rich will somehow force smaller galleries to go out of business, and imperil the careers of young artists."
Jun 17th 2019
Extract: "ust as an earlier generation resisted the limiting post-War era "white middle class" definition of being American by giving birth to an awakening of cultural pluralism and ethnic pride, it falls to our generation to fight for an expanded view of the idea of being American that rejects the narrow view projected by Trump and white nationalists. The idea of America isn't theirs. It's bigger than they are and unless our national cohesion is to unravel, this challenge must be met by projecting an inclusive vision of America that celebrates our inclusive national identity in an increasingly globalized world."
May 28th 2019
Whatever other attributes Homo sapiens may have – and much is made of our opposable thumbs, upright walking and big brains – our capacity to impact the environment far and wide is perhaps unprecedented in all of life’s history. If nothing else, we humans can make an almighty mess.
Apr 29th 2019
A century ago, unspeakable horrors took place on every continent that were known only to the victims and the perpetrators. Not so today. As a result of advances in communications – from the telegraph and radio to satellite television and the internet – the pain and loss of global tragedies are brought home to us in real time.   Because of this expanding consciousness, the post-World War II era has witnessed the rise of visionary leaders and the birth of countless organizations dedicated to alleviating suffering and elevating the causes of peace, human rights, and tolerance among peoples. Individually and collectively, they have championed the rights of peoples in far-flung corners of the world, some of which had been previously unknown to those who became their advocates. These same leaders and groups have also fought for civil rights and for economic, social, political, and environmental justice in their own countries. 
Apr 23rd 2019

 

“Cursed be that mortal inter-indebtedness which will not do away with ledgers. I would be free as air; and I’m down in the whole world’s books. I am so rich… and yet I owe for the flesh in the tongue I brag with” (Moby Dick, chapter cviii). 

Apr 20th 2019
Economists speak in numbers only, clinging to statistical data and quantitative models. We do so in the hope of looking objective. But this is counter-productive – “data” cannot tell us everything. Other social sciences such as sociology and anthropology use a broader range of methods, and consequently have a broader perspective on society. If we take our societal role of adviser on economic matters seriously, we will need to open up and adopt the insights that these other disciplines bring us about how the economy works.Politics and economics are inextricably intertwined, as Adam Smith, David Ricardo, Karl Marx knew all too well. Somehow this has been forgotten. This does not mean economists need to get political or choose sides. But it does mean that we ignore politics at our own peril – by blindsiding ourselves or dismissing it as “external stuff”, we hamper our understanding of the very system we study.
Apr 16th 2019
Although it is not likely that many visitors who pass by the Giacometti sculptures on their way to Las Meninas will ponder it, the contrast between these works underscores the single greatest transformation in the history of western art, from a regime in which artists tailored their works to the aims of individual patrons, to one in which artists choose their techniques and motifs according to their own concerns, and only then present the products to an anonymous competitive market
Apr 4th 2019
On March eleventh, the world lost someone who was very special, who made a mark and touched people with his voice, as a singer, a humorist and writer..........I had the great good fortune to know him and spend time with him, playing music, talking with him – he was a man of immense culture, fluent in Hebrew, German, English, and Romanian. He loved New York City and Vienna and we would often swap apartments so that he could stay in New York while I lived at his place in Vienna.
Apr 1st 2019
The ongoing controversy over admissions to American universities has overlooked the one of the most telling aspects of the scandal—that it took place with the connivance and active participation of administrative bureaucracies able to act with impunity in the pursuit of their interests. Neither the professoriate, often the target of opprobrium from the left and the right, nor the student body, also the target of criticism from both sides of the political spectrum, bore any of the responsibility.  Current debates over “what ails” U.S. colleges and universities consistently ignore the single most important dynamic of all institutions—their structure of power. I suggest that the way in which power is allocated within American universities is strikingly similar to that of Soviet-type regimes. Presidents, chancellors, provosts, deans, and their bureaucratic apparatuses preside over vast real-estate and financial holdings, engage in the economic equivalent of central planning, have inordinate influence over personnel, and are structured hierarchically, thereby forming an enormously powerful “new class” like that described by the renowned Yugoslav dissident, Milovan Djilas, in the mid-1950s. 
Mar 22nd 2019
When you think of religion, you probably think of a god who rewards the good and punishes the wicked. But the idea of morally concerned gods is by no means universal. Social scientists have long known that small-scale traditional societies – the kind missionaries used to dismiss as “pagan” – envisaged a spirit world that cared little about the morality of human behaviour. Their concern was less about whether humans behaved nicely towards one another and more about whether they carried out their obligations to the spirits and displayed suitable deference to them. Nevertheless, the world religions we know today, and their myriad variants, either demand belief in all-seeing punitive deities or at least postulate some kind of broader mechanism – such as karma – for rewarding the virtuous and punishing the wicked. In recent years, researchers have debated how and why these moralising religions came into being.
Mar 19th 2019
European food and ingredients have become staple food choices for the British. The use of ingredients such as garlic, peppers, avocados, Parmesan cheese and all those other European ingredients that are now taken for granted are relatively new and were still rare in the 1990s. When I was growing up in rural Devon in the 1970s, olive oil was only really readily available in chemists as a cure for earache – now it is found in most food cupboards. And wine drinking has permeated through all social classes.