Feb 12th 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir


Sam Ben-Meir is an assistant adjunct professor of philosophy at City University of New York, College of Technology.

 

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity. 

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019) that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”   

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1749. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”  

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.” 

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized. 

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018). 

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation. 

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.” 

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.” 

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.” 

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.” 

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers. 

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.   

 

 

Browse articles by author

More Essays

Nov 26th 2018
There is now good evidence that the risks versus benefits of alcohol are strongly influenced by the type of alcohol and the way it is drunk.
Nov 14th 2018
Jean Gabin - pictured below by the author of this book review Michael Johnson - lives on vibrantly through international film festivals, art houses and television reruns although he died in Paris 42 years ago. Just last week in prime time I watched one of his classic films, “Pépé le Moko”, a story of considerable depth that pops up regularly on television. American author Joseph Harriss rightly calls it “Casablanca for grownups”. Other classics abound – “La Grande Illusion”, “Le Quai des Brumes” “Touchez pas au grisbi”, for example. 
Nov 13th 2018
Over the last ten years, research has demonstrated the importance of creative practice in the arts and humanities. They can help maintain health, provide ways of breaking down social barriers and expressing and understanding experiences and emotions, and assist in developing trust, identities, shared understanding and more compassionate communities. So, hopefully, this sidelining of the arts in health terms is changing.
Nov 13th 2018
I am here to sing Will Kemp’s [in the picture below] praises and review this new e-book because I have been studying with Will since January 2016, long distance but close in heart—Will lives in Britain and I live in the States.
Nov 2nd 2018
Writing is such hard work that those of us who dabble in prose often dread looking at the “white bull” – Hemingway’s term for a blank sheet of paper waiting to be filled up with our words. Will we defeat the bull today? It’s always a tossup. The stress and strain of writing perhaps explains why so many writers seek an outlet in the visual arts, particularly painting and sculpture. Visual output satisfies the hunger to create, and, as a bonus, the art form is more free and spontaneous. Great writers have produced great paintings. Look at Victor Hugo, Guillaume Apollinaire, Rudyard Kipling, Dante Gabriel Rossetti. Even more interesting to me is the somewhat lesser phenomenon of pianists who paint. They are seeking the same release, the same soulagement, the same need to liberate themselves. 
Nov 1st 2018
Modern life does have many benefits, but when it persuades us to use transport, sit in a chair at work, or watch TV for extended periods, we increasingly have to turn to medicine for solutions because these habits are killing hundreds of millions of us each year. With 70% of people in the US on prescription drugs (50% in the UK), it seems that as lifespan inches upwards, disease is skyrocketing. The irony is that many advances in modern medicine are firefighting those very problems that modern life itself has created.
Oct 30th 2018
It’s important to note that all studies, including our own, only show an association between the herpes virus and Alzheimer’s – they don’t prove that the virus is an actual cause. Probably the only way to prove that a microbe is a cause of a disease is to show that an occurrence of the disease is greatly reduced either by targeting the microbe with a specific anti-microbial agent or by specific vaccination against the microbe. Excitingly, successful prevention of Alzheimer’s disease by use of specific anti-herpes agents has now been demonstrated in a large-scale population study in Taiwan. Hopefully, information in other countries, if available, will yield similar results.
Oct 18th 2018
Leaving a major political body is nothing new for mainland Britain. In 409AD, more than 350 years after the Roman conquest of 43AD, the island slipped from the control of the Roman Empire. Much like the present Brexit, the process of this secession and its practical impacts on Britain’s population in the early years of the 5th century remain ill-defined. As with the UK and Brussels, Britain had always been a mixed blessing for Rome. In around 415AD, St Jerome called the island “fertile in tyrants” (meaning usurpers) and late Roman writers portrayed a succession of rebellions in Britain, usually instigated by the army – many of whom would have been born in the province.
Oct 16th 2018
One of the oldest Greek myths, the story of Pandora was first recorded more than 2,500 years ago, in the time of Homer. In the original telling, Pandora was not some innocent girl who succumbed to the temptation to open a forbidden jar......Pandora was deliberately devised to punish humankind for accepting the gift of fire from Prometheus. Essentially a seductive AI fembot, she had no parents, childhood memories, or emotions of any kind, nor would she ever age or die. She was programmed to carry out one malevolent mission: to insinuate herself in an earthly setting and then unseal the jar......With AI/machine learning quickly evolving into a “black box” technology, the symbol of Pandora’s sealed jar has taken on new meaning.
Oct 11th 2018
The Scottish National Gallery in Edinburgh is currently exhibiting a substantial selection of Rembrandt’s paintings, drawings, and prints – focusing on those works that reveal the story of “Britain’s Discovery of the Master.” Exploring the significance of Rembrandt to British collectors, artists, and writers provides us with the occasion to revisit some fifteen major oil paintings.....
Oct 10th 2018
On the fiftieth anniversary of Nicolas Garcia Uriburu’s first coloration, Buenos Aires’ National Museum of Fine Arts pays tribute to the landmark early accomplishment of its native son..........Uriburu’s role as an early environmentalist has never been appreciated outside of his native country. It is sad that this neglect was not remedied in his lifetime, but at least it should be done now; a full-scale retrospective of his pioneering work should be presented in the art world’s capitals, to inspire young artists.
Oct 2nd 2018
The 2018 Nobel Prize in Physiology or Medicine has been awarded to two immunologists for their revolutionary approaches to treat cancer. James Allison, based in the MD Anderson Cancer Center in Houston, Texas, and Tasuku Honjo, based at Kyoto University in Japan, led exciting and groundbreaking work on developing new types of immunotherapy that help our immune system fight cancer.
Sep 20th 2018
We all want other people to “get us” and appreciate us for who we really are. In striving to achieve such relationships, we typically assume that there is a “real me”. But how do we actually know who we are? It may seem simple – we are a product of our life experiences, which we can be easily accessed through our memories of the past. Indeed, substantial research has shown that memories shape a person’s identity......................But it turns out that identity is often not a truthful representation of who we are anyway – even if we have an intact memory. Research shows that we don’t actually access and use all available memories when creating personal narratives. It is becoming increasingly clear that, at any given moment, we unawarely tend to choose and pick what to remember.
Sep 20th 2018
The research, published in the Canadian Medical Association Journal, compared how much mothers reported using cleaning products with the rate of obesity in 757 children at the age of three. Faecal samples were taken from the infants at three to four-months-old and the researchers investigated associations between microbial changes and being overweight at age three. The researchers found a link between heavy use of cleaning products, microbial changes and children with a higher body mass index (BMI). However, higher disinfectant usage was also reported among households with infants who received antibiotics around the time of birth; who were exposed to cigarette smoke; or were delivered by caesarean section. The results may therefore reflect several interlinking factors. Obesity was less likely to occur in breastfed children, but breastfeeding was also linked to lower disinfectant usage, which makes it difficult to tease apart these two factors.
Sep 11th 2018
If there’s a story that unites success in Silicon Valley and the new economy that’s given us iPhones and Uber, it’s that geek innovators are rewarded. Engineer the killer app and the cash will roll in. Big brains mean a big pay day. It may be a new economy, but this is a very old mistake. The idea that those at the top of a business are the ones who should be celebrated makes little sense to anyone who actually works in an organisation like Tesla. They might be the ones who make the headlines, but it’s the ordinary employees who do the work and produce the value.
Aug 15th 2018
The ability to reverse ageing is something many people would hope to see in their lifetime. This is still a long way from reality, but in our latest experiment, we have reversed the ageing of human cells, which could provide the basis for future anti-degeneration drugs.
Aug 14th 2018
We all like to think of ourselves as morally sound individuals. However in doing so we often assume that morality is static – that we are consistently moral to some extent over time. In reality, research suggests that most of us will behave in contradictory ways and act both morally and immorally from time to time. Interestingly, when we think about our past moral actions, we are likely to engage engage in compensatory behaviour and act immorally going forward.
Aug 8th 2018
This year marks the hundredth anniversary since the death of Gustav Klimt (1862-1918) and Egon Schiele (1890-1918), two of Austria’s greatest artists. That same year, 1918, also saw the end of the Austro-Hungarian Empire following its defeat in World War I – the end, that is, of an entire era, of a world. Fin de siècle Vienna was a place of extraordinary innovation – in music (with Arnold Schoenberg and the Second Viennese School), in literature (with Modernists such as Robert Musil and Herman Broch), in science (with Sigmund Freud and the development of psychoanalysis), and, of course, the visual arts, with the founding of the Vienna Secession in 1897, whose first president was Gustav Klimt. In Vienna, the rupture caused by the war was total: the city became the archetype of “a doomed society, in which brilliant achievements glowed in the gathering twilight.”
Jul 24th 2018
A decade ago, as the scale of the disaster in Iraq began to sink in, American historians often compared the United States to ancient Rome. Both seemed to suffer from an imperial disease whose symptoms began with overreach and ended in collapse. This is a useful way for Americans like me to consider our troubles abroad. But when it comes to our democracy’s problems at home, the closer parallel is with 18th century Britain, the “mother country” from which the United States broke away in 1776. Britons of that time enjoyed many liberties unknown to their favourite bogeymen, the French. These freedoms had many roots, including the Magna Carta of 1215, the Bill of Rights from 1689 and various parts of English common law. Most Britons saw their country as God’s favourite and thanked their “Constitution” — a general term for established forms of law and government — for their rising glory. Yet for all the liberties it tolerated, that Constitution’s real goal was to shield wealth and privilege from popular demands.
Jul 17th 2018
There are two ways of tackling chronic lifestyle diseases such as cancer, heart disease and diabetes: discover new drugs and treatments or persuade people to make positive lifestyle changes to avoid developing them in the first place. Health coaching is one of the most powerful ways of changing people’s mindsets for the long term. Practitioners are rapidly taking their place alongside executive coaches, life coaches and personal trainers as another means of making us better people through one-to-one improvement sessions.