Feb 12th 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir

Sam Ben-Meir is professor of philosophy and world religions at Mercy Collage in New York.

 

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity. 

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019) that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”   

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1749. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”  

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.” 

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized. 

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018). 

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation. 

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.” 

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.” 

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.” 

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.” 

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers. 

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.   

 

 

Browse articles by author

More Essays

Nov 19th 2021
EXTRACTS: "At a time when the struggle between authoritarianism and democracy is so intense, if not fateful for the future of democracies, NATO and the EU must warn these countries [Editor's note: Poland and Hungary, EU and NATO, Turkey NATO] that they are on the precipice of being kicked out if they do not change their governing practice. They must be required to restore the principles of democracy by upholding universal human rights and abiding the rule of law, or else they will forfeit their membership and suffer from the consequences of their crimes." ------ "A narcissistic leader, such as Trump, whose hunger for power seems to know no limit, has happily sacrificed the good of the country on the altar of his twisted ego. America’s democracy cannot be repaired unless he and those who helped him are held accountable and face the weight of the law."
Nov 18th 2021
EXTRACT: "Many people who go through intense trauma, for example, become deeper and stronger than they were before. They may even undergo a sudden and radical transformation that makes life more meaningful and fulfilling. Indeed, research shows that between half and one-third of all people experience significant personal development after traumatic events, such as bereavement, serious illness, accidents or divorce. Over time, they may feel a new sense of inner strength and confidence and gratitude for life and other people. They may develop more intimate and authentic relationships and have a wider perspective, with a clear sense of what is important in life and what isn’t. In psychology, this is referred to as “post-traumatic growth”. "
Nov 11th 2021
EXTRACT: "Notably, Murdoch thinks that really knowing or understanding another person is a difficult task: “It is a task to come to see the world as it is”. According to the Freudian psychology Murdoch subscribes to in The Sovereignty of Good, humans are prone to “fantasy” – refusing to face the truth because it can damage our fragile egos."
Nov 9th 2021
EXTRACT: "People do not believe false information because they are ignorant. There are many factors at work, but most researchers would agree that the belief in misinformation has little to do with the amount of knowledge a person possesses. Misinformation is a prime example of motivated reasoning. People tend to arrive at the conclusions they want to reach as long as they can construct seemingly reasonable justifications for these outcomes."
Oct 28th 2021
EXTRACTS: "Brood with me on the latest delay of the full release of the records pertaining to the murder of President John F. Kennedy in Dallas on November 22, 1963. That was 58 years ago." -----"Mark my words: ...... No one who remembers 1963 will live to see the US government admit the full truth about Kennedy’s murder. And the American people’s faith in democracy will continue to fade. There is only one way to prevent this, and that is to release every record, withholding nothing – and to do it now."
Oct 27th 2021
EXTRACT: "..... we may defy the warnings of modern medicine, convinced of our own superiority. Researchers at the University of Chicago Divinity School reported half of their participants, all of whom indicated some religious affiliation, agreed with the statement “God will protect me from being infected”. To cope with our dread of death, we delude ourselves into thinking we are invincible: death might happen to other people, but not to me."
Oct 22nd 2021
EXTRACT: "Wes Anderson’s new film The French Dispatch is about the final issue of a magazine that specialises in long-form articles about the goings-on in the fictional town of Ennui-sur-Blasé. The film is an anthology of shorts representing three of the articles. A piece by the magazine’s art critic (Tilda Swinton) explores the life and late success of the abstract artist Moses Rosenthaler (Benicio Del Toro). Talented from a young age, Rosenthaler pursued art with a dogged determination that drove him to slowly lose his mind." ---- "Like everything else, mental illness is understood within the context of its time. In their study of melancholy and genius Born Under Saturn, the art historians Margot and Rudolf Wittkower show how Renaissance artists embraced mental alienation. This was shown by a withdrawn, slothful gloom. Such heavy sadness was considered both the symptom and the price of divine inspiration." ---- "Today, the association of creativity and mental illness often implies regression from an adult and orderly state of mind to one that is primal, impulsive, or infantile. The artist in Anderson’s film is such an example: he is noisy, impetuous, and extravagantly mad. And it is while he is at his “maddest” that he paints his best work." ---- "Here I explore the work of four painters whose work has been shaped by various mental illnesses, highlighting how the idea of the “mad artist” need not be tied up with a loss of control but rather a bid to gain it."
Oct 21st 2021
EXTRACT: "So much of Succession holds a mirror to real life, and the way that Logan Roy’s hand-picked board members allowed these abuses to continue by turning a blind eye to them is a good example. We have just published research that shows that public companies whose directors are chosen by their CEOs are statistically more likely to be involved in corporate misconduct, along with various other shortcomings. So why does this happen, and what should be done about it? "
Oct 10th 2021
EXTRACT: "Born in Zanzibar in 1948, Gurnah came to Britain in the 1960s as a refugee. Being of Arab origin, he was forced to flee his birthplace during the revolution of 1964 and only returned in 1984 in time to visit his dying father. Until his retirement, he was a full-time professor of English and postcolonial literatures at the University of Kent in Canterbury."
Oct 7th 2021
EXTRACT: "As the 25th James Bond film No Time to Die hits the cinemas, we are once again reminded of the way that disability is depicted negatively in Hollywood films. The new James Bond film features three villains, all of who have facial disfigurements (Blofeld, Safin and Primo). If you take a closer look at James Bond villains throughout history, the majority have facial disfigurements or physical impairments. This is in sharp contrast to the other characters, including James Bond, who are able-bodied and presented with no physical bodily differences. Indeed, many films still rely on outdated disability tropes, including Star Wars and various Disney classics. Rather than simply being part of a character’s identity, the physical difference is exploited and exaggerated to become a plot point and visual metaphor for villains" ----- "The British Film Institute (BFI) was the first organisation to sign up and has committed to stop funding films that feature negative representations depicted through scars or facial differences – a step in the right direction."
Oct 5th 2021
EXTRACT: "The trillions of microbes inside of our gut play many very important roles in our body. Not only does this “microbiome” regulate our metabolism and help us absorb nutrients from food into the body, it can also influence whether we are lean or obese."
Sep 16th 2021
EXTRACTS: "Hyperbaric oxygen therapy involves breathing pure oxygen in a pressurised chamber. In the chamber, the air pressure is increased two to three times higher than normal air pressure. It is commonly used to treat decompression sickness (a condition scuba divers can suffer from), carbon monoxide poisoning,......" ---- "Blood flow to the brain is reduced in people with Alzheimer’s. This study showed increased blood flow to the brain in the mice receiving oxygen therapy, which helps with the clearance of plaques from the brain, and reduces inflammation – a hallmark of Alzheimer’s." ----- "The researchers then used these findings to assess the effectiveness of oxygen therapy in six people over the age of 65 with cognitive decline. They found that 60 sessions of oxygen therapy, over 90 days, increased blood flow in certain areas of the brain and significantly improved the patients’ cognitive abilities – improved memory, attention and information processing speed."
Sep 14th 2021
EXTRACT: "Hollywood for years called on Charles Boyer to typify one French look –  bedroom eyes, sly maneuverings, the dismissive look. A face of another type, the massive mug and narrow eyes of Charles de Gaulle, provides the same disdain of the foreigner but also a superiority based on his belief in his own destiny."
Sep 12th 2021
EXTRACT: "The burden of loneliness for older people is intimately connected to what they are alone with. As we reach the end of our lives, we frequently carry heavy burdens that have accumulated along the way, such as feelings of regret, betrayal and rejection. And the wounds from past relationships can haunt people all their lives."
Sep 5th 2021
EXTRACT: "Gardens help restore the ability to concentrate on demanding tasks, providing the perfect space for a break when working from home in a pandemic. Natural things – such as trees, plants and water – are particularly easy on the eye and demand little mental effort to look at. Simply sitting in a garden is therefore relaxing and beneficial to mental wellbeing."
Aug 17th 2021
EXTRACT: "Whether or not a person achieves remission, reducing blood sugar levels is important in managing the negative effects of type 2 diabetes and reducing risk of complications. But when it comes to choosing a diet, the most important thing is to pick one that suits you – one that you’re likely to stick to long term."
Aug 10th 2021
EXTRACT: "In our latest study, we show that by taking the microbiome from young mice and transplanting them into old mice, many of the effects of ageing on learning and memory and immune impairments can be reversed. Using a maze, we showed that this faecal microbiota transplant from young to old mice led to the old mice finding a hidden platform faster."
Aug 3rd 2021
EXTRACT: "Fukuyama argued that political struggle causes history. This struggle tries to solve the problem of thymos – an ancient Greek term referring to our desire to have our worth recognised. This desire can involve wanting to be recognised as equal to others. But it can also involve wanting to be recognised as superior to others. A stable political system needs to accommodate both desires." .... "Counter-dominant spite can weaken liberal democracies. During the 2016 Brexit referendum, some people in the UK voted Leave to spite elites, knowing this could damage the country’s economy. Similarly, during the 2016 US presidential election some voters supported Donald Trump to spite Hillary Clinton, knowing his election could harm the US. "
Jul 31st 2021
EXTRACT: "If we want to live in a world that is good for pollinators, as well as the rest of us, big changes are needed in our environment, and our food system. This is why many beekeepers change their diet and their shopping, eating more locally grown vegetables that aren’t treated with pesticides. ...... Being willing to buy fruit and vegetables that may have the occasional insect living in it is better for us and for nature. To live more harmoniously with the natural world, we need to relax about larvae in the lettuce and slugs in the spinach."
Jul 22nd 2021
EXTRACT: "You’d think our brush with mortality through the pandemic would have brought some of this home to us. You’d think it would give us pause for thought about what really matters to us: the kind of world we want for our children; the kind of society we want to live in. And for many people it has. In a survey carried out during lockdown in the UK, 85% of respondents found something in their changed conditions they felt worth keeping and fewer than 10% wanted a complete return to normal."