Feb 12th 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir

Sam Ben-Meir is professor of philosophy and world religions at Mercy Collage in New York.

 

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity. 

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019) that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”   

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1749. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”  

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.” 

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized. 

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018). 

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation. 

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.” 

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.” 

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.” 

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.” 

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers. 

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.   

 

 

Browse articles by author

More Essays

Jul 31st 2020
EXTRACT: "From a Kantian standpoint discrimination based on race – or religion, or gender – is fundamentally wrong. It is wrong, first of all, because it is dehumanizing, a denial of human dignity. When I racially discriminate, I am denying the person’s intrinsic self-worth, I am, in fact, denying their very right to exist, whether I know it or not. The moral law demands that I treat every individual as a free person equal to everyone else. If the moral law grants each of us a kind of infinite worth, it does not grant someone greater worth than anyone else."
Jul 12th 2020
EXTRACT: "Remember, your wellbeing is extremely important when supporting someone with depression. Take time for self-care so you can model positive behaviours and be replenished enough to provide this crucial support."
Jul 4th 2020
EXTRACT: "--- Nobody is more dangerous than he who imagines himself pure in heart, for his purity, by definition, is unassailable. --- Author James Baldwin’s words, written in the America of the late 1950s."
Jun 29th 2020
EXTRACT: "Numerous studies have shown that children who grow up in more deprived neighbourhoods tend to have worse physical health as adults compared to those raised in more affluent areas. This is the case even when researchers take into account family income and education, and whether or not parents have major illnesses. In order to address this health disparity, researchers need to understand how those living in disadvantaged neighbourhoods end up with worse health outcomes. Our team’s latest study has highlighted one potential way your childhood neighbourhood may influence your health for years to come. It might do so through changing how the activity of your genes is regulated."
Jun 29th 2020
EXTRACT: "Ruth Poniarski is a painter and the author of Journey of the Self: Memoir of an Artist (Warren Publishing, 2020), in which she tells the story of her decade long struggle with mental illness, a “spiraling malady” which led her into a “pattern of psychosis”. I recently had the opportunity to talk with Poniarski about her life and work, and how she eventually overcame her demons."
Jun 27th 2020
EXTRACT: "I know I’m good in a couple of things, really good in a few things, and that’s enough. My confidence is big enough that I can really let people grow next to me, it’s no problem. I need experts around me. It’s really very important that you are empathetic, that you try to understand the people around you, and that you give real support to the people around you."
Jun 27th 2020
An essay about the "the enormously influential 1940 'Head of Christ' painting by evangelical Warner E. Sallman" pictured below.
Jun 17th 2020
EXTRACT: "The diverse, non-human life forms that live in our guts – known as our microbiome – are crucial to our health. A disrupted balance of these contribute to a range of disorders and diseases, including obesity, diabetes, inflammatory bowel disease. It could even affect our mental health..... It’s well known that the microbes living in our guts are altered through diet. For example, including dietary fibre and dairy products in our diets encourages the growth of beneficial bacteria. But mounting evidence suggests that exercise can also modify the types of bacteria that reside within our guts."
Jun 13th 2020
EXTRACT: "Bonhoeffer’s life holds an important lesson for us today, regardless of our religious affiliation or lack thereof. And simply put it is this: you are called upon; you are called on behalf of your neighbor. When you are called to be responsible that is not an obligation which you can decline, discharge or acquit yourself of – it is an infinite responsibility, a “forever commitment” as Charles Blow recently put it. And we all must be prepared to make any sacrifice necessary when we are called."
Jun 11th 2020
EXTRACT: "People differ substantially in how much they’re affected by experiences in their lives. Some people seem to be more affected by daily stress, or the loss of someone close to them. On the other hand, some people seem to get through the same experiences relatively unscathed. Similarly, some people benefit strongly from counselling, or having a support system of close family and friends. Others seem better able to manage on their own. But understanding why some people are more sensitive than others isn’t just a question of how they were raised, and the experiences they’ve been through. In fact, previous research has found that some people in general seem more sensitive to what they experience – and some are generally less sensitive."
Jun 7th 2020
EXTRACT: " The root causes of anthropogenic climate change – which has led to the endangering of countless species across the globe – cannot be adequately grasped in isolation from the technological application of modern science. While Swedish activist Greta Thunberg was certainly justified in calling upon American legislators to “unite behind the science,” neither can we overlook the culpability of science in bringing about the environmental crisis. "
May 23rd 2020
EXTRACT: "The QAnon movement began in 2017 after someone known only as Q posted a series of conspiracy theories about Trump on the internet forum 4chan. QAnon followers believe global elites are seeking to bring down Trump, whom they see as the world’s only hope to defeat the “deep state.” OKM is part of a network of independent congregations (or ekklesia) called Home Congregations Worldwide (HCW). The organization’s spiritual adviser is Mark Taylor, a self-proclaimed “Trump Prophet” and QAnon influencer with a large social media following on Twitter and YouTube."
May 23rd 2020
EXTRACT: "The aim of my research for the Understanding Unbelief programme was to investigate the worldviews of non-believers, since little is known about the diversity of these non-religious beliefs, and what psychological functions they serve. I wanted to explore the idea that while non-believers may not hold religious beliefs, they still hold distinct ontological, epistemological and ethical beliefs about reality, and the idea that these secular beliefs and worldviews provide the non-religious with equivalent sources of meaning, or similar coping mechanisms, as the supernatural beliefs of religious individuals."
May 22nd 2020
EXTRACT: "Psalm 91, for example, reassures believers that God will protect them from “the pestilence that walketh in darkness… A thousand shall fall at thy side, and ten thousand at thy right hand; but it shall not come nigh thee”.............Luther was a devout believer but insisted that religious faith had to be joined with practical, physical defences against sickness. It was a good Christian’s duty to work to keep themselves and others safe, rather than relying solely on the protection of God. "
May 22nd 2020
EXTRACT: "Evidence from this study shows clearly that eating foods rich in flavonoids over your lifetime is significantly linked to reducing Alzheimer’s disease risk. However, their consumption will be even more beneficial alongside other lifestyle changes, such as quitting smoking, managing a healthy weight and exercising."
May 5th 2020
EXTRACT: "It’s possible that the answers to questions like, “how do I live a virtuous life?” or “how do we build a good society?” are not the same as they were a few weeks ago."
May 2nd 2020
EXTRACT: "Strangely, those with strong beliefs tend to be admired. The human mind hates uncertainty, so it is comforting to be told what to think, and to form settled opinions. But it is not rational. As the philosopher Bertrand Russell wrote: “The fundamental cause of the trouble is that in the modern world the stupid are cocksure while the intelligent are full of doubt.”
Apr 21st 2020
Extract: "Humans, Boccaccio seems to be saying, can think of themselves as upstanding and moral – but unawares, they may show indifference to others. We see this in the 10 storytellers themselves: They make a pact to live virtuously in their well-appointed retreats. Yet while they pamper themselves, they indulge in some stories that illustrate brutality, betrayal and exploitation. Boccaccio wanted to challenge his readers, and make them think about their responsibilities to others. “The Decameron” raises the questions: How do the rich relate to the poor during times of widespread suffering? What is the value of a life? In our own pandemic, with millions unemployed due to a virus that has killed thousands, these issues are strikingly relevant.
Apr 20th 2020
Extract: "If we do not seize this crisis as a moment for transformation, then we will have lost the war. If doing so requires reviving notions of collective guilt and responsibility – including the admittedly uncomfortable view that every one of us is infinitely responsible, then so be it; as long we do not morally cop out by blaming some group as the true bearers of sin, guilt, and God’s heavy judgment. A pandemic clarifies the nature of action: that with our every act we answer to each other. In that light, we have a duty to seize this public crisis as an opportunity to reframe our mutual responsibility to one another and the world."
Apr 16th 2020
EXTRACT: "Death is the common experience which can make all members of the human race feel their common bonds and their common humanity."