Feb 12th 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir


Sam Ben-Meir is an assistant adjunct professor of philosophy at City University of New York, College of Technology.

 

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity. 

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019) that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”   

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1749. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”  

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.” 

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized. 

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018). 

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation. 

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.” 

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.” 

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.” 

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.” 

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers. 

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.   

 

 

Browse articles by author

More Essays

Mar 12th 2020
EXTRACT: "Repeated stress is a major trigger for persistent inflammation in the body. Chronic inflammation can lead to a range of health problems, including diabetes and heart disease. The brain is normally protected from circulating molecules by a blood-brain barrier. But under repeated stress, this barrier becomes leaky and circulating inflammatory proteins can get into the brain. The brain’s hippocampus is a critical brain region for learning and memory, and is particularly vulnerable to such insults. Studies in humans have shown that inflammation can adversely affect brain systems linked to motivation and mental agility. There is also evidence of chronic stress effects on hormones in the brain, including cortisol and corticotropin releasing factor (CRF). High, prolonged levels of cortisol have been associated with mood disorders as well as shrinkage of the hippocampus. It can also cause many physical problems, including irregular menstrual cycles."
Mar 12th 2020
EXTRACT: "It’s important to do things that make you happy or content as you are doing them – and doing them for yourself. Research has found that picking recovery activities you find personally satisfying and meaningful is more likely to help you feel recovered by the next morning."
Feb 22nd 2020
EXTRACTS: "A recent study of nearly 3,000 physicists found that a scientist’s most highly cited publication had an equal probability of being published at any point within the sequence of papers the scientist published.........Creativity is not the prerogative of the young, but can occur at any stage in the life cycle...........there is not a single kind of creativity, but that in virtually every intellectual discipline there are two different types of creativity, each associated with a distinct pattern of discovery over the life cycle. The bold leaps of fearless and iconoclastic young conceptual innovators are one important form of creativity. Archetypal conceptual innovators include Einstein, Picasso.......very different type of creativity, in which important new discoveries emerge gradually and incrementally from the extended explorations of older experimental innovators.......The single year from with Paul Cézanne’s work is most frequently illustrated in textbooks of art history is 1906 – the last year of his life, when he was 67."
Feb 22nd 2020
EXTRACT: "As our global population is projected to live longer than ever before, it’s important that we find ways of helping people live healthier for longer. Exercise and diet are often cited as the best ways of maintaining good health well into our twilight years. But recently, research has also started to look at the role our gut – specifically our microbiome – plays in how we age."
Feb 16th 2020
EXTRACT: "In an increasingly polarised political landscape, we see differing political views challenged, not through debate and discussion, but through tribal behaviour. We often consider the groups that we belong to as worthy of empathy, respect and tolerance – but not others. What’s more, recent research has identified that we reward our leaders for being naysayers – negating, refuting or criticising others – rather than empowering them."
Feb 14th 2020
EXTRACT: "All of which is to say that the Communist Manifesto is not a historical relic of a bygone era, an era of which many would like to think we have washed our hands. As long as workers’ rights are trampled on, and children are pressed into wretched servitude; as long as real wages stagnate, so that economic inequality continues to grow, allowing wealth to be ever more concentrated in the hands of the few – then the Communist Manifesto will continue to resonate and we will hear the clarion call of workers of the world to unite, “for they have nothing to lose but their chains. They have a world to win.” "
Feb 4th 2020
EXTRACTS: "In my many visits to Michael’s studio I have had the opportunity to observe his process up close and over time.............."Armageddon Yacht (2019)". The name is derived from a term that US sailors use for an aircraft carrier. Power and violence are recurring themes in Anderson’s work – and no less here. With irony and wit he questions our contemporary assumptions and illusions about power. The central image of three models sipping martinis on a yacht presents us with an idealized vision of Western luxury and decadence, privilege and wealth."
Jan 23rd 2020
EXTRACT: " For the first time in over two decades a painting by Marc Chagall will be going up for auction in Israel. Tiroche Auction House will be hosting the Israeli & International Art auction on January 25th – featuring paintings by a number of Israeli masters, including Reuben Rubin, and Yosl Bergner. The highlight of the evening however is Chagall’s Jacob’s Ladder (1970-1974), a theme to which the artist would return at least a dozen times in paintings and drawings."
Jan 16th 2020
EXTRACT: "Between 1940 and 1942 Charlotte Salomon, a young German-Jewish artist, created a sequence of 784 paintings while hiding from the Nazi authorities. She gave the sequence a single title: Leben? oder Theater? (Life? or Theatre?). Viewed in the 21st century, Salomon’s artwork could be considered a precursor to the contemporary graphic novel, creating a complex web of narratives through words and images."
Jan 9th 2020
EXTRACT: "It’s simply not possible to do justice to the value of Iran’s cultural heritage – it’s a rich and noble history that has had a fundamental impact on the world through art, architecture, poetry, in science and technology, medicine, philosophy and engineering. The Iranian people are intensely aware – and rightly proud of – their Persian heritage. The archaeological legacy left by the civilisations of ancient and medieval Iran extend from the Mediterranean Sea to India and ranges across four millennia from the Bronze age (3rd millennium BC) to the glorious age of classical Islam and the magnificent medieval cities of Isfahan and Shiraz that thrived in the 9th-12th centuries AD, and beyond."
Jan 9th 2020
EXTRACT: "Lautrec had a genius for representing people. He would rarely paint any other subject. When he looked at a person who caught his interest, not only their appearance, but seemingly also their personality would magically flow from his hand, fixing a moment of their life, and his, on a piece of cardboard or canvas."
Jan 7th 2020
EXTRACT: "In 2010, Great Britain generated 75% of its electricity from coal and natural gas. But by the end of the decade*, these fossil fuels accounted for just 40%, with coal generation collapsing from the decade’s peak of 41% in 2012 to under 2% in 2019. The near disappearance of coal power – the second most prevalent source in 2010 – underpinned a remarkable transformation of Britain’s electricity generation over the last decade, meaning Britain now has the cleanest electrical supply it has ever had. Second place now belongs to wind power, which supplied almost 21% of the country’s electrical demand in 2019, up from 3% in 2010. As at the start of the decade, natural gas provided the largest share of Britain’s electricity in 2019 at 38%, compared with 47% in 2010."
Jan 5th 2020
EXTRACT: "Owing to these positive developments, many were lulled into thinking that modern advanced economies can run on autopilot. And yet economists knew that market capitalism does not automatically self-correct for adverse distributional trends (both secular and transitional), especially extreme ones. Public policies and government services and investments have a critical role to play. But in many places, these have been either non-existent or insufficient. The result has been a durable pattern of unequal opportunity that is contributing to the polarization of many societies. This deepening divide has a negative spillover effect on politics, governance, and policymaking, and now appears to be hampering our ability to address major issues, including the sustainability challenge."
Jan 2nd 2020
In September 2018, Ian Buruma was forced out as editor of The New York Review of Books, following an outcry over the magazine’s publication of a controversial essay about #MeToo. A year later, in a conversation with Svenska Dagbladet US correspondent Malin Ekman, he reflects on lost assignments, literature, cancel culture, threats to freedom of speech, and the state of liberal democracy.
Dec 31st 2019
EXTRACT: "I have long been troubled by the way so many believing Christians in the West have either been ignorant of or turned their backs on the plight of Palestinians, both Christian and Muslim. Right​-wing Evangelicals, under the sway of heretical theology, are so blinded by their obsession with Israel that they can't see Israel's victims. Other Western Christians simply just don't know or about the people of Palestine. I find this state of affairs to always distressing, but especially so at Christmas time, since the Christmas story we celebrate not only took place in that land, it continues to define the lives of the Palestinians who live in places like Bethlehem and Nazareth. "
Dec 19th 2019
EXTRACT: "Although there have long been farmers and merchants who specialised in growing and selling seeds, it wasn’t until the 20th century that people started talking about seed production as an industrial process. Thanks to changes in farming, science and government regulations, most of the “elite” seed that is bought and sold around the world today is mass produced and mass marketed — by just four transnational corporations."
Dec 14th 2019
EXTRACT: "Dehydration is associated with a higher risk of ill health in older people, from having an infection, a fall or being admitted to hospital. But an appetite for food and drink can diminish as people age, so older people should drink regularly, even when they’re not thirsty. Older women who don’t have to restrict their fluid intake for medical reasons, such as heart or kidney problems, are advised to drink eight glasses a day. For older men, it’s ten glasses."
Dec 12th 2019
EXTRACT: "A decade ago, I wrote The Life You Can Save: Acting Now to End World Poverty. This month, a fully revised Tenth Anniversary edition was published, and is available, free, as an eBook and audiobook. The chapters of the audiobook are read by celebrities, including Paul Simon, Kristen Bell, Stephen Fry, Natalia Vodianova, Shabana Azmi, and Nicholas D’Agosto. Revising the book has led me to reflect on the impact it has had, while the research involved in updating it has made me focus on what has changed over the past ten years"
Nov 27th 2019
EXTRACT: "Jay Willis at GQ reports that Secretary of Energy Rick Perry said on Fox and Friends that Trump is God’s Chosen One. He said he told Trump, “If you’re a believing Christian, you understand God’s plan for the people who rule and judge over us on this planet and our government.” Perry also said that he had written a memo for Trump about how God uses imperfect people, comparing Trump to biblical figures such as Solomon, Saul and David, who were also flawed. This evangelical discourse that a providential God controls political power goes back to old West Semitic Religion"
Nov 7th 2019
Extract: "The PSA test is done using a small amount of blood to detect raised levels of prostate specific antigen (PSA). Yet, despite its relatively low cost and ease of administering, it is not offered for routine screening in many countries, including the UK. This is because a significant proportion of those testing positive have no disease (a false-positive result), slow-growing cancer that doesn’t need treatment, or positive results caused by a relatively benign condition, such as a urinary tract infection. Detecting prostate cancer early is important and saves lives. But many of those identified by the PSA test as having elevated levels of the antigen could potentially undergo painful treatment with significant life-altering side effects, which were unnecessary. Also, up to 15% of men with prostate cancer have normal PSA levels (a false-negative result), meaning that many men would receive unwarranted reassurance from this test. Guidelines in most countries, therefore, note that the possible benefits of testing are outweighed by the potential harms of over-diagnosis and over-treatment, making it unsuitable for screening everyone."