Feb 12th 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir


Sam Ben-Meir is an assistant adjunct professor of philosophy at City University of New York, College of Technology.

 

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity. 

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019) that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”   

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1749. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”  

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.” 

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized. 

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018). 

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation. 

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.” 

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.” 

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.” 

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.” 

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers. 

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.   

 

 

Browse articles by author

More Essays

Nov 15th 2020
EXTRACT: "Perhaps it is Piller’s discovery that when it comes to war there is no such thing as innocence...."
Nov 4th 2020
EXTRACT: "I imagined America as the land of the free that gave voice to the forgotten. Where race, color, and creed do not matter and human rights are guarded with zeal. Where the ingathering of all cultures and people made it richer and human resources and talent knew no limits or constraints. Where opportunity awaits the able and generosity is extended to the needy. Where everyone is equal before the law and political differences are valued to make America better. Where sacrifices are willingly made to right the wrong morals and fortitude guide its leaders. Where caring about friends and allies is the hallmark of the nation and opposing oppression near and far is the emblem that distinguished America. This is the character of America. This is the soul of America. This is what made America great. The America that gave me a home. The America that fulfilled my dreams."
Oct 15th 2020
EXTRACT: "“The paintings which I propose to do will depict the struggles of a people to create a nation and their attempt to build a democracy” – this is how Jacob Lawrence described his project in 1954. Over sixty-five years later his proposal has, if anything, become only more urgent. Two days after this exhibition closes, Americans will vote in what is arguably the most significant election in a generation, an election that will measure our commitment to preserving that democracy, the struggle for which was Lawrence’s mighty theme."
Oct 15th 2020
EXTRACT: "There are also other ways our life stories can be passed down through generations, besides being inscribed in our DNA...... One 2014 study looked at epigenetic changes in mice. Mice love the sweet smell of cherries, so when a waft reaches their nose, a pleasure zone in the brain lights up, motivating them to scurry around and hunt out the treat.... The researchers decided to pair this smell with a mild electric shock, and the mice quickly learned to freeze in anticipation....... The study found this new memory was transmitted across the generations. The mice’s grandchildren were fearful of cherries, despite not having experienced the electric shocks themselves. The grandfather’s sperm DNA changed its shape, leaving a blueprint of the experience entwined in the genes."
Oct 1st 2020
EXTRACT: "As we Americans face the potential loss of a peaceful transition of power after the election and the possible end of democracy as we know it, we are reminded that discourse matters, that words matter and that the one who quotes poetry is a man who reads—and that matters."
Sep 25th 2020
EXTRACT: "We now know the potentially appalling long-term effects of suffering cruelty from others, including damage to both physical and mental health. The benefits of being compassionate towards oneself, rather than treating oneself cruelly, are also increasingly recognised..... And the idea that we must suffer to grow is questionable. Positive life events, such as falling in love, having children and achieving cherished goals can lead to growth..... Teaching through cruelty invites abuses of power and selfish sadism. Yet Buddhism offers an alternative - wrathful compassion. Here, we act from love to confront others to protect them from their greed, hatred and fear. Life can be cruel, truth can be cruel, but we can choose not to be."
Sep 19th 2020
EXTRACT: "Over his incredible career, David Attenborough has seen more of earth’s natural wonders than almost anyone. To hear him talk, with such clarity, about how bad things are getting is deeply moving. Scientists have recently demonstrated what would be needed to bend the curve on biodiversity loss. As Attenborough says in the final scene, “What happens next, is up to every one of us”. "
Sep 15th 2020
EXTRACTS: "The Anglo-Australian multinational company Rio Tinto – the largest iron ore mining company in the world – demolished two 46,000-year-old Aboriginal rock shelters in May.......The Dampier Archipelago of Western Australia is home to thousands of Aboriginal pictographs, and perhaps the oldest surviving rock art in the world. Indeed, Australia’s Indigenous art represents the longest uninterrupted tradition of art in the world – going back over 50,000 years......Aboriginal people represent the oldest continuous culture in the world...."
Sep 13th 2020
EXTRACT: "Iran’s 1979 Islamic revolution was a defining event that changed how we think about the relationship between religion and modernity. Ayatollah Khomeini’s mass mobilisation of Islam showed that modernisation by no means implies a linear process of religious decline.....Reliable large-scale data on Iranians’ post-revolutionary religious beliefs, however, has always been lacking...........In June 2020, our research institute, the Group for Analyzing and Measuring Attitudes in IRAN...conducted an online survey......The results verify Iranian society’s unprecedented secularisation."
Sep 12th 2020
EXTRACT: "Just as you can upgrade your old computer’s operating system, culture can evolve even if intelligence doesn’t. Humans in ancient times lacked smartphones and spaceflight, but we know from studying philosophers such as Buddha and Aristotle that they were just as clever. Our brains didn’t change, our culture did."
Sep 2nd 2020
EXTRACT: "Our lab in Cambridge, England, is working with a promising new family of materials known as halide perovskites. They are semiconductors, conducting charges when stimulated with light. Perovskite inks are deposited onto glass or plastic to make extremely thin films – around one hundredth of the width of a human hair – made up of metal, halide and organic ions. When sandwiched between electrode contacts, these films make solar cell or LED devices."
Sep 2nd 2020
EXTRACT: "Bryant, a black man, was sentenced to life in prison for trying to steal hedge clippers from a Louisiana carport storage room in 1997. He has already served twenty-three years for this petty crime, and on 31 July the Louisiana Supreme Court denied a request to review his life sentence. The denial followed a lower appeals court’s 2019 decision that concluded “his life sentence is final.” The only judge on the Louisiana Supreme Court to dissent (or even issue an opinion) was Chief Justice Bernette Johnson. She wrote a stinging rebuke, observing that Bryant’s “life sentence for a failed attempt to steal a set of hedge clippers is grossly out of proportion to the crime and serves no legitimate penal purpose.” "
Aug 18th 2020
EXTRACT: "In 2016, the Brennan Center for Justice reported that as high as 40 percent of prisoners should not be in prison—”behind bars with no compelling public safety reason.” There are literally thousands of young prisoners, Black and white, who are serving life sentences without the possibility of parole for non-violent offences. It is unfathomable that we as a society are spending billions of dollars every year to sustain such pointless cruelty, to inflict needless pain on individuals, fathers and mothers, who pose no threat at all to the public."
Jul 31st 2020
EXTRACT: "From a Kantian standpoint discrimination based on race – or religion, or gender – is fundamentally wrong. It is wrong, first of all, because it is dehumanizing, a denial of human dignity. When I racially discriminate, I am denying the person’s intrinsic self-worth, I am, in fact, denying their very right to exist, whether I know it or not. The moral law demands that I treat every individual as a free person equal to everyone else. If the moral law grants each of us a kind of infinite worth, it does not grant someone greater worth than anyone else."
Jul 12th 2020
EXTRACT: "Remember, your wellbeing is extremely important when supporting someone with depression. Take time for self-care so you can model positive behaviours and be replenished enough to provide this crucial support."
Jul 4th 2020
EXTRACT: "--- Nobody is more dangerous than he who imagines himself pure in heart, for his purity, by definition, is unassailable. --- Author James Baldwin’s words, written in the America of the late 1950s."
Jun 29th 2020
EXTRACT: "Numerous studies have shown that children who grow up in more deprived neighbourhoods tend to have worse physical health as adults compared to those raised in more affluent areas. This is the case even when researchers take into account family income and education, and whether or not parents have major illnesses. In order to address this health disparity, researchers need to understand how those living in disadvantaged neighbourhoods end up with worse health outcomes. Our team’s latest study has highlighted one potential way your childhood neighbourhood may influence your health for years to come. It might do so through changing how the activity of your genes is regulated."
Jun 29th 2020
EXTRACT: "Ruth Poniarski is a painter and the author of Journey of the Self: Memoir of an Artist (Warren Publishing, 2020), in which she tells the story of her decade long struggle with mental illness, a “spiraling malady” which led her into a “pattern of psychosis”. I recently had the opportunity to talk with Poniarski about her life and work, and how she eventually overcame her demons."
Jun 27th 2020
EXTRACT: "I know I’m good in a couple of things, really good in a few things, and that’s enough. My confidence is big enough that I can really let people grow next to me, it’s no problem. I need experts around me. It’s really very important that you are empathetic, that you try to understand the people around you, and that you give real support to the people around you."