Feb 21st 2019

A New Despotism in the Era of Surveillance Capitalism

by Sam Ben-Meir

Sam Ben-Meir is professor of philosophy and world religions at Mercy Collage in New York.

There is a fascinating chapter toward the end of Alexis de Toqueville’s Democracy in America titled “What Kind of Despotism Do Democratic Nations Have to Fear?” in which the author attempted something truly extraordinary – to describe a social condition which humankind had never before encountered. We find him trying to put his finger on something which does not yet exist, but which – in his extraordinary political imagination – he was able to foresee with startling clarity.

I maintain that we have good reason to fear that the business model of commercial surveillance – pioneered by Google and adopted by Facebook, among others – is serving to undermine the foundations of our democracy. Shoshana Zuboff explains in her new book, The Age of Surveillance Capital (Public Affairs, 2019), that the system works by treating human experience as “free raw material for translation into behavioral data. Although some of these data are applied to service improvements, the rest are declared as proprietary behavioral surplus, fed into advanced manufacturing processes known as ‘machine intelligence,’ and fabricated into prediction products that anticipate what you will do now, soon and later. Finally, these prediction products are traded in a new kind of marketplace that I call behavioral futures markets. Surveillance capitalists have grown immensely wealthy from these trading operations, for many companies are willing to lay bets on our future behavior.”

In effect, we are becoming the subject of a new insidious, subtle, and almost invisible form of subjugation that was foreseen with uncanny ability by Tocqueville in 1849. Over a hundred and seventy-five years ago, Tocqueville wrote: “The kind of oppression with which democratic peoples are threatened will resemble nothing that has proceeded it in the world.” He goes on to describe the elevation of “an immense tutelary power … which alone takes charge of assuring their enjoyments and watching over their fate. It is absolute, detailed, regular, far-seeing, and mild. It would resemble paternal power, if, like that, it had for its object to prepare men for manhood; but on the contrary, it seeks only to keep them fixed in childhood; it likes citizens to enjoy themselves, provided that they think only of enjoying themselves. It willingly works for their happiness; but it wants to be the unique agent and sole arbiter of that.”

In Time magazine’s January seventeenth article “I Mentored Mark Zuckerberg, But I Can’t Stay Silent” author Roger McNamee observes, “One of the best ways to manipulate attention is to appeal to outrage and fear, emotions that increase engagement. Facebook’s algorithms give users what they want, so each person’s News Feed becomes a unique and personal reality, a filter bubble that creates the illusion that most people the user knows believe the same things.”

The notion of a bubble here is a useful one: central to the work of Jakob von Uexküll, an Estonian-born biologist and one of the fathers of biosemiotics, is the concept of the umwelt – or ‘surrounding-world’ – the ‘soap-bubble’ that each creature creates for itself and which constitutes their experiential world. The umwelt is composed of signs as bearers of meaning, and for each organism the umwelt is the whole of their reality. What distinguishes us as human beings is that our umwelt is not fixed, immobile, rigid, or static. One of the ways we can understand the effect of Facebook’s algorithms on its users is that the umwelt each user inhabits runs the danger of effectively shrinking: growing smaller and ever more calcified. In “How Facebook’s Algorithm Suppresses Content Diversity and How the Newsfeed Rules Your Clicks,” the author Zeynep Tufekci asserts that researchers were able to definitively conclude that, by a measurable amount, Facebook’s newsfeed algorithm reduces a user’s exposure to “…ideologically diverse, cross-cutting content...”  By assuring that we are exposed only to that which we are likely to approve of and assent to, our umwelt – or social reality – is that much more diminished and homogenized.

Facebook’s business model has far-reaching implications, especially in terms of our ability to empathize with others – others who may not be like, or think like, ourselves. This had devastating results in Myanmar where Facebook became a tool for ethnic cleansing against the Rohingya. While it certainly may not have been its intention, Facebook has become a “forum for tribalism” promoting a “simplistic version of ‘community’” while arguably “harming democracy, science and public health” – as Siva Vaidhyanathan suggests in Antisocial Media: How Facebook Disconnects Us and Undermines Democracy (Oxford University Press, 2018).

Much of my research has shown that there is a close relationship between empathy and our ability to creatively reconstruct the umwelt of the other. While one cannot share his or her umwelt – each of us remains in our own soap-bubble, as it were – we can participate in a common umwelt, which in many ways is purportedly the stated goal of social media. It is ironic that Facebook, which claims to prize connectivity above all, has in fact, contributed to producing the opposite result – where each of us fixed in a vapid and hardened bubble of isolation.

In the face of an American government that is increasingly retreating from its responsibilities, we must recognize that Facebook, Google, and Amazon are the new leviathans. In serving users only those posts with which they will agree, Facebook is like Tocqueville’s ‘tutelary’s power’ which “everyday … renders the employment of free will less useful, and more rare; it confines the action of the will in a smaller space, and little by little steals the very use of free will from each citizen.” These companies do not simply want to automate information: as Zuboff observes, “the goal now is to automate us… to produce ignorance by circumventing individual awareness and thus eliminate any possibility of self-determination.”

Facebook’s business model represents a new insidious form of subjugation that does not tyrannize, but as Vaidhyanathan observes, “it hinders, compromises, enervates, extinguishes, dazes, and finally reduces each nation to being nothing more than timid and industrious animals of which the government is the shepherd.”

Facebook has contributed its share to the deterioration of epistemic norms and has helped to usher in the era of so-called post-truth. The motivation behind this disdain for truth as such, has always been the same – namely, it serves the bottom line. As McNamee puts it: “on Facebook, information and disinformation look the same; the only difference is that disinformation generates more revenue, so it gets better treatment.”

Over a two-year period preceding the 2016 election, one hundred and twenty-six million Americans saw Russian-backed content. Facebook was at best reckless in the rampant and deliberate spread of disinformation through fake Russian accounts; which is to say that by allowing the proliferation of fake news, Facebook incontrovertibly helped Donald Trump to become the President of the United States. Facebook has provided fertile ground for the spread of grossly irresponsible conspiracy theories and “hopelessly inaccurate viral posts.”

Like many others, McNamee suggests that users should have control over their own data and metadata – as if data ownership is the solution to the scourge of surveillance capitalism. The problem with this kind of thinking is that it fails to ask the more elementary question of whether such data should exist at all. As Zuboff observes “It’s like negotiating how many hours a day a seven-year-old should be allowed to work, rather than contesting the fundamental legitimacy of child labor.” Surveillance capitalism represents a new form of despotism, one that is harming our capacity for individual autonomy in order that behavioral data can continue to be generated unimpeded, supplying markets and the advertisers that are Google’s and Facebook’s real customers.

We are becoming the kind of solipsistic and atomistic society that Tocqueville foresaw, “an enumerable crowd of like and equal men who revolve on themselves without repose … each of them, withdrawn, and apart, is like a stranger to the destiny of all the others… As for dwelling with his fellow citizens, he is beside them, but he does not see them; he touches them and does not feel them.” Alexis de Tocqueville warned us that oppression may take forms which are gentle, quiet, calm, but nonetheless, inimical to genuine freedom. To adequately respond to the problem will require more than demanding greater privacy or data ownership – it will involve a radical questioning of our basic assumptions, and a new understanding of what democracy means and entails in the age of capitalistic surveillance.



Sam Ben-Meir is a professor of philosophy and world religions at Mercy College in New York City.
 

 

Browse articles by author

More Current Affairs

Dec 14th 2019
EXTRACT: "Conspiracy theories about sinister Jewish power have a long history. The Protocols of the Elders of Zion, a Russian forgery published in 1903, popularized the notion that Jewish bankers and financiers were secretly pulling the strings to dominate the world. Henry Ford was one of the more prominent people who believed this nonsense."
Dec 13th 2019
EXTRACT: "In previous British elections, to say that trust was the main issue would have meant simply that trust is the trump card – whichever leader or party could secure most trust would win. Now, the emerging question about trust is whether it even matters anymore."
Dec 5th 2019
EXTRACT: "Europe must fend for itself for the first time since the end of World War II. Yet after so many years of strategic dependence the US, Europe is unprepared – not just materially but psychologically – for today’s harsh geopolitical realities. Nowhere is this truer than in Germany."
Nov 23rd 2019
Extdact: "The kind of gratitude expressed by Vindman and my grandfather is not something that would naturally occur to a person who can take his or her nationality for granted, or whose nationality is beyond questioning by others. Some who have never felt the sharp end of discrimination might even find it mildly offensive. Why should anyone be grateful for belonging to a particular nation? Pride, perhaps, but gratitude? In fact, patriotism based on gratitude might be the strongest form there is."
Nov 20th 2019
Extract: "Moody’s, one of the big three credit rating agencies, is not upbeat about the prospects for the world’s debt in 2020 – to put it mildly. If we were to try to capture the agency’s view of where we are heading on a palette of colours, we would be pointing at black – pitch black."
Nov 17th 2019
Extract: "Digital money is already a key battleground in finance, with technology firms, payment processing companies, and banks all vying to become the gateway into the burgeoning platform-based economy. The prizes that await the winners could be huge. In China, Alipay and WeChat Pay already control more than 90% of all mobile payments. And in the last three years, the four largest listed payment firms – Visa, Mastercard, Amex, and PayPal – have increased in value by more than the FAANGs (Facebook, Apple, Amazon, Netflix, and Google)."
Nov 14th 2019
Extract: "Trump, who understands almost nothing about governing, made a major mistake in attacking career public officials from the outset of his presidency. He underestimated – or just couldn’t fathom – the honor of people who could earn more in the private sector but believe in public service. And he made matters worse for himself as well as for the government by creating a shadow group – headed by the strangely out-of-control Rudy Giuliani, once a much-admired mayor of New York City, and now a freelance troublemaker serving as Trump’s personal attorney – to impose the president’s Ukraine policy over that of “the bureaucrats.” "
Nov 4th 2019
Extract: "Trump displays repeated and persistent behaviours consistent with narcissistic personality disorder and antisocial personality disorder. These behaviours include craving for adulation, lack of empathy, aggression and vindictiveness towards opponents, addiction to lying, and blatant disregard for rules and conventions, among others." The concern is that leaders with these two disorders may be incapable of putting the interests of the country ahead of their own personal interests. Their compulsive lying may make rational action impossible and their impulsiveness may make them incapable of the forethought and planning necessary to lead the country. They lack empathy and are often motivated by rage and revenge, and could make quick decisions that could have profoundly dangerous consequences for democracy.
Oct 31st 2019
EXTRACT: "......let’s see what happens when we have less money for all the things we want to do as a country and as individuals. Promises and predictions regarding Brexit will soon be tested against reality. When they are, I wouldn’t want to be one of Johnson’s Brexiteers."
Oct 21st 2019
EXTRACT: "Were Israel to be attacked with the same precision and sophistication as the strike on Saudi Arabia, the Middle East would be plunged into war on a scale beyond anything it has experienced so far. Sadly (but happily for Russian President Vladimir Putin), that is the reality of a world in which the US has abandoned any pretense of global leadership."
Oct 20th 2019
EXTRACT: "Europe also stands to lose from Trump’s abandonment of the Kurds. If, in the ongoing chaos, the thousands of ISIS prisoners held by the Kurdish-led Syrian Democratic Forces escape – as some already have – America’s estranged European allies will suffer. Yet Trump is unconcerned. “Well, they are going to be escaping to Europe, that’s where they want to go,” he remarked casually at a press conference. “They want to go back to their homes." "
Oct 15th 2019
EXTRACT: "Assuming the House ultimately votes to impeach Trump, the fact remains that there are far fewer votes in the Senate than will be needed to convict him and remove him from office. But the willingness of Congress – including the Senate – to continue tolerating his dangerous conduct in office, including threats to US national security, is now truly in question."
Oct 7th 2019
EXTRACT: "The problem didn't start with the election of Donald Trump. Nor did it begin with the Democrats launching an impeachment inquiry against Trump. This is a developing crisis that has been growing like a cancer within our polity for at least the past 25 years. Its main symptoms are a lack of civility in our political discourse, a "take no prisoners" mindset, and a denial of the very legitimacy of "the other side." Trump didn't create this crisis; he was the result of it.   When Newt Gingrich took the helm of Congress in 1995, unlike previous Republican leaders, he embarked on a campaign not only to obstruct the efforts of then President Clinton, but to destroy him. Congress launched a series of investigations accusing Clinton of everything from corruption to obstruction of justice – with hints of even more nefarious plots to assassinate those who might pose a problem to his presidency.  "
Oct 4th 2019
EXTRACT: "As the story spreads, it grows darker. Meanwhile, Trump is trying to learn the identity of the whistleblower (who is protected by law), which could expose that person to great danger. And he is accusing some people – including Adam Schiff, the chair of the House Intelligence Committee – of treason. My sense is that Trump fears the tough, focused Schiff. Trump has ominously noted that traitors used to be shot or hanged. And he hasn’t helped himself with members of either party by declaring, in one of his hundreds of febrile tweets, that forcing him from office could lead to a “civil war.” Trump has taken the United States somewhere it’s never been before. His presidency may not survive it."
Sep 24th 2019
EXTRACT: "But regardless of whether the Ukraine scandal remains front-page news, it will haunt the US intelligence community, which has been Trump’s bête noire since the day he took office. Trump has relentlessly attacked US intelligence agencies, cozied up to Russian President Vladimir Putin, and divulged secrets to foreign officials, potentially burning high-value sources. This behavior had already raised serious concerns about whether Trump can be trusted to receive sensitive intelligence at all. Now, intelligence leaders must ask themselves how far they are willing to go in toeing the White House line."
Sep 21st 2019
EXTRACT: "As Lobaczewski pointed out, pathological leaders tend to attract other people with psychological disorders. At the same time, empathetic and fair-minded people gradually fall away. They are either ostracised or step aside voluntarily, appalled by the growing pathology around them.......As a result, over time pathocracies become more entrenched and extreme. You can see this process in the Nazi takeover of the German government in the 1930s, when Germany moved from democracy to pathocracy in less than two years.......In the US, there has clearly been a movement towards pathocracy under Trump. As Lobaczewski’s theory predicts, the old guard of more moderate White House officials – the “adults in the room” – has fallen away. The president is now surrounded by individuals who share his authoritarian tendencies and lack of empathy and morality. Fortunately, to some extent, the democratic institutions of the US have managed to provide some push back."
Sep 16th 2019
EXTRACT: "If the Supreme Court does agree with the Divisional Court that the question is political rather than legal, it will take the UK constitution into quite peculiar territory. Prime ministers will be the new kings and queens. They will be free to suspend parliament at will, and for as long as they wish, without any judicial interference. Parliament will meet not out of constitutional necessity but in the service of the government’s interests – namely, to pass its legislation and to maintain appearances, rather than to hold it to account."
Sep 12th 2019
Extract: "The Republican Party has lashed its fate to an increasingly unhinged leader. Though three other presidential hopefuls for 2020 now stand in Trump’s way, none can defeat him. But they can damage his reelection effort, which is why the Republican Party has been scrapping some primaries and caucuses. How well Trump does in November next year may well depend on how his fragile ego withstands the coming months."
Sep 2nd 2019
EXTRACTS: "Most people think of revolutions as sudden earthquakes or volcanic eruptions that come without warning and sweep away an entire political system. But historians, political scientists, and even the odd politician know that the reality is very different: revolutions happen when systems hollow themselves out, or simply rot from within. Revolutionaries can then brush aside established norms of behavior, or even of truth, as trivialities that should not impede the popular will............ Only time will tell whether we are currently witnessing the hollowing out of British democracy. But Prime Minister Boris Johnson may well have crossed some invisible Rubicon by.......... Whatever happens now, British parliamentary democracy may never be the same again. It will certainly never again be the model that so many people around the world once admired."
Aug 29th 2019
EXTRACT: "Events such as prorogations and dissolutions happen when countries face difficult times. Therefore, because of the disastrous effects of Brexit: sterling in freefall; a recession looming on the horizon and Britain’s international standing at its lowest ebb since Suez, it is no surprise that the country is in this position now. The worrying thing is that using the monarchical power of prorogation does not solve problems – it has a history of turning them into frightening and often violent crises. There is a worrying relationship between the use of such powers and a complete breakdown in government."