Oct 23rd 2013

Measure for Mismeasure

by Esther Dyson

Esther Dyson, CEO of EDventure Holdings, is an active investor in a variety of start-ups around the world. Her interests include information technology, health care, private aviation, and space travel.

ISTANBUL – I recently used Uber (an online service for ordering a car and driver) and did not have the usual pleasant experience. The driver did not know the area, and, worse, he did not follow his navigator’s instructions, turning left instead of right. When Uber asked me, as usual, to rate the driver, I did not hesitate to give him two out of five. I was not being vindictive; I wanted to save other passengers from an unpleasant experience, and I hoped that maybe feedback would encourage him to improve or find another line of work.

But what does two out of five mean? It obviously means worse than average, which would be three. But, while I would always pick an average driver over a driver with a rating of two, given the choice between a two driver and a blind pick, I might pick the two, because the fear of someone even worse would keep me from taking a risk. This is a well-known phenomenon known as loss aversion: the risk of a one outweighs the hope of a five.

Just last week, I was engaged in ranking proposals for the Knight News Challenge; to simplify things, they had a three-point ranking: three for yes, two for consider, one for reject. The idea was to pick the easy winners, reject the losers, and focus on distinguishing among the maybes. That makes sense in the context of focusing attention where a decision is needed.

Ranking exercises, like the things they rank, are not all the same; different approaches fit different situations. We live in a world where everything is being rated, whether you are a professional judge or an individual trying to make sense of modern life. Indeed, while we rate the Uber drivers, they are rating us.

Consider a business plan or a foundation grant proposal. One proposal might be ranked nine out of ten, while another is eight out of 20; the first is pretty good but with limited upside, while the second is not so good, but has the potential to be great. The two cannot really be compared: One is a safe choice, but not likely to have a huge impact; the other is riskier, but ultimately may be more worthwhile. If you are a customer buying a product that should work, you want the nine out of ten; if you are a venture capitalist who thinks she can add value, you want the eight out of 20.

Helping people to think clearly about these numbers is important. People want simplicity, yet at the same time, in a world of targeted marketing, customization, and precision, in which vendors struggle to give consumers exactly what they want, people can help themselves by thinking clearly and specifying their preferences.

Imagine that you have cancer. The doctor says that you probably have two years to live, or a 50% expected improvement in “survival” (medical terminology for living another five years) if you undergo chemotherapy. In other words, you can have two years of gradual decline with some pain, or three years of nauseating treatments, “chemo brain,” loss of hair, and diminished dignity.

If you think those numbers are not quite comparable, you are right; that is part of the problem. (And the numbers may be based on a limited sample of people who do not quite resemble you.) But, while the timing is uncertain, the trade-offs are pretty clear. What you really want, of course, is a cure, not merely a minimal extension of life expectancy, but nothing is certain. The choice sounds easy, but then perhaps you just want to survive to see your daughter graduate, or your son get married. It would be nice to understand those numbers better.

Even on the population level, we are facing some of the same complexities at HICCup (the Health Initiative Coordinating Council), a startup that I founded. How do you measure health improvement? It is not, as one benighted analyst suggested, “A 20% improvement (reduction) in heart attacks plus a 30% improvement (reduction) in diabetes incidence equals a 50% improvement.” You need to average the improvements to get a figure somewhere between 20% and 30%. But how do you weight diabetes versus heart attacks, life extension versus quality of life?

There is also, in any sector, the issue of what the data really mean. One of my favorite (sad) stories concerns consumer credit ratings in Russia. A retail banker once told me that in making credit decisions in Russia, his analysts had faced a shortage of data and had assumed that a criminal record would be one easy way to weed out the bad eggs.

But when the bank ran the numbers, they discovered that although about half of the people applying for low-end, high-interest-rate credit had a police record, this did not seem to reflect on payment outcomes. I suspect the reason was that the people with no police record were the middle 50%. At the bottom were 25% who had a police record for some kind of bad behavior. At the top were 25% who had a police record for exceptionally good behavior, like refusing to pay bribes or to overlook corruption.

The moral of this story is that numbers do not tell us everything. Do we end up focusing on price because we can measure it, to the exclusion of other things that matter? This phenomenon has rendered the airline business largely unprofitable – and customers increasingly unhappy. Quality used to be included in the price of a ticket; now, with surcharges for seat selection, meals, and the like, customers are charged for it separately.

In short, the paradox of choice (as elegantly described in an eponymous book by Barry Schwartz) is that too many choices confuse us and raise the possibility of regret; how can we be sure that we are getting just what we want, and that something else would not be better?

Or it may be that the greatest happiness of all comes from not having to worry about stuff like this.



Copyright: Project Syndicate, 2013.
www.project-syndicate.org

 


This article is brought to you by Project Syndicate that is a not for profit organization.

Project Syndicate brings original, engaging, and thought-provoking commentaries by esteemed leaders and thinkers from around the world to readers everywhere. By offering incisive perspectives on our changing world from those who are shaping its economics, politics, science, and culture, Project Syndicate has created an unrivalled venue for informed public debate. Please see: www.project-syndicate.org.

Should you want to support Project Syndicate you can do it by using the PayPal icon below. Your donation is paid to Project Syndicate in full after PayPal has deducted its transaction fee. Facts & Arts neither receives information about your donation nor a commission.

 

 

Browse articles by author

More Current Affairs

Dec 14th 2019
EXTRACT: "Conspiracy theories about sinister Jewish power have a long history. The Protocols of the Elders of Zion, a Russian forgery published in 1903, popularized the notion that Jewish bankers and financiers were secretly pulling the strings to dominate the world. Henry Ford was one of the more prominent people who believed this nonsense."
Dec 13th 2019
EXTRACT: "In previous British elections, to say that trust was the main issue would have meant simply that trust is the trump card – whichever leader or party could secure most trust would win. Now, the emerging question about trust is whether it even matters anymore."
Dec 5th 2019
EXTRACT: "Europe must fend for itself for the first time since the end of World War II. Yet after so many years of strategic dependence the US, Europe is unprepared – not just materially but psychologically – for today’s harsh geopolitical realities. Nowhere is this truer than in Germany."
Nov 23rd 2019
Extdact: "The kind of gratitude expressed by Vindman and my grandfather is not something that would naturally occur to a person who can take his or her nationality for granted, or whose nationality is beyond questioning by others. Some who have never felt the sharp end of discrimination might even find it mildly offensive. Why should anyone be grateful for belonging to a particular nation? Pride, perhaps, but gratitude? In fact, patriotism based on gratitude might be the strongest form there is."
Nov 20th 2019
Extract: "Moody’s, one of the big three credit rating agencies, is not upbeat about the prospects for the world’s debt in 2020 – to put it mildly. If we were to try to capture the agency’s view of where we are heading on a palette of colours, we would be pointing at black – pitch black."
Nov 17th 2019
Extract: "Digital money is already a key battleground in finance, with technology firms, payment processing companies, and banks all vying to become the gateway into the burgeoning platform-based economy. The prizes that await the winners could be huge. In China, Alipay and WeChat Pay already control more than 90% of all mobile payments. And in the last three years, the four largest listed payment firms – Visa, Mastercard, Amex, and PayPal – have increased in value by more than the FAANGs (Facebook, Apple, Amazon, Netflix, and Google)."
Nov 14th 2019
Extract: "Trump, who understands almost nothing about governing, made a major mistake in attacking career public officials from the outset of his presidency. He underestimated – or just couldn’t fathom – the honor of people who could earn more in the private sector but believe in public service. And he made matters worse for himself as well as for the government by creating a shadow group – headed by the strangely out-of-control Rudy Giuliani, once a much-admired mayor of New York City, and now a freelance troublemaker serving as Trump’s personal attorney – to impose the president’s Ukraine policy over that of “the bureaucrats.” "
Nov 4th 2019
Extract: "Trump displays repeated and persistent behaviours consistent with narcissistic personality disorder and antisocial personality disorder. These behaviours include craving for adulation, lack of empathy, aggression and vindictiveness towards opponents, addiction to lying, and blatant disregard for rules and conventions, among others." The concern is that leaders with these two disorders may be incapable of putting the interests of the country ahead of their own personal interests. Their compulsive lying may make rational action impossible and their impulsiveness may make them incapable of the forethought and planning necessary to lead the country. They lack empathy and are often motivated by rage and revenge, and could make quick decisions that could have profoundly dangerous consequences for democracy.
Oct 31st 2019
EXTRACT: "......let’s see what happens when we have less money for all the things we want to do as a country and as individuals. Promises and predictions regarding Brexit will soon be tested against reality. When they are, I wouldn’t want to be one of Johnson’s Brexiteers."
Oct 21st 2019
EXTRACT: "Were Israel to be attacked with the same precision and sophistication as the strike on Saudi Arabia, the Middle East would be plunged into war on a scale beyond anything it has experienced so far. Sadly (but happily for Russian President Vladimir Putin), that is the reality of a world in which the US has abandoned any pretense of global leadership."
Oct 20th 2019
EXTRACT: "Europe also stands to lose from Trump’s abandonment of the Kurds. If, in the ongoing chaos, the thousands of ISIS prisoners held by the Kurdish-led Syrian Democratic Forces escape – as some already have – America’s estranged European allies will suffer. Yet Trump is unconcerned. “Well, they are going to be escaping to Europe, that’s where they want to go,” he remarked casually at a press conference. “They want to go back to their homes." "
Oct 15th 2019
EXTRACT: "Assuming the House ultimately votes to impeach Trump, the fact remains that there are far fewer votes in the Senate than will be needed to convict him and remove him from office. But the willingness of Congress – including the Senate – to continue tolerating his dangerous conduct in office, including threats to US national security, is now truly in question."
Oct 7th 2019
EXTRACT: "The problem didn't start with the election of Donald Trump. Nor did it begin with the Democrats launching an impeachment inquiry against Trump. This is a developing crisis that has been growing like a cancer within our polity for at least the past 25 years. Its main symptoms are a lack of civility in our political discourse, a "take no prisoners" mindset, and a denial of the very legitimacy of "the other side." Trump didn't create this crisis; he was the result of it.   When Newt Gingrich took the helm of Congress in 1995, unlike previous Republican leaders, he embarked on a campaign not only to obstruct the efforts of then President Clinton, but to destroy him. Congress launched a series of investigations accusing Clinton of everything from corruption to obstruction of justice – with hints of even more nefarious plots to assassinate those who might pose a problem to his presidency.  "
Oct 4th 2019
EXTRACT: "As the story spreads, it grows darker. Meanwhile, Trump is trying to learn the identity of the whistleblower (who is protected by law), which could expose that person to great danger. And he is accusing some people – including Adam Schiff, the chair of the House Intelligence Committee – of treason. My sense is that Trump fears the tough, focused Schiff. Trump has ominously noted that traitors used to be shot or hanged. And he hasn’t helped himself with members of either party by declaring, in one of his hundreds of febrile tweets, that forcing him from office could lead to a “civil war.” Trump has taken the United States somewhere it’s never been before. His presidency may not survive it."
Sep 24th 2019
EXTRACT: "But regardless of whether the Ukraine scandal remains front-page news, it will haunt the US intelligence community, which has been Trump’s bête noire since the day he took office. Trump has relentlessly attacked US intelligence agencies, cozied up to Russian President Vladimir Putin, and divulged secrets to foreign officials, potentially burning high-value sources. This behavior had already raised serious concerns about whether Trump can be trusted to receive sensitive intelligence at all. Now, intelligence leaders must ask themselves how far they are willing to go in toeing the White House line."
Sep 21st 2019
EXTRACT: "As Lobaczewski pointed out, pathological leaders tend to attract other people with psychological disorders. At the same time, empathetic and fair-minded people gradually fall away. They are either ostracised or step aside voluntarily, appalled by the growing pathology around them.......As a result, over time pathocracies become more entrenched and extreme. You can see this process in the Nazi takeover of the German government in the 1930s, when Germany moved from democracy to pathocracy in less than two years.......In the US, there has clearly been a movement towards pathocracy under Trump. As Lobaczewski’s theory predicts, the old guard of more moderate White House officials – the “adults in the room” – has fallen away. The president is now surrounded by individuals who share his authoritarian tendencies and lack of empathy and morality. Fortunately, to some extent, the democratic institutions of the US have managed to provide some push back."
Sep 16th 2019
EXTRACT: "If the Supreme Court does agree with the Divisional Court that the question is political rather than legal, it will take the UK constitution into quite peculiar territory. Prime ministers will be the new kings and queens. They will be free to suspend parliament at will, and for as long as they wish, without any judicial interference. Parliament will meet not out of constitutional necessity but in the service of the government’s interests – namely, to pass its legislation and to maintain appearances, rather than to hold it to account."
Sep 12th 2019
Extract: "The Republican Party has lashed its fate to an increasingly unhinged leader. Though three other presidential hopefuls for 2020 now stand in Trump’s way, none can defeat him. But they can damage his reelection effort, which is why the Republican Party has been scrapping some primaries and caucuses. How well Trump does in November next year may well depend on how his fragile ego withstands the coming months."
Sep 2nd 2019
EXTRACTS: "Most people think of revolutions as sudden earthquakes or volcanic eruptions that come without warning and sweep away an entire political system. But historians, political scientists, and even the odd politician know that the reality is very different: revolutions happen when systems hollow themselves out, or simply rot from within. Revolutionaries can then brush aside established norms of behavior, or even of truth, as trivialities that should not impede the popular will............ Only time will tell whether we are currently witnessing the hollowing out of British democracy. But Prime Minister Boris Johnson may well have crossed some invisible Rubicon by.......... Whatever happens now, British parliamentary democracy may never be the same again. It will certainly never again be the model that so many people around the world once admired."
Aug 29th 2019
EXTRACT: "Events such as prorogations and dissolutions happen when countries face difficult times. Therefore, because of the disastrous effects of Brexit: sterling in freefall; a recession looming on the horizon and Britain’s international standing at its lowest ebb since Suez, it is no surprise that the country is in this position now. The worrying thing is that using the monarchical power of prorogation does not solve problems – it has a history of turning them into frightening and often violent crises. There is a worrying relationship between the use of such powers and a complete breakdown in government."