Oct 23rd 2013

Measure for Mismeasure

by Esther Dyson

Esther Dyson, CEO of EDventure Holdings, is an active investor in a variety of start-ups around the world. Her interests include information technology, health care, private aviation, and space travel.

ISTANBUL – I recently used Uber (an online service for ordering a car and driver) and did not have the usual pleasant experience. The driver did not know the area, and, worse, he did not follow his navigator’s instructions, turning left instead of right. When Uber asked me, as usual, to rate the driver, I did not hesitate to give him two out of five. I was not being vindictive; I wanted to save other passengers from an unpleasant experience, and I hoped that maybe feedback would encourage him to improve or find another line of work.

But what does two out of five mean? It obviously means worse than average, which would be three. But, while I would always pick an average driver over a driver with a rating of two, given the choice between a two driver and a blind pick, I might pick the two, because the fear of someone even worse would keep me from taking a risk. This is a well-known phenomenon known as loss aversion: the risk of a one outweighs the hope of a five.

Just last week, I was engaged in ranking proposals for the Knight News Challenge; to simplify things, they had a three-point ranking: three for yes, two for consider, one for reject. The idea was to pick the easy winners, reject the losers, and focus on distinguishing among the maybes. That makes sense in the context of focusing attention where a decision is needed.

Ranking exercises, like the things they rank, are not all the same; different approaches fit different situations. We live in a world where everything is being rated, whether you are a professional judge or an individual trying to make sense of modern life. Indeed, while we rate the Uber drivers, they are rating us.

Consider a business plan or a foundation grant proposal. One proposal might be ranked nine out of ten, while another is eight out of 20; the first is pretty good but with limited upside, while the second is not so good, but has the potential to be great. The two cannot really be compared: One is a safe choice, but not likely to have a huge impact; the other is riskier, but ultimately may be more worthwhile. If you are a customer buying a product that should work, you want the nine out of ten; if you are a venture capitalist who thinks she can add value, you want the eight out of 20.

Helping people to think clearly about these numbers is important. People want simplicity, yet at the same time, in a world of targeted marketing, customization, and precision, in which vendors struggle to give consumers exactly what they want, people can help themselves by thinking clearly and specifying their preferences.

Imagine that you have cancer. The doctor says that you probably have two years to live, or a 50% expected improvement in “survival” (medical terminology for living another five years) if you undergo chemotherapy. In other words, you can have two years of gradual decline with some pain, or three years of nauseating treatments, “chemo brain,” loss of hair, and diminished dignity.

If you think those numbers are not quite comparable, you are right; that is part of the problem. (And the numbers may be based on a limited sample of people who do not quite resemble you.) But, while the timing is uncertain, the trade-offs are pretty clear. What you really want, of course, is a cure, not merely a minimal extension of life expectancy, but nothing is certain. The choice sounds easy, but then perhaps you just want to survive to see your daughter graduate, or your son get married. It would be nice to understand those numbers better.

Even on the population level, we are facing some of the same complexities at HICCup (the Health Initiative Coordinating Council), a startup that I founded. How do you measure health improvement? It is not, as one benighted analyst suggested, “A 20% improvement (reduction) in heart attacks plus a 30% improvement (reduction) in diabetes incidence equals a 50% improvement.” You need to average the improvements to get a figure somewhere between 20% and 30%. But how do you weight diabetes versus heart attacks, life extension versus quality of life?

There is also, in any sector, the issue of what the data really mean. One of my favorite (sad) stories concerns consumer credit ratings in Russia. A retail banker once told me that in making credit decisions in Russia, his analysts had faced a shortage of data and had assumed that a criminal record would be one easy way to weed out the bad eggs.

But when the bank ran the numbers, they discovered that although about half of the people applying for low-end, high-interest-rate credit had a police record, this did not seem to reflect on payment outcomes. I suspect the reason was that the people with no police record were the middle 50%. At the bottom were 25% who had a police record for some kind of bad behavior. At the top were 25% who had a police record for exceptionally good behavior, like refusing to pay bribes or to overlook corruption.

The moral of this story is that numbers do not tell us everything. Do we end up focusing on price because we can measure it, to the exclusion of other things that matter? This phenomenon has rendered the airline business largely unprofitable – and customers increasingly unhappy. Quality used to be included in the price of a ticket; now, with surcharges for seat selection, meals, and the like, customers are charged for it separately.

In short, the paradox of choice (as elegantly described in an eponymous book by Barry Schwartz) is that too many choices confuse us and raise the possibility of regret; how can we be sure that we are getting just what we want, and that something else would not be better?

Or it may be that the greatest happiness of all comes from not having to worry about stuff like this.



Copyright: Project Syndicate, 2013.
www.project-syndicate.org

 


This article is brought to you by Project Syndicate that is a not for profit organization.

Project Syndicate brings original, engaging, and thought-provoking commentaries by esteemed leaders and thinkers from around the world to readers everywhere. By offering incisive perspectives on our changing world from those who are shaping its economics, politics, science, and culture, Project Syndicate has created an unrivalled venue for informed public debate. Please see: www.project-syndicate.org.

Should you want to support Project Syndicate you can do it by using the PayPal icon below. Your donation is paid to Project Syndicate in full after PayPal has deducted its transaction fee. Facts & Arts neither receives information about your donation nor a commission.

 

 

Browse articles by author

More Current Affairs

Nov 24th 2024
Extracts: "We all think, speak, and write within certain intellectual frameworks that we largely take for granted. But, eventually, the passage of time renders familiar categories and ideas obsolete. For example, who still talks about the “Soviet Union” today, apart from historians?" ------- "Trump won decisively despite his contempt for democratic institutions, his efforts to overturn the 2020 election, and his subsequent 34-count felony conviction. Though voters know about his chaotic approach to governance, his habitual mendacity, and his sinister immigration policies, he won every swing state. Even with full knowledge of who Trump is, more Americans voted for him than for Kamala Harris. We must not mince words: liberal democracy in the US has suffered a lethal blow. It will be under increasing pressure on both sides of the Atlantic, and there is no guarantee that it will survive. After all, can there be any future for the liberal West without the US as its leader? I believe the answer is no." ----- "If Europe fails to come together at this moment of tumultuous change, it will not get a second chance. Its only option is to become a military power capable of protecting its interests and securing peace and order on the world stage. The alternative is fragmentation, impotence, and irrelevance."
Nov 24th 2024
EXTRACTS: "When the US presidential election was called for Donald Trump, the yield on ten-year US government bonds increased from 4.3% to 4.4%, and the 30-year-bond yield rose from 4.5% to 4.6%, with both remaining at those levels ten days later." ----- " Clearly, investors expect the next Trump administration to produce higher government budget deficits and more debt. It is not difficult to see why. During Trump’s first term in office, he added $8 trillion to the national debt – all previous presidents combined had accumulated $20 trillion – despite having promised to run budget surpluses so large that they would eliminate the national debt within two terms." ----- "Supporters often say that a businessman like Trump or Musk will know how to put America’s fiscal house in order. But the smart money says they have no idea what they are doing."
Nov 13th 2024
EXTRACT: "For 2,300 years, at least since Plato’s Republic, philosophers have known how demagogues and aspiring tyrants win democratic elections. The process is straightforward, and we have now just watched it play out." ........ "As Jean-Jacques Rousseau argued, democracy is at its most vulnerable when inequality in a society has become entrenched and grown too glaring." ..... "From everything Trump has said and done during this campaign and in his first term, we can expect Plato to be vindicated once again. The Republican Party’s domination of all branches of government would render the US a one-party state. The future may offer occasional opportunities for others to vie for power, but whatever political contests lie ahead most likely will not qualify as free and fair elections."
Nov 3rd 2024
EXTRACT: "The likelihood of escalation in the coming weeks and months means that there will be economic and financial risks to manage. A large-enough Israeli strike on Iran could severely disrupt energy production and exports from the Gulf. If Iran gets desperate, it could try to mine the Gulf and block the Strait of Hormuz, while also striking Saudi oil facilities. In this scenario, the world would experience stagflationary shocks similar to those that followed the 1973 Yom Kippur War and the 1979 Iranian revolution."
Oct 9th 2024
EXTRACT: "The continuing cycles of violence can easily spiral out of control, precipitating a wider war involving nuclear powers. Moreover, Netanyahu’s goal of 'total victory' against an ideological movement cannot be achieved by military means alone." ..... "So long as both sides seek to inflict maximum damage on the other to right past wrongs, the violence will not end. Netanyahu may think that total victory is in sight, now that Hezbollah is badly damaged and Gaza reduced to rubble, but that is an illusion. All he has done is create more enemies who will want to restore their honor by killing in a war without end."
Oct 9th 2024
EXTRACTS: "Nasrallah was on a mission to destroy Israel. It was a mantle he had taken up from countless other Arab leaders, from Haj Amin al-Husseini, the grand mufti of Jerusalem who met with Adolf Hitler in 1941 to discuss the destruction of the Jews, to Azzam Pasha, the secretary-general of the Arab League who described the Arab invasion of the then-nascent Israel in 1948 as a 'war of annihilation'. Egyptian President Gamal Abdel Nasser – an icon of pan-Arabism in the 1950s and 1960s – pledged more than once to 'destroy Israel'. Iraqi dictator Saddam Hussein and the Palestinian leader Yasser Arafat, who founded Fatah, nurtured their own dreams of liquidating the Jewish state." ...... "Alas, Israelis have built their own dangerous dream palace of 'total victory', erected on a foundation of nationalist fervor, religious messianism, and political intransigence. There is a scenario in which Israel’s military exploits change the region for the better. Unfortunately, far from being the standard-bearer for some enlightened political vision, Israel’s current government is committed to fighting a war on all fronts, with no view toward any political future that Israel’s neighbors could possibly accept."
Oct 8th 2024
EXTRACT: "But in the real world, slain leaders are replaced. Those who bury their dead do not forget or forgive, and those who have felt the punishment of arms do not forego weapons but embrace them. So it seems unlikely that’s how the story will end. Sadly, it’s far more likely it will never end."
Oct 3rd 2024
EXTRACT: ".....,Russia will probably spend about $190 billion, or 10% of GDP, on the war this year, and that figure presumably represents the peak, given the constraints imposed by Western financial sanctions. Whenever Russia can no longer finance a budget deficit, it will have to cut public expenditures, and its non-military outlays have already been pared to the bone."
Sep 12th 2024
EXTRACT: "Throughout recorded history, crises and tragedies have inevitably spurred apocalyptic interpretations that seek to imbue temporal catastrophes with some divine or redemptive meaning. One can see this in the doctrines of the major monotheistic religions, and even in modern totalitarian ideologies, such as communism and Nazism. One way or another, humans appear inclined to believe that, without Satan, there is no redeemer. To understand just how dangerous this logic can be, look no further than Gaza, where a tragedy of Biblical proportions is fueling the messianic hallucinations of Israel, Hamas, and American Christian evangelicals alike."
Aug 7th 2024
EXTRACT: "China knows that the war has had catastrophic consequences for both Russia and Ukraine. Estimates indicate that Putin’s conflict in Ukraine could cost Russia US$1.3 trillion (£1.0 trillion) and at least 315,000 in troop casualties. So, win or lose, the post-war damage to Russia would be immense. This is bad news for China. Not only will it have a weakened ally, but the west could then have a free hand to consolidate its resources in dealing with the 'Chinese threat'."
Jul 27th 2024
EXTRACT: "......, regardless of the folly of political violence, the attempt on Trump’s life was futile inasmuch as ridding America, and the world, of Trump, would by no means rid us of Trumpism, which was and remains a symptom, and not the root cause, of this country’s moral and epistemic decline. How else could so many millions of Americans support this man? No one can claim that they do not know what he stands for (insofar as he stands for anything other than himself) or what his intentions are: he has made it very clear that his second administration will be not only authoritarian, but fascist in rhetoric and deed.
Jul 17th 2024
EXTRACTS: "Iran unveiled a digital clock counting down the days to the destruction of Israel in 2040. The display, located in Tehran’s Palestine Square, embodies the Islamic Republic’s long-held commitment to annihilating the Jewish state. Some view this promise as a mere rhetorical exercise...." ----- "From Adolf Hitler to Vladimir Putin and even Osama bin Laden, history has taught us to take threats of ideologically inspired attacks at face value. " ---- "......., the key enabler of Iran’s war of attrition is, in fact, Israel’s own government. Netanyahu’s unrealistic goal of achieving 'a complete victory' in Gaza serves Iran’s strategy of miring Israel in an inconclusive conflict while orchestrating a long-term plan to destroy the Jewish state." ----- "It turns out that the only truly irrational, trigger-happy fanatics in this lethal equation are Netanyahu and his theo-fascist allies, who are determined to engage in an apocalyptic war in Gaza and Lebanon." ---- "These messianic hallucinators have a willing collaborator in Netanyahu. Together, they are doing more to annihilate the Jewish national project than Iran could ever hope to achieve on its own."
Jul 16th 2024
EXTRACTS: "In her dissenting opinion in Trump v. United States, Supreme Court Justice Sonia Sotomayor declared that with the majority’s ruling, 'the President is now a king above the law'. In this, she is wrong: the majority opinion has given the US president far more power than English kings had at the time of the American Revolution." ---- "In June 1686, 11 of the 12 hand-picked justices ruled in favor of the king. Echoing the king’s own solicitor, Sir Thomas Powys, the Lord Chief Justice George Jeffreys contended that if the king did not have leeway above the law, 'the preservation of the government' might be in jeopardy." ---- "In 1689, the English people roundly rejected such reasoning and asserted that their kings would thereafter be subject to the law. They set a precedent by removing James II from office. The Supreme Court’s decision goes beyond threatening more than two centuries of American jurisprudence; it overturns four centuries of Anglo-American jurisprudence. The Roberts majority did not give the president the power of an English king; it gave the president power that an English king could only covet."
Jul 4th 2024
EXTRACT: "Most American voters who believe that Trump is the best defender of democracy are not fascists, much less communists. The very thought would horrify them. But they almost surely have a strong opinion on who constitutes the true American people: God-fearing, hard-working, and most probably white. And they worry that these ordinary Americans are being displaced by illegal immigrants, and that their way of life is being threatened by new ideas about gender, race, and sexuality emerging from elite universities. Trump is stoking these fears and exaggerating these threats. His line that the US courts are attacking not only him, but every right-thinking American is horribly effective. Since he is heard as the true voice of the people, he is the purest democrat. As a result, liberal democracy might not withstand another four years of his rule."
Jul 3rd 2024
EXTRACT: "....the debate showed all too clearly that he is suffering cognitive decline and cannot possibly serve as a competent president for another four years. If Biden is true to his word, and stopping Trump from regaining the presidency is his overriding goal, he needs to announce that at the Democratic Convention in August, he will release his delegates from their obligation to vote for him, and instead ask them to vote for the candidate with the best chance of defeating Trump."
Jul 3rd 2024
EXTRACTS: "Both Chief Justice John Roberts and Justice Sonia Sotomayor of the United States Supreme Court have just announced grand opinions trying to resolve the fundamental constitutional issues raised by former President Donald Trump’s claim to absolute immunity" ---- "According to Sotomayor, who wrote for the three dissenting justices, Roberts’ sweeping grant of immunity has 'no firm grounding in constitutional text, history, or precedent.' ” ----- "For what it’s worth, I think that Sotomayor is right and Roberts is wrong." ----"But for now, it is much more important to consider the objection raised by Justice Amy Coney Barrett to both Roberts’ constitutional glorification of the presidency and Sotomayor’s devastating critique of Roberts’ majority opinion." ---- "Barrett is right to ask why Roberts and Sotomayor did not join her in adopting the problem-solving approach that they have repeatedly endorsed in many other contexts." ---- "Roberts took the path that not only betrayed Founding principles, as Sotomayor argued, but also betrayed the very principles to which he has dedicated his entire career. "
Jul 1st 2024
EXTRACTS: "Netanyahu’s disdainful criticism of Biden. Netanyahu knows how indispensable the US is to Israel, as no country has provided Israel with more financial, military, and political support than the US. And no American president has ever been more supportive and committed to Israel's security than President Biden. But then, leave it to the most loathsome Netanyahu, who dares to criticize the president for suspending the shipment specifically of 2,000-pound bombs to continue with his devastating bombardment of Rafah that could indiscriminately kill thousands of innocent civilians." ---- "All Israelis who care about their country’s future must rise and demand the immediate resignation of this corrupt and brazen creature who inflicted untold damage on the only Jewish state, making it a pariah state."
Jun 12th 2024
EXTRACTS: "One of the more amusing exercises on the economic calendar is the International Monetary Fund’s annual review of the United States. Yet while everyone knows that the US government pays absolutely no heed to what the IMF has to say about its affairs, the Fund’s most recent Article IV review of the US economy is striking for one unexpected finding. Readers will be startled to learn that, in the IMF’s estimation, US government debt is on a sustainable path." ---- "What then could go wrong? Well, US institutions could turn out not to be so strong. Donald Trump has a personal history of defaulting on his debts. As William Silber has observed, Trump in a second presidential term could instruct his Treasury secretary to suspend payments on the debt, and neither Congress nor the courts might be willing to do anything about it. The gambit would be appealing to Trump insofar as a third of US government debt is held by foreigners. The damage to the dollar’s safe-asset status would be severe, even if Congress, the courts, or a subsequent president reversed Trump’s suspension of debt payments. Investors in US Treasuries would demand a hefty risk premium, potentially causing the government’s interest payments to explode."
Jun 9th 2024
EXTRACT: "An all-too-familiar specter is haunting Europe, one that reliably appears every five years. As citizens head to the polls to elect a new European Parliament, observers are once again asking whether far-right anti-European parties will gain ground and unite to destroy the European Union from within. To be sure, skeptics of this doomsday scenario have always argued that the far right will remain divided, because nationalist internationalism is a contradiction in terms. But it is more likely that specific policy disagreements – mainly over the Ukraine war – and drastically diverging political strategies will prevent Europe’s various far-right parties from forming a 'supergroup.' ”
Jun 9th 2024
EXTRACT: "While the dreadful legacy of his Conservative predecessors – the morally vacuous Johnson and the reckless Liz Truss – would make it extremely difficult for Sunak to offer a credible vision of a better future, many of his current problems are self-inflicted. For example, he supported Johnson’s bid for the Conservative leadership, a decision that reflects poorly on his judgment. Sunak has also been a Euroskeptic since he was a schoolboy and was an early supporter of Brexit."