Psychologist Philip Tetlocks warning that the average expert is roughly as accurate as a dart-throwing chimpanzee has assumed Talmudic weight as the world awaits the results of next months U.S. presidential election. Donald Trumps victory in the 2016 vote after elections guru Nate Silver said he had only a 29% chance of winning the electoral college was widely viewed as a stake through the heart of statistics-led political punditry and fuels a belief among the right and the left that his re-election is imminent.
A more accurate conclusion is that most observers misunderstood and misapplied Silvers analysis: Silver was saying that in roughly one out of every three elections Trump would win. That failure wasnt the fault of experts and pundits alone. Rather, it reflects shortcomings that are built into the way we think about the world and are capable of being fixed (to some degree.)
Given that virtually every decision is to some degree a prediction where shall we go for dinner? makes assumptions about a future experience it is remarkable just how bad we as a species are at it. Ancient civilizations credited the crazed and addled for insight, or were willing to seek destinies in entrails, excrement or the stars. Weve advanced considerably in technique although horoscopes remain popular but the future remains as unknowable as ever.
Nobel Prize-winning economist and psychologist Daniel Kahneman argues that we make sense of a complex world with heuristics mental shortcuts or rules and biases derived from experience that allow us to substitute simpler problems for more difficult ones. Unfortunately, his work demonstrates that those shortcuts frequently dont work as intended. We are rarely equipped with the numeracy or the patience to apply them properly and as a result we poorly anticipate correctly what the future will bring.
That failure assumes greater significance when we move from decisions of personal importance to those of policy. Tetlock and J. Peter Scoblic note that every policy is a prediction, one that posits a causal relationship between means and ends. Every policy choice argues that doing X now will lead to Y outcome. For example, tax cuts will stimulate economic growth or building this missile will promote peace. Getting it wrong can be deadly. The COVID-19 crisis is a failure of imagination a failure to accurately forecast the future and as a result government planning and budgets reflected traditional definitions of security and left us struggling when a novel virus emerged. Getting cause and effect right in international affairs is especially tough, but it is getting exponentially harder as the world transforms and the mental maps that policymakers use for their analyses their heuristics are quickly outdated.
The COVID failure has policymakers scrambling to fill the gap. In their latest effort Tetlock and Scoblic advise policymakers to combine probabilistic forecasting and scenario planning for the best results. It isnt an intuitive mix: The two approaches make fundamentally different assumptions about the future. Scenario planners start with the belief that there are so many possible futures that plausibility, not probability, is what matters. They then try to identify those futures. Decision-makers complain that understanding the contours of those imaginings isnt enough. There needs to be some sense of likelihood, which is where forecasters enter the picture: They try to calculate the odds of possible outcomes. Tetlock and Scoblic conclude that a holistic approach that combines the two would provide policymakers with both a range of conceivable futures and regular updates as to which one is likely to emerge.
Intriguing as this may be the newest issue of Foreign Affairs is titled What are We Missing? Predicting the Next Crisis far more interesting and more relevant to most readers is Tetlocks earlier work on forecasting that explains our inability to predict the future and offers suggestions on how to improve.
I may be digging my own grave, but I have to start with one of Tetlocks most important conclusions: Experts are especially bad forecasters. Not only are their predictions no better than random guesses, but they are often outperformed by amateur news junkies. According to Tetlocks research (and borrowing from Isaiah Berlin), foxes individuals who know a lot about many different subjects, accept complexity and are open-minded and curious invariably outperform hedgehogs, those who dig deep and know a lot about a single thing. The best forecasters accept uncertainty, and continually assess, update and revise their analyses. They are not wedded to conclusions or belief structures, and they constantly search for clues and analogies, which may not be obvious, to inform their logic and reasoning.
Ironically, Tetlock found an inverse correlation between fame and accuracy; the most famous experts had the worst records of prediction. Among other factors, he blamed the media, which demands short, simple and compelling stories, devaluing the nuance that lengthens and complicates a narrative and which invariably renders it more accurate. As Tetlock explained, experts are just human in the end. They are dazzled by their own brilliance and hate to be wrong. Experts are led astray not by what they believe, but by how they think.
There is hope. People can be taught to be better forecasters. A critical skill is numeracy: Success demands an understanding of statistics and probabilities and the ability to use them properly. To go back to 2016, the odds on a Trump victory were long but statistics still indicated that he would win one out of every three elections not one out of every three votes. Its a simple example but it is revealing about how many people think.
Equally valuable is the wisdom of the crowd, or at least similarly oriented teams. Open-minded thinkers use teams to provide insight into areas which they might not master, and as counterweights to their biases, reasoning and conclusions. Success depends on the avoidance of group think that neuters doubt and silences criticism. While conclusions must be reached, it is important to see all sides of a question and moderate certainties by incorporating opposing views.
Finally, there are ways to structure inquiries to improve accuracy. One important step is deconstructing questions into smaller discrete queries that may be easier to answer. Think of the future as a series of steps and anticipate the likelihood of each. Breaking down the future will also help separate the knowable from the unknowable and save time (and credibility) on the issues that can in some way be ascertained. Being able to ascribe probabilities to those intermediate steps is also valuable. Assess your record and try to learn from success and failure. Good forecasters are constantly updating data and processes. And, dont try to look too far into the future: There are too many variables to have confidence in judgments that peer too far ahead.
Self-awareness of limits and flaws, especially biases, is essential. Once that understanding is internalized, practice. It is worth the effort. Tetlock administered Department of Defense-sponsored forecasting competitions open to the general public and the top performers had scores that were 30 percent better than those of career CIA analysts with access to classified information.
Of course, foresight doesnt guarantee that insights will be used. Organizations have many ways, some bold, some banal, to obstruct the use of even the most accurate predictions, a phenomenon that stretches back more than 2,000 years. Google COVID Cassandra nearly 36 million hits for proof.
I predict that we will continue to be flummoxed and frustrated by the future. Moreover, we will repeatedly be blindsided by events that some will have anticipated but our leaders ignored. Does that get me a banana?
Brad Glosserman is deputy director of and visiting professor at the Center for Rule Making Strategies at Tama University as well as senior adviser (nonresident) at Pacific Forum. He is the author of Peak Japan: The End of Great Ambitions (Georgetown University Press, 2019).
PHOTO GALLERY (CLICK TO ENLARGE)
See the rest here:
It's hard to make predictions, especially about the future but it's not impossible - The Japan Times
- RFK Jr.s brain worm has a Talmudic history and may be a punishment for eating pork - Forward - May 15th, 2024 [May 15th, 2024]
- Why South Koreans are in love with Judaism - The Jewish Chronicle - May 15th, 2024 [May 15th, 2024]
- Contemplating mutual responsibility ahead of Independence Day - The Jerusalem Post - May 15th, 2024 [May 15th, 2024]
- Take One, Talmud to Go Bava Metzia 72 and 73 - Tablet Magazine - May 15th, 2024 [May 15th, 2024]
- Talmudic Grappling is Alive and Well at Milken Conference - Jewish Journal - May 15th, 2024 [May 15th, 2024]
- Israel's Independence Day is a time for mourning and celebration - Opinion - The Jerusalem Post - May 15th, 2024 [May 15th, 2024]
- Honoring EFRAT: An organization that provides support to parents - The Jerusalem Post - February 18th, 2024 [February 18th, 2024]
- For the Yehudim There Was Light - COLlive - February 18th, 2024 [February 18th, 2024]
- Book Review: Subculture Vulture, by Moshe Kasher - The New York Times - January 29th, 2024 [January 29th, 2024]
- Palestine, the Jews, the Talmud and the Aleppo Codex | Jaime Kardontchik | The Blogs - The Times of Israel - January 29th, 2024 [January 29th, 2024]
- Israel-Hamas War: Yearning for children lost before their time - The Jerusalem Post - January 29th, 2024 [January 29th, 2024]
- Roots, Midrash and Tu B'Shvat | Gershon Hepner | The Blogs - The Times of Israel - January 29th, 2024 [January 29th, 2024]
- Emotional moments as awards are given out to the talmidim of Talmud Torah Kollel Shomrei Hachomos Rockland Daily - Rockland Daily - January 23rd, 2024 [January 23rd, 2024]
- The People's Talmud Presents: RANDOM Brain Teasers - The Jewish Press - JewishPress.com - January 23rd, 2024 [January 23rd, 2024]
- Why the Jewish Word for Heretic Is Based on Epicurus - Greek Reporter - January 23rd, 2024 [January 23rd, 2024]
- War, Talmud, and agriculture - opinion - The Jerusalem Post - December 28th, 2023 [December 28th, 2023]
- Claims on 'Canaan' by Africans and Arabs in the Talmud - The Times of Israel - December 28th, 2023 [December 28th, 2023]
- Berakhot (tractate) - Wikipedia - January 4th, 2023 [January 4th, 2023]
- Talmud and Midrash | Definition, Books, Examples, & Facts - January 4th, 2023 [January 4th, 2023]
- The William Davidson Talmud The William Davidson Talmud - December 26th, 2022 [December 26th, 2022]
- Switching My Kids to This Jewish Day School from Public School Was a Godsend and Came Just in Time - Kveller.com - December 23rd, 2022 [December 23rd, 2022]
- Humans of Heller High: What nine teens learned on an immersive program in Israel - JTA News - Jewish Telegraphic Agency - December 16th, 2022 [December 16th, 2022]
- Jesus in the Talmud - Wikipedia - November 23rd, 2022 [November 23rd, 2022]
- The Oral Law -Talmud & Mishna - Jewish Virtual Library - October 23rd, 2022 [October 23rd, 2022]
- Creating Humanity and Midrash in the Divine Image - Jewish Exponent - October 19th, 2022 [October 19th, 2022]
- Help Jewish Federation do good that goes everywhere - Jewish Community Voice - October 19th, 2022 [October 19th, 2022]
- On the Turkish-Syrian border, a citys last Jews watch the ending of an epoch - JTA News - Jewish Telegraphic Agency - October 19th, 2022 [October 19th, 2022]
- Cate Blanchett gives what might be her best performance ever in TR - Cult MTL - October 19th, 2022 [October 19th, 2022]
- Revisiting The Campus Archives - New Voices - October 19th, 2022 [October 19th, 2022]
- Opinion | Wood column: Reliever Larry Sherry went from obscurity to fame in a moment - The Daily Advance - October 19th, 2022 [October 19th, 2022]
- The Moon Provides an All-Star Example of Sincere Repentance - Torah.org - October 19th, 2022 [October 19th, 2022]
- Was the fruit of the Tree of Life from which Adam and Eve ate really an apple? J-Wire - J-Wire Jewish Australian News Service - October 19th, 2022 [October 19th, 2022]
- Major raids into Al-Aqsa and the Occupation prevents worshipers from entering - Middle East Monitor - October 17th, 2022 [October 17th, 2022]
- Funny Girl Star Tovah Feldshuh on Sharing the Stage With Lea Michele and What the Talmud Says About Gossip - Variety - October 15th, 2022 [October 15th, 2022]
- No-bake 'millionaire' bars are a rich treat for a sweet Simchat Torah J. - The Jewish News of Northern California - October 15th, 2022 [October 15th, 2022]
- Jewish donations to support abortion rights groups are booming J. - The Jewish News of Northern California - October 15th, 2022 [October 15th, 2022]
- Superminis Remix Of The Phantom Of The Operas Title Song is Out Now - Yahoo Entertainment - October 15th, 2022 [October 15th, 2022]
- Joey Weisenberg coming to S.F. to help build 'singing communities' J. - The Jewish News of Northern California - October 15th, 2022 [October 15th, 2022]
- Islamic Tahrif Began With The Samaritans OpEd - Eurasia Review - October 13th, 2022 [October 13th, 2022]
- Rosh Hashanah threats show that Jewish students are being targeted - JNS.org - October 13th, 2022 [October 13th, 2022]
- Freedom to cycle The female Afghan refugees rediscovering life on the bike in Italy - CyclingWeekly - October 13th, 2022 [October 13th, 2022]
- Rabbi: Lets recommit to one another and get the polio vaccine | Opinion - NJ.com - October 13th, 2022 [October 13th, 2022]
- How and when did the first synagogues appear in Ukraine, and why is this an important aspect of Ukrainian history (Pt. 1) - UJE - Ukrainian Jewish... - October 13th, 2022 [October 13th, 2022]
- The Facts about Pope John Paul I Novus Ordo Watch - October 11th, 2022 [October 11th, 2022]
- My ApologiesKanye West Isn't What I Told You - The Epoch Times - October 11th, 2022 [October 11th, 2022]
- A new cookbook highlights women of the Talmud - Press Herald - October 8th, 2022 [October 8th, 2022]
- The greatest contemporary teacher of Judaism is a van driver in Israel - Religion News Service - October 8th, 2022 [October 8th, 2022]
- Letter to the Editor: Rabbis do take political stands when morality, ethics and national threats are involved - Summit Daily - October 8th, 2022 [October 8th, 2022]
- Taking inspiration from the Talmud to feed the needy - Australian Jewish News - September 11th, 2022 [September 11th, 2022]
- Kenden Alfond Finds Culinary Inspiration from the Talmud - aish.com - Aish.com - September 11th, 2022 [September 11th, 2022]
- Missouri bagel shop goes viral for effort to feed the needy J. - The Jewish News of Northern California - September 11th, 2022 [September 11th, 2022]
- What Do Some of YU's Torah Leaders Think of the Five Torot? - The Commentator - The Commentator - September 11th, 2022 [September 11th, 2022]
- Gorbachev was different he had a heart - The Jewish Standard - September 11th, 2022 [September 11th, 2022]
- Love is a Skeleton Key - aish.com - Aish.com - September 11th, 2022 [September 11th, 2022]
- 50 Best Wine Quotes That Will Have You Breaking Out a Bottle Stat! - Parade Magazine - September 11th, 2022 [September 11th, 2022]
- We have faced Amaleks like Putin forever, but with morality we can prevail J. - The Jewish News of Northern California - September 11th, 2022 [September 11th, 2022]
- Being On The Team - The Jewish Press - JewishPress.com - September 11th, 2022 [September 11th, 2022]
- Twelve more Slovaks awarded Righteous Among the Nations - The Slovak Spectator - September 11th, 2022 [September 11th, 2022]
- West Temples Rabbi Lader to retire in June 2023 - Cleveland Jewish News - September 11th, 2022 [September 11th, 2022]
- A Texas rabbi is fighting Jewish stereotypes on Chinas TikTok - The Times of Israel - August 29th, 2022 [August 29th, 2022]
- I'm a Gamblin' Man: The 17th Century Rabbi who Battled Addiction - aish.com - Aish.com - August 29th, 2022 [August 29th, 2022]
- Q & A: The Mantle Of Leadership (Part II) - The Jewish Press - JewishPress.com - August 29th, 2022 [August 29th, 2022]
- Anger, Procrastination, and Elul - The Jewish Press - JewishPress.com - August 29th, 2022 [August 29th, 2022]
- What Is the Talmud? - Christianity.com - August 25th, 2022 [August 25th, 2022]
- The Choice: A Novel of Love, Faith, and the Talmud - reviewed by Rabbi Jeffrey Cohen J-Wire - J-Wire Jewish Australian News Service - August 25th, 2022 [August 25th, 2022]
- What If It Were 'Zalman'? - The Jewish Press - JewishPress.com - August 25th, 2022 [August 25th, 2022]
- Jewish law symposium to tackle the ethics of cancel culture and redemption - The Jewish Standard - August 25th, 2022 [August 25th, 2022]
- What I'm Reading (Aug. 25) | American Council on Science and Health - American Council on Science and Health - August 25th, 2022 [August 25th, 2022]
- Apples of Our Eyes: Stories of the Unforgettable Teachers Who Illuminated Our Minds and Marked Our Lives - Jewish Journal - August 25th, 2022 [August 25th, 2022]
- Here Comes the Judge - Jewish Exponent - August 25th, 2022 [August 25th, 2022]
- Asking the Clergy: Your faith and recreational marijuana - Newsday - August 25th, 2022 [August 25th, 2022]
- When Judaism considers the future, it looks to the past - Jewish Community Voice - August 25th, 2022 [August 25th, 2022]
- The Judaism And Zionism Of David Sarnoff - The Jewish Press - JewishPress.com - August 25th, 2022 [August 25th, 2022]
- Blessings From Studying The Zera Shimshon - The Jewish Press - JewishPress.com - August 25th, 2022 [August 25th, 2022]
- You Say it but Do You Believe it? - The Jewish Press - JewishPress.com - August 25th, 2022 [August 25th, 2022]
- Facing a personal reckoning, with a dose of absurdity, on a bus tour of Naziland - Forward - August 25th, 2022 [August 25th, 2022]
- Ezra Furman and the Tireless, Sacred Work of Being Alive | Interview - The Line of Best Fit - August 25th, 2022 [August 25th, 2022]
- The Long and Short of a Well-Rounded Shabbos - The Jewish Press - JewishPress.com - August 25th, 2022 [August 25th, 2022]
- At many Bay Area synagogues, the real action is social action J. - The Jewish News of Northern California - August 25th, 2022 [August 25th, 2022]
- Abortion is a religious issue, but not in the way you think - Santa Fe New Mexican - August 6th, 2022 [August 6th, 2022]