Connect with us

Life

3 Tactics Ordinary Citizens Used To Out Predict CIA Experts

Published

on

intelligence

In the intelligence community, it’s crucial to be able to predict future events. The ability for the CIA and its intelligence counterparts to be able to forecast world events based on limited information is what gives us advantages on the international stage.

In a recent interview on The Science of Success Podcast, New York Times best-selling author Dan Gardner shares the incredible story of how a group of citizen volunteers led by Philip Tetlock, changed the way our intelligence communities’ approach analyzing and forecasting future political events.

It all started in 2011. The Office of the Director of National Intelligence (ODNI) decided it was time to evaluate and improve on how The United States’ 16 intelligence agencies forecast future events. The idea was to analyze these agencies past predictions and find ways to learn from previous mistakes.

The intelligence community actually spends a lot of its time not just spying, but also analyzing information to try and figure out what’s going to happen next. Will Russia try to seize the Crimea? They’ll try to make forecasts. On all parts of geopolitical events, including economic events like what’s going to happen at the Chinese economy in the fourth quarter, that sort of thing.”

So in order to gain perspective the intelligence community agreed to fund a number of private researches to assemble teams of unpaid volunteers to take their best shot at it. “You set up a team to make forecasts, and we’ll ask questions, and they’ll be the real world questions that we have to answer all the time.” Gardner explains.

Ultimately they came up with five university based research teams for this tournament. One of which was headed up by Gardner’s co-author, Philip Tetlock. They decided to name their team The Good Judgment Project. The Project successfully recruited thousands of volunteers. The ODNI set several benchmarks that all of the researchers thought we’re much too ambitious. “Prior to beginning the project, looking at these benchmarks, nobody could do this!”

The results were beyond surprising. Certain volunteers blew away each benchmark and predicted future events with incredible accuracy. “The Good Judgment Project won hands down. They found that a certain group of these volunteers were consistently good at forecasting these events. Anyone can get lucky once, twice, maybe three times. These volunteers however were consistent, and that is key.”

These “Superforecasters” were normal people, with average IQ scores, no previous intelligence community experience, and zero access to classified information. Each of these volunteers had a common interest in world events and stayed up to date on their world politics, but had nothing else you or I couldn’t find ourselves on Google. Yet they were making predictions that economists said should have been impossible.

So how did they do it? Dan points out three things the researchers from The Good Judgment Project found these volunteers had in common.

1. Unpack Your Problems

Many of us look at a problem as one thing. We are presented with the issue, we look it over, stroke our chins, and then try to solve. However, looking at the problem or question as one big issue will lead to terrible predictions.

What they do is that they methodically unpack the question. They take a big question, and they unpack it, and make a whole series of smaller questions, and then they unpack those and they make a series of smaller questions, and they methodically examine them.”

You’re taking one complex problem, breaking it down into its smaller, simpler components. Allowing you to answer these simpler questions and ultimately piece them back together to create an extremely accurate and effective answer to a larger problem.

“If you’re overwhelmed by the size of a problem, break it down into smaller pieces.” – Chuck Close

2. Craving Cognition

Each of these “superforecasters” had a desire to be intellectually challenged and learn. “These are people who like to learn, they’re constantly picking up bits and pieces of information, and no surprise, when you spend a lot of time picking up this sort of information, eventually you will have quite a number of dots in your intellectual arsenal for you to connect.”

Also, each volunteer enjoyed pushing himself or herself mentally. “They’re the kinds of people who do puzzles for fun and the harder the puzzle is, the more fun it is,” explains Gardner.

So next time you decide to do some recreational problem solving whether it be a puzzle or mental game, crank the difficulty up a little bit and give your brain a challenge.

3. It’s All About Your Mindset

Each “superforecaster” volunteer was extremely open to hearing other’s opinions. “This means okay, I’ve got my perspective but I want to hear your perspective. I want to hear somebody else’s perspective. I want to hear different ways of thinking about this problem.”

By listening to as many other opinions as possible, these volunteers were able to then synthesize ideas from multiple sources and viewpoints and create the most well rounded and analyzed prediction possible.

It’s easy to want to take all the credit, to finish first, and be the star of the show. We all have the impulse to think we’ve done our due diligence and our viewpoint is the right one. It’s only through keeping an open mind to other viewpoints and outside information that we can truly begin to consistently make better predictions and decisions.  

“Once your mindset changes, everything on the outside will change along with it.” – Steve Maraboli

The Good Judgment Project is still being conducted to this day and is open for volunteers. To learn more about the project, forecasting tactics, and Dan’s book Superforecasting, listen to his full hour interview on The Science of Success Podcast.

Which one of these three tactics do you use most? Please leave your thoughts below!

Matt Bodnar, named a “Rising Restaurateur Star” by the National Restaurant Association and a “Strategy Pro” by Restaurant Hospitality Magazine, is a partner at an early stage investment firm Fresh Hospitality where he focuses on deal making and strategy. Bodnar is also the creator and host of "The Science of Success" a #1 New & Noteworthy podcast, with more than 1 Million+ downloads, focused on improving decision-making, understanding psychology, and sharing insights from experts. Bodnar previously worked as an import/export consultant in Nanjing, China and spent several years at Goldman Sachs before returning to his family roots in the hospitality space.

Life

The 7 Things that Are Preventing You from Enjoying Life to the Fullest

Published

on

Image Credit: Unsplash

If you’d like to learn how to live each moment to the fullest and succeed in all aspects of your life so you can be happy, sign up for the free 90-Day Master Class hosted by the founder of Addicted2Success.com, Joel Brown.


To some people, life is unfair. To some, life is good. And to others, life is great. It all depends on your perspective and how much responsibility you take for your personal development and income. (more…)

Continue Reading

Life

How to Harness Your Own Uniqueness

Published

on

Image Credit: Unsplash

If you’d like to learn how to harness your own unique personality traits so you can be successful in pursuing your passions, sign up for the free 90-Day Master Class hosted by the founder of Addicted2Success.com, Joel Brown.


No two people are exactly alike. Yet, we were all created in God’s image. Each one of us has their own preferences when it comes to things that they hold dear to their heart and things that do not matter to them. (more…)

Continue Reading

Life

Read This If You Are Tired Of Finding Excuses For Your Inconsistency

Published

on

Image Credit: Unsplash

If you’d like to learn how to build strong and consistent habits so you can achieve your goals, sign up for the free 90-Day Master Class hosted by the founder of Addicted2Success.com, Joel Brown.


You are the main factor limiting the growth of your business because of your fears, limiting beliefs, inability to focus, and inconsistency. Three years into running my first business, one thought sits deeply with me: I might have the best strategies, yet nothing would work until my habits (or the lack of those) stand in the way. (more…)

Continue Reading

Life

8 Ways A Digital Detox Will Increase Your Productivity

Published

on

Image Credit: Unsplash

There is a downside to being constantly plugged in. We all know that spending too much time online can be tiring and dulls our focus. A trade-off we must make for the benefits of living in a more connected world. If we aren’t careful however, the amazing technology that helps us to reach more people, be more informed, and do better business can really hinder our productivity (more…)

Continue Reading

Trending