← Back to Sahilverse

The Forecast Room · a field ledger for uncertain beliefs

A forecast is a claim the future can answer.
It is not a measure of how wise you are.

In ten minutes you can learn to write a belief so it can be wrong, put an honest number on it, and change your mind without drama. Eight fictional cases and a card you can print.

Start exploring Read the argument

20406080

What this is / is not

Is: a small, self-contained workshop on forecasting and belief revision, written for a stranger. Is not: a test of your intelligence, a validated psychological instrument, a prediction service, or advice about your life. Everything stays in your browser tab; nothing is sent or stored.

Labels used below: ESTABLISHED FRAMEWORK INTERPRETATION HYPOTHESIS ILLUSTRATION FICTION

1. A claim the future can answer

ESTABLISHED FRAMEWORK

“The launch will go well” can never be wrong, so it can never teach you anything. “At least 8 of our 12 colleagues will open the tool weekly by 30 November” can be wrong, and that is its value. The words that make a claim answerable are its resolution criteria: who decides, by when, counted how. Write them before the outcome exists. Many arguments about who “called it” are really arguments about what the sentence meant.

2. Four things people blur

ESTABLISHED FRAMEWORK

Likelihood is how probable something is. Impact is how much it matters if it happens. Calibration is a property of many forecasts: do your 70% claims come true about 70% of the time? Hindsight is the feeling, afterwards, that you knew. A 5% chance of flooding the shop deserves a plan because of impact, not likelihood. A 90% forecast that fails once is not refuted; a single outcome speaks to calibration very quietly.

3. Start from the reference class

ILLUSTRATION ESTABLISHED FRAMEWORK

Hypothetical: you plan to finish a report in two days and your plan feels 80% safe. Ask a different question: of my last six reports this size, how many finished on time? Say two did. That gives a starting point near one in three, a base rate from a reference class. Then adjust for what is genuinely different this time (fewer meetings, a clearer brief), and nudge, don’t leap. Six reports is a tiny class, so treat the number as an anchor, not a verdict. The point is the order: outside view first, inside story second.

4. Why one outcome says so little

ESTABLISHED FRAMEWORK

Suppose ten forecasts are each exactly 70% likely. By ordinary binomial arithmetic, five or fewer coming true happens about 15% of the time, by chance alone. So a bad week of misses is weak evidence that your judgment is poor, and a good week is weak evidence that it is good. Ambiguity makes it worse: if resolution wasn’t written down, memory quietly picks the reading that flatters. Small samples invite stories; keep the stories loose.

5. Wanting, and hindsight

INTERPRETATION

When you want something to be true, the number drifts upward and the reasons arrive afterwards. When the outcome is known, “I always suspected” rewrites the record. A modest defence is to write the number and the reason down before. That doesn’t make you immune; it only makes the drift visible to the one person who can fix it, you.

6. What would change my mind

ILLUSTRATION

Claim (hypothetical): “A cousin’s bakery will still be open in two years.” Starting estimate: 70%. Before looking at any news, list what would move it, and which way:

  • Sales fall three months in a row → lower, perhaps substantially.
  • The landlord renews the lease early → raise it a little.
  • A larger competitor opens next door → lower a little, unless regulars are loyal.
  • Two days of rain → almost no movement. Noise should not move you.

These sizes are judgments, not calculations. Their purpose is to decide in calm what counts as evidence, so that later you update on the evidence, not on mood.

7. Eight fictional cases

FICTION Each case is invented. For each, choose how likely the statement is to come true, commit, then see what the author decided happened. Outcomes were set by the author, not drawn at random, so they teach about reasoning, not about the world.

8. Honest objections

INTERPRETATION

“Numbers are false precision.” Often right: 63% is rarely different from 60%, which is why the cases use four bands. “You can game it by saying 50%.” You can, and you’ll learn nothing; the habit only helps if it is honest. “Some questions aren’t forecasting problems.” Correct. Whether to forgive someone, what a fair wage is, or what a child owes a parent are questions of value and choice. Probabilities may inform them; they cannot settle them.

Agency changes the question. If you are part of the system, a forecast is partly a decision: “I’ll probably skip the gym” can become true because you said it. Forecast what you cannot steer; commit to what you can. Behavioural friction (defaults, reminders, effort) often matters more than the estimate. Sahil’s inquiries on agency and the Identity–Action Gap explore this; the gap is a HYPOTHESIS, a proposed inquiry, not a validated psychological law.

9. Glossary

Base rate
How often something happens across comparable situations, before you consider the specifics of yours.
Reference class
The set of comparable situations you count. Choosing it is a judgment, and different classes can give different answers.
Resolution criteria
The pre-agreed test for deciding whether a forecast came true: who judges, by when, using what evidence.
Updating
Changing a probability in proportion to how strongly new evidence favours one possibility over another.
Hindsight bias
Remembering an outcome as having been more predictable than it was.

10. A forecast card to keep

Fill it in, then copy or print. Nothing is stored or transmitted; closing the tab erases it.


An open question

If a forecast changes what you do, what exactly were you forecasting: the world, or yourself?

Related worlds

Links supplied by Sahil; this build did not check them live.

Sources and limits

No bibliography is claimed. This build had no live browsing, so no external research was verified. The concepts above (base rates, calibration, reference classes) are standard in forecasting and decision research. See RESEARCH_AND_CREDITS.md for what is and isn’t covered. This site is not audited for accessibility compliance.