Method
What this site is, what its numbers mean, and what is not known.
What this is
Matcha Time is a set of practice exercises built around twelve well-known thinking tools. You do the exercises and the site keeps a record of what you did.
We have not tested whether playing improves real-world decisions. Nobody has studied this site. The numbers it shows describe your answers here and nothing else.
What research on other teaching found (not this site)
None of the studies below tested the games on this site. They are background, not support for it.
In two experiments, adults played one game of about an hour that taught several decision biases. Compared with their own results beforehand, they made at least 31.9% fewer of the trained errors straight afterwards, and at least 23.6% fewer when tested again 8 or 12 weeks later. People who watched a half-hour video instead also made fewer, by a smaller margin; no group went without any teaching. The tests were written by the researchers (Morewedge and colleagues, 2015).
Whether such teaching changes what people do outside the exercise is much less clear. One study of business students found a difference in a later case exercise (Sellier, Scopelliti and Morewedge, 2019). A 2021 review of the field concluded that the evidence for an effect on real-life decisions was insufficient (Korteling, Gerritsma and Toet).
Separately, people in a forecasting tournament who received under an hour of teaching about probabilities gave more accurate forecasts over the following year than those who did not (Mellers and colleagues, 2014). Those volunteers were unusually well educated, and they forecast world events, not everyday ones.
How to read your numbers
Counts first.Small samples swing widely, so the site shows counts such as “6 of 10” and holds back percentages and summaries until there is more to go on: 40 first-time answers in Sure of It, 30 in Which Tool?, and 10 resolved predictions in Called It.
First time only. Once you have seen a question and its answer, getting it right again says little. Repeats are counted apart.
No verdicts. There is no overall score, no level and no ranking. The League page shows only who has played recently.
Getting used to the game. People get better at any exercise by repeating it. A rising count here may be exactly that.
Sources
- Morewedge and colleagues (2015), Debiasing Decisions: Improved Decision Making With a Single Training Intervention. Link
- Sellier, Scopelliti and Morewedge (2019), Debiasing Training Improves Decision Making in the Field. Link
- Korteling, Gerritsma and Toet (2021), Retention and Transfer of Cognitive Bias Mitigation Interventions: A Systematic Literature Study. Link
- Mellers and colleagues (2014), Psychological Strategies for Winning a Geopolitical Forecasting Tournament. Link
Every Sure of It answer links to the source it was checked against. If you find a wrong one, tell the site's admin.