8,244 responses from 1,188 respondents to 7 items.
| Description | This dataset measures the tendency to override intuitive answers using the 7-item Cognitive Reflection Test (CRT). |
|---|---|
| Reference | Himmelstein, Mark, Sophie Ma Zhu, Nikolay Petrov, Ezra Karger, Jessica Helmer, Sivan Livnat, Amory Bennett, Page Hedley, and Phil Tetlock. “The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability”. PsyArXiv, November 23, 2025. doi:10.31234/osf.io/a7kdx_v8. |
| DOI | 10.31234/osf.io/a7kdx_v8 |
| Licence | CC BY 4.0 |
| Source data | https://github.com/forecastingresearch/fpt/tree/main/data_cognitive_tasks |
| Responses | 8,244 |
|---|---|
| Respondents | 1,188 |
| Items | 7 |
| Response categories | 2 |
| Responses per respondent | 6.939 |
| Responses per item | 1177.714 |
| Density | 0.991 |
| Longitudinal | TRUE |
| age range | Adult (18+) |
|---|---|
| construct type | Behavioral |
| measurement tool | Test |
| item format | Likert Scale/selected response |
| primary language(s) | eng |
| construct name | Tendency to override intuitive answers using the Cognitive Reflection Test (CRT) |
This table has item text in the IRW: the wording administered to respondents, not just the response codes.
| Instrument | This dataset measures the tendency to override intuitive answers using the 7-item Cognitive Reflection Test (CRT). |
|---|---|
| Mean words per item | 36.429 |
| Mean characters per item | 178.714 |
| Mean characters per response | NaN |
| Flesch-Kincaid grade level | 3.595 |
cov_session_ididitemrespwave
Or load it directly in R or Python:
# R
install.packages("remotes")
remotes::install_github("itemresponsewarehouse/Rpkg")
library(irw)
df <- irw_fetch("himmelstein-cognitive_reflection-2025")
# Python
pip install irw
import irw
df = irw.fetch("himmelstein-cognitive_reflection-2025")
| IRW version | v393 |
|---|---|
| Redivis dataset | item_response_warehouse_2 v19.0 |
| Redivis dataset DOI | 10.57761/qtx5-4m80 |
| Manifest pin for this IRW version | v19.0 |
| Metadata source | irw_meta v23.0 |