himmelstein-admc_raw-2025

45,066 responses from 1,194 respondents to 38 items.

One of 8 tables from the same source; this one measures Trial-level decision-making responses on the Adult Decision-Making Competence. The others are listed under Related tables.

About this table

DescriptionThis dataset measures trial-level decision-making responses on the Adult Decision-Making Competence (ADMC) battery, including Resistance to Framing, Deliberation/Reflection, and Risk Perception.
ReferenceHimmelstein, Mark, Sophie Ma Zhu, Nikolay Petrov, Ezra Karger, Jessica Helmer, Sivan Livnat, Amory Bennett, Page Hedley, and Phil Tetlock. “The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability”. PsyArXiv, November 23, 2025. doi:10.31234/osf.io/a7kdx_v8.
DOI10.31234/osf.io/a7kdx_v8
LicenceCC BY 4.0
Source datahttps://github.com/forecastingresearch/fpt/tree/main/data_cognitive_tasks

Size and shape

Responses45,066
Respondents1,194
Items38
Response categories7
Responses per respondent37.744
Responses per item1185.947
Density0.993
LongitudinalTRUE

Classification

age rangeAdult (18+)
sampleTargeted/specific
construct typeBehavioral
measurement toolSurvey/questionnaire
item formatSlider/continuous
primary language(s)eng
construct nameTrial-level decision-making responses on the Adult Decision-Making Competence

Item text

This table has item text in the IRW: the wording administered to respondents, not just the response codes.

InstrumentAdult Decision Making Competence (ADMC): the Resistance to Framing and Applying Decision Rules subtests, administered as part of the Forecasting Proficiency Test battery.
Mean words per item69.244
Mean characters per item391.021
Mean characters per response6.788
Flesch-Kincaid grade level8.695

Codebook

This codebook is reconstructed by the IRW from the IRW data standard. It is our best reading, not the source’s own codebook, and it may contain mistakes. Where the two disagree, the source data are the authority. If you find an error, please tell us.

ColumnWhat it isSource column
IRW standard columns
idIRW standard Identifier for the focal unit being measured — typically a person, but sometimes another entity (e.g., a word in a lexical task).not traced
itemIRW standard Item identifier.not traced
respIRW standard Response value.not traced
rtIRW standard Response time.not traced
waveIRW standard Longitudinal wave indicator.not traced
Respondent covariates
cov_session_idCovariate not traced
cov_session_restart_idCovariate not traced

What item codes and covariate values stand for is in the source’s documentation, data_admc_raw.docx.

Get the data

Download CSVno account neededBrowse on Redivisexplore and queryCroissant metadataHugging Face, Kaggle, OpenML

Or load it directly in R or Python (both need a free Redivis account; the first call opens a browser to sign in):

# R
install.packages("remotes")
remotes::install_github("itemresponsewarehouse/Rpkg")
library(irw)
df <- irw_fetch("himmelstein-admc_raw-2025")
# Python
pip install irw

import irw
df = irw.fetch("himmelstein-admc_raw-2025")

How to cite

@article{Himmelstein_2025, title={The Forecasting Proficiency Test: A General Use Assessment of Forecasting Ability}, url={http://dx.doi.org/10.31234/osf.io/a7kdx_v8}, DOI={10.31234/osf.io/a7kdx_v8}, publisher={Center for Open Science}, author={Himmelstein, Mark and Zhu, Sophie Ma and Petrov, Nikolay and Karger, Ezra and Helmer, Jessica and Livnat, Sivan and Bennett, Amory and Hedley, Page and Tetlock, Phil}, year={2025}, month=nov }

Version and provenance

IRW versionv557
Redivis datasetitem_response_warehouse_2 v33.0
Redivis dataset DOI10.57761/6m04-m698
Manifest pin for this IRW versionv33.0
Metadata sourceirw_meta v40.0