3,164 responses from 452 respondents to 7 items.
A version of this table that keeps the option each respondent chose is sirota_2018_crt_nom.
One of 2 tables from the same source; this one is the crt table. The others are listed under Related tables.
| Description | Cognitive Reflection Test, 7 items, 452 respondents randomised to open, 2-option or 4-option response format (cov_format); resp = correct, resp_raw = 1 correct / 2 intuitive incorrect / 3 other incorrect. |
|---|---|
| Reference | Sirota, M., & Juanchich, M. (2018). Effect of response format on cognitive reflection: Validating a two- and four-option multiple choice question version of the Cognitive Reflection Test. Behavior Research Methods, 50, 2511-2522. |
| DOI | 10.3758/s13428-018-1029-4 |
| Licence | CC BY 4.0 |
| Source data | https://osf.io/mzhyc/ |
| Responses | 3,164 |
|---|---|
| Respondents | 452 |
| Items | 7 |
| Response categories | 2 |
| Responses per respondent | 7 |
| Responses per item | 452 |
| Density | 1 |
| Longitudinal | FALSE |
This codebook is reconstructed by the IRW from the IRW data standard and the script that built it, sirota_2018_crt.py. It is our best reading, not the source’s own codebook, and it may contain mistakes. Where the two disagree, the source data are the authority. If you find an error, please tell us.
| Column | What it is | Source column |
|---|---|---|
| IRW standard columns | ||
id | IRW standard Identifier for the focal unit being measured — typically a person, but sometimes another entity (e.g., a word in a lexical task). | ID |
item | IRW standard Item identifier. | made in the build script |
resp | IRW standard Response value. | made in the build script |
resp_raw | IRW standard The response as originally recorded, where resp holds a scored or recoded version of it — the letter a candidate marked (A–E), an option label, a categorical string. | made in the build script |
| Respondent covariates | ||
cov_age | Covariate | Age |
cov_edu | Covariate | Edu |
cov_format | Covariate | XP |
cov_gender | Covariate | Gender |
What item codes and covariate values stand for is in the source’s codebook, Codebook_MCQCRTdata.txt.
Or load it directly in R or Python (both need a free Redivis account; the first call opens a browser to sign in):
# R
install.packages("remotes")
remotes::install_github("itemresponsewarehouse/Rpkg")
library(irw)
df <- irw_fetch("sirota_2018_crt")
# Python
pip install irw
import irw
df = irw.fetch("sirota_2018_crt")
@article{Sirota_2018, title={Effect of response format on cognitive reflection: Validating a two- and four-option multiple choice question version of the Cognitive Reflection Test}, volume={50}, ISSN={1554-3528}, url={http://dx.doi.org/10.3758/s13428-018-1029-4}, DOI={10.3758/s13428-018-1029-4}, number={6}, journal={Behavior Research Methods}, publisher={Springer Science and Business Media LLC}, author={Sirota, Miroslav and Juanchich, Marie}, year={2018}, month=Mar, pages={2511–2522} }
| IRW version | v581 |
|---|---|
| Redivis dataset | item_response_warehouse_6 v5.11 |
| Redivis dataset DOI | 10.57761/qahq-j855 |
| Manifest pin for this IRW version | v5.11 |
| Metadata source | irw_meta v44.0 |