genpsych_russell_2024_gpt3_5

31,031 responses from 1,001 respondents to 31 items.

One of 5 tables from the same source; this one is the gpt3_5 table. The others are listed under Related tables.

About this table

DescriptionLLM-generated big 5 inventory
ReferenceRussell-Lasalandra, L. L., Christensen, A. P., & Golino, H. (2024, September 12). Generative Psychometrics via AI-GENIE: Automatic Item Generation and Validation via Network-Integrated Evaluation. https://doi.org/10.31234/osf.io/fgbj4
DOI10.31234/osf.io/fgbj4
LicenceCC0 1.0
Source datahttps://osf.io/zcytb/?view_only=79d2c8bf12c24393863d60c4143f8a0e

Size and shape

Responses31,031
Respondents1,001
Items31
Response categories5
Responses per respondent31
Responses per item1,001
Density1
LongitudinalFALSE

Classification

age rangeAdult (18+)
sampleInternet-based
construct typePersonality
measurement toolSurvey/questionnaire
item formatLikert Scale/selected response
primary language(s)eng
construct nameBig Five

Item text

This table has item text in the IRW: the wording administered to respondents, not just the response codes.

InstrumentAI-GENIE GPT-3.5 generated Big Five personality inventory
Mean words per item10.677
Mean characters per item74.613
Mean characters per response14
Flesch-Kincaid grade level11.399

Codebook

This codebook is reconstructed by the IRW from the IRW data standard and the script that built it, genpsych_russell_2024.r. It is our best reading, not the source’s own codebook, and it may contain mistakes. Where the two disagree, the source data are the authority. If you find an error, please tell us.

ColumnWhat it isSource column
IRW standard columns
idIRW standard Identifier for the focal unit being measured — typically a person, but sometimes another entity (e.g., a word in a lexical task).made in the build script
itemIRW standard Item identifier.made in the build script
respIRW standard Response value.made in the build script
Respondent covariates
cov_ageCovariate age
cov_englishCovariate english
cov_genderCovariate gender
cov_hispanicCovariate hispanic
cov_raceCovariate race

What item codes and covariate values stand for is in the codebook released with the source data.

Get the data

Download CSVno account neededBrowse on Redivisexplore and queryCroissant metadataHugging Face, Kaggle, OpenML

Or load it directly in R or Python (both need a free Redivis account; the first call opens a browser to sign in):

# R
install.packages("remotes")
remotes::install_github("itemresponsewarehouse/Rpkg")
library(irw)
df <- irw_fetch("genpsych_russell_2024_gpt3_5")
# Python
pip install irw

import irw
df = irw.fetch("genpsych_russell_2024_gpt3_5")

How to cite

@article{Russell_Lasalandra_2024, title={Generative Psychometrics via AI-GENIE: Automatic Item Generation and Validation via Network-Integrated Evaluation}, url={http://dx.doi.org/10.31234/osf.io/fgbj4}, DOI={10.31234/osf.io/fgbj4}, publisher={Center for Open Science}, author={Russell-Lasalandra, Lara Lee and Christensen, Alexander P. and Golino, Hudson}, year={2024}, month=sep }

Version and provenance

IRW versionv549
Redivis datasetitem_response_warehouse v70.0
Redivis dataset DOI10.57761/4qxs-pq87
Manifest pin for this IRW versionv70.0
Metadata sourceirw_meta v39.0