hrm_rater_sim

18,000 simulated responses from 1,000 respondents to 6 items.

Simulated data. These responses were generated by a script, not collected from people; see the generating script. The cov_true_theta column holds the true generating values, which a real dataset would not have.

About this table

DescriptionSimulated rater effects under the hierarchical rater model: 1,000 persons x 6 items x 3 raters (fully crossed), scores 0-3; raters differ in bias and variability. True ability in cov_true_theta, item parameters and item-by-rater bias (phi) and variability (psi) in itemcov_true_*; rater column identifies the rater.
ReferencePatz, R. J., Junker, B. W., Johnson, M. S., & Mariano, L. T. (2002). The hierarchical rater model for rated test items and its application to large-scale educational assessment data. Journal of Educational and Behavioral Statistics, 27(4), 341-384. Generated with immer::immer_hrm_simulate (Robitzsch, A., & Steinfeld, J., immer R package, version 1.5.13).
DOI10.3102/10769986027004341
LicenceCC0 1.0
Generating scripthttps://cran.r-project.org/package=immer

Size and shape

Responses18,000
Respondents1,000
Items6
Response categories4
Responses per respondent18
Responses per item3,000
Density3

Columns

cov_true_thetaiditemitemcov_true_aitemcov_true_b1itemcov_true_b2itemcov_true_b3itemcov_true_phi_rater1itemcov_true_phi_rater2itemcov_true_phi_rater3itemcov_true_psi_rater1itemcov_true_psi_rater2itemcov_true_psi_rater3raterresp

id, item, rater, resp are defined in the IRW data standard and mean the same in every table. The other columns are set by the generating script.

Get the data

Download CSVno account neededBrowse on Redivisexplore and queryCroissant metadataHugging Face, Kaggle, OpenML

Or load it directly in R or Python (both need a free Redivis account; the first call opens a browser to sign in):

# R
install.packages("remotes")
remotes::install_github("itemresponsewarehouse/Rpkg")
library(irw)
df <- irw_fetch("hrm_rater_sim", source = "sim")
# Python
pip install irw

import irw
df = irw.fetch("hrm_rater_sim", source="sim")

How to cite

@article{Patz_2002, title={The Hierarchical Rater Model for Rated Test Items and its Application to Large-Scale Educational Assessment Data}, volume={27}, ISSN={1935-1054}, url={http://dx.doi.org/10.3102/10769986027004341}, DOI={10.3102/10769986027004341}, number={4}, journal={Journal of Educational and Behavioral Statistics}, publisher={American Educational Research Association (AERA)}, author={Patz, Richard J. and Junker, Brian W. and Johnson, Matthew S. and Mariano, Louis T.}, year={2002}, month=Dec, pages={341–384} }

Version and provenance

IRW versionv581
Redivis datasetirw_simsyn v1.4
Redivis dataset DOI10.57761/d90d-aa22
Manifest pin for this IRW versionv1.4
Metadata sourceirw_meta v44.0