9,996 comparisons among 504 agents.
One of 6 tables from the same source; this one is the treebank table. The others are listed under Related tables.
| Description | MTurk pairwise comparisons of Stanford Sentiment Treebank snippets for positivity; experiment 1 untrained, experiment 2 certified coders |
|---|---|
| Reference | Carlson, D., & Montgomery, J. M. (2017). A pairwise comparison framework for fast, flexible, and reliable human coding of political texts. American Political Science Review, 111(4), 835-843. Data: Carlson, David; Montgomery, Jacob, Harvard Dataverse, https://doi.org/10.7910/DVN/0ZRGEE |
| DOI | 10.1017/S0003055417000302 |
| Licence | CC0 1.0 |
| Source data | https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/0ZRGEE |
| Comparisons | 9,996 |
|---|---|
| Agents | 504 |
agent_aagent_bbatch_idcomparison_iddateexperimenthomefieldraterscore_ascore_bwinner
Or load it directly in R or Python (both need a free Redivis account; the first call opens a browser to sign in):
# R
install.packages("remotes")
remotes::install_github("itemresponsewarehouse/Rpkg")
library(irw)
df <- irw_fetch("carlson_2017_treebank", source = "comp")
# Python
pip install irw
import irw
df = irw.fetch("carlson_2017_treebank", source="comp")
@article{CARLSON_2017, title={A Pairwise Comparison Framework for Fast, Flexible, and Reliable Human Coding of Political Texts}, volume={111}, ISSN={1537-5943}, url={http://dx.doi.org/10.1017/S0003055417000302}, DOI={10.1017/s0003055417000302}, number={4}, journal={American Political Science Review}, publisher={Cambridge University Press (CUP)}, author={CARLSON, DAVID and MONTGOMERY, JACOB M.}, year={2017}, month=Sept, pages={835–843} }
| IRW version | v584 |
|---|---|
| Redivis dataset | irw_competitions v6.2 |
| Redivis dataset DOI | 10.57761/1w3w-5w94 |
| Manifest pin for this IRW version | v6.2 |
| Metadata source | irw_meta v44.0 |