10,768 responses from 3,026 respondents to 195 items.
| Description | SemEval-2013 Task 7 SciEntsBank: grade 3-6 students' written answers to FOSS/ASK science assessment questions, 3,026 students x 195 questions (sparse); text = graders' 5-way accuracy label (correct / partially_correct_incomplete / contradictory / irrelevant / non_domain), resp = 1 if correct, answer_text = the student's answer. |
|---|---|
| Reference | Dzikovska, M. O., Nielsen, R., Brew, C., Leacock, C., Giampiccolo, D., Bentivogli, L., Clark, P., Dagan, I., & Dang, H. T. (2013). SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge. Proceedings of the 7th International Workshop on Semantic Evaluation (SemEval 2013), 263-274. |
| Licence | CC BY-SA 3.0 |
| Source data | https://github.com/myrosia/semeval-2013-task7 |
These notes describe the source data, which the IRW reproduces as released. All notes are listed on the Data Notes page.
| Responses | 10,768 |
|---|---|
| Respondents | 3,026 |
| Items | 195 |
| Response categories | 5 |
| Responses per respondent | 3.558 |
answer_textiditemitemcov_modulerespsplittext
id, item, resp are defined in the IRW data standard and mean the same in every table. For the other columns, including what item codes and covariate values stand for, any codebook is the one released with the source data.
Or load it directly in R or Python (both need a free Redivis account; the first call opens a browser to sign in):
# R
install.packages("remotes")
remotes::install_github("itemresponsewarehouse/Rpkg")
library(irw)
df <- irw_fetch("semeval2013_scientsbank_nom", source = "nom")
# Python
pip install irw
import irw
df = irw.fetch("semeval2013_scientsbank_nom", source="nom")
@inproceedings{Dzikovska2013,
author = {Dzikovska, Myroslava O. and Nielsen, Rodney and Brew, Chris and Leacock, Claudia and Giampiccolo, Danilo and Bentivogli, Luisa and Clark, Peter and Dagan, Ido and Dang, Hoa T.},
title = {SemEval-2013 Task 7: The Joint Student Response Analysis and 8th Recognizing Textual Entailment Challenge},
booktitle = {Proceedings of the 7th International Workshop on Semantic Evaluation (SemEval 2013)},
pages = {263--274},
year = {2013},
url = {https://github.com/myrosia/semeval-2013-task7}
}
| IRW version | v581 |
|---|---|
| Redivis dataset | irw_nominal v4.1 |
| Redivis dataset DOI | 10.57761/9hzd-dc70 |
| Manifest pin for this IRW version | v4.1 |
| Metadata source | irw_meta v44.0 |