TY - JOUR
T1 - The Digital Experiment Reporting Protocol (DERP)
AU - Weinmann, Markus
AU - Schneider, Christoph
AU - Valacich, Joseph
N1 - Publisher Copyright:
© 2025 by the Association for Information Systems.
PY - 2025
Y1 - 2025
N2 - Transparent reporting is a cornerstone of credible and reproducible research, yet digital experiments—randomized studies conducted in online or computerized environments—often lack clear reporting standards. To address this gap, we adapt and extend the CONSORT Statement, a widely used checklist for clinical trials, to develop a reporting checklist tailored for digital experiments. While the checklist is broadly applicable across disciplines, we demonstrate its relevance through an empirical application to digital experiments published in two leading Information Systems (IS) journals: Information Systems Research and MIS Quarterly. Our analysis reveals substantial shortcomings in reporting quality, with only 43% of the papers providing sufficient detail on core items. These findings highlight the urgent need for standardized reporting in digital experimentation. The proposed checkl ist offers a practical tool for authors, reviewers, and editors to enhance the transparency, rigor, and replicability of digital experiments.
AB - Transparent reporting is a cornerstone of credible and reproducible research, yet digital experiments—randomized studies conducted in online or computerized environments—often lack clear reporting standards. To address this gap, we adapt and extend the CONSORT Statement, a widely used checklist for clinical trials, to develop a reporting checklist tailored for digital experiments. While the checklist is broadly applicable across disciplines, we demonstrate its relevance through an empirical application to digital experiments published in two leading Information Systems (IS) journals: Information Systems Research and MIS Quarterly. Our analysis reveals substantial shortcomings in reporting quality, with only 43% of the papers providing sufficient detail on core items. These findings highlight the urgent need for standardized reporting in digital experimentation. The proposed checkl ist offers a practical tool for authors, reviewers, and editors to enhance the transparency, rigor, and replicability of digital experiments.
KW - Checklist
KW - Digital Experiments
KW - Reporting
KW - Research Transparency
UR - http://www.scopus.com/inward/record.url?scp=105008276205&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=105008276205&partnerID=8YFLogxK
U2 - 10.2139/ssrn.3985991
DO - 10.2139/ssrn.3985991
M3 - Article
AN - SCOPUS:105008276205
SN - 1529-3181
VL - 57
SP - 555
EP - 579
JO - Communications of the Association for Information Systems
JF - Communications of the Association for Information Systems
ER -