On doing relevant and rigorous experiments: Review and recommendations.

dc.contributor.authorLonati, S.
dc.contributor.authorQuiroga, Bernardo F.
dc.contributor.authorZehnder, C.
dc.contributor.authorAntonakis, J.
dc.date.accessioned2020-03-10T16:08:14Z
dc.date.available2020-03-10T16:08:14Z
dc.date.issued2018
dc.date.updated2020-01-30T16:10:40Z
dc.description.abstractAlthough experiments are the gold standard for establishing causality, several threats can undermine the internal validity of experimental findings. In this article, we first discuss these threats, which include the lack of consequential decisions and outcomes, deception, demand effects and unfair comparisons, as well as issues concerning statistical validity (e.g., minimum sample size per cell, estimating variance correctly). We expose each problem, show potential solutions, and bring to the fore issues of relevance of the findings (i.e., external and ecological validity). Thereafter, we take stock of the state-of-the-science regarding validity threats using a representative sample of 468 recent experiments from 258 articles published in top-tier journals. We compare research practices in three fields of study—management, social psychology, and economics, which regularly use experimental research—to operations management, which has more recently begun to use the experimental paradigm. Our results underscore the importance for journals and authors to follow what we identify to be best-practice methodological suggestions (i.e., the “ten commandments” of experimental research). We show that—on average—markers of methodological rigor and generalizability positively and significantly predict the citations received by published articles. Finally, given that experiments are infeasible in some settings, we conclude with a brief review of often overlooked quasi-experimental designs, which are useful for generating strong counterfactuals and hence allow making causal claims in the field.
dc.identifier.doi10.1016/j.jom.2018.10.003
dc.identifier.urihttp://www.scopus.com/inward/record.url?eid=2-s2.0-85058159524&partnerID=MN8TOARS
dc.identifier.urihttps://repositorio.uc.cl/handle/11534/28498
dc.language.isoen
dc.nota.accesoContenido parcial
dc.pagina.final40
dc.pagina.inicio19
dc.relation.isformatofJournal of Operations Management 64 (2018), p. 19-40
dc.revistaJournal of Operations Managementes_ES
dc.rightsacceso restringido
dc.subjectExperimental methodses_ES
dc.subjectResearch methodses_ES
dc.subjectResearch impactes_ES
dc.subjectCausalityes_ES
dc.subjectEndogeneityes_ES
dc.subjectQuasi-experimentationes_ES
dc.subject.ddc507.24
dc.subject.deweyCienciases_ES
dc.titleOn doing relevant and rigorous experiments: Review and recommendations.es_ES
dc.typeartículo
dc.volumenVol. 64
sipa.codpersvinculados120937
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
On doing relevant and rigorous experiments.pdf
Size:
346.46 KB
Format:
Adobe Portable Document Format
Description: