The Null Result Penalty

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt

Standard

The Null Result Penalty. / Chopra, Felix; Haaland, Ingar; Roth, Christopher; Stegmann, Andreas.

I: The Economic Journal, Bind 134, Nr. 657, 01.2024, s. 193-219.

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › fagfællebedømt

Harvard

Chopra, F, Haaland, I, Roth, C & Stegmann, A 2024, 'The Null Result Penalty', The Economic Journal, bind 134, nr. 657, s. 193-219. https://doi.org/10.1093/ej/uead060

APA

Chopra, F., Haaland, I., Roth, C., & Stegmann, A. (2024). The Null Result Penalty. The Economic Journal, 134(657), 193-219. https://doi.org/10.1093/ej/uead060

Vancouver

Chopra F, Haaland I, Roth C, Stegmann A. The Null Result Penalty. The Economic Journal. 2024 jan.;134(657):193-219. https://doi.org/10.1093/ej/uead060

Author

Chopra, Felix ; Haaland, Ingar ; Roth, Christopher ; Stegmann, Andreas. / The Null Result Penalty. I: The Economic Journal. 2024 ; Bind 134, Nr. 657. s. 193-219.

Bibtex

@article{37fff27edbb8463ca057049c13492088,
title = "The Null Result Penalty",
abstract = " examine how the evaluation of research studies in economics depends on whether a study yielded a null result. Studies with null results are perceived to be less publishable, of lower quality, less important and less precisely estimated than studies with large and statistically significant results, even when holding constant all other study features, including the sample size and the precision of the estimates. The null result penalty is of similar magnitude among PhD students and journal editors. The penalty is larger when experts predict a large effect and when statistical uncertainty is communicated with p-values rather than standard errors. Our findings highlight the value of a pre-result review.",
author = "Felix Chopra and Ingar Haaland and Christopher Roth and Andreas Stegmann",
year = "2024",
month = jan,
doi = "10.1093/ej/uead060",
language = "English",
volume = "134",
pages = "193--219",
journal = "The Economic Journal",
issn = "0013-0133",
publisher = "Wiley",
number = "657",

}

RIS

TY - JOUR

T1 - The Null Result Penalty

AU - Chopra, Felix

AU - Haaland, Ingar

AU - Roth, Christopher

AU - Stegmann, Andreas

PY - 2024/1

Y1 - 2024/1

N2 - examine how the evaluation of research studies in economics depends on whether a study yielded a null result. Studies with null results are perceived to be less publishable, of lower quality, less important and less precisely estimated than studies with large and statistically significant results, even when holding constant all other study features, including the sample size and the precision of the estimates. The null result penalty is of similar magnitude among PhD students and journal editors. The penalty is larger when experts predict a large effect and when statistical uncertainty is communicated with p-values rather than standard errors. Our findings highlight the value of a pre-result review.

AB - examine how the evaluation of research studies in economics depends on whether a study yielded a null result. Studies with null results are perceived to be less publishable, of lower quality, less important and less precisely estimated than studies with large and statistically significant results, even when holding constant all other study features, including the sample size and the precision of the estimates. The null result penalty is of similar magnitude among PhD students and journal editors. The penalty is larger when experts predict a large effect and when statistical uncertainty is communicated with p-values rather than standard errors. Our findings highlight the value of a pre-result review.

U2 - 10.1093/ej/uead060

DO - 10.1093/ej/uead060

M3 - Journal article

VL - 134

SP - 193

EP - 219

JO - The Economic Journal

JF - The Economic Journal

SN - 0013-0133

IS - 657

ER -

ID: 373549509