TY - JOUR
T1 - An Empirical Investigation of Inadequate Statistical Reporting Practices in Communication Meta-Analyses and Their Consequences
AU - Van Stee, Stephanie K.
AU - Yang, Qinghua
AU - Rains, Stephen A.
N1 - Publisher Copyright:
© 2022 Taylor & Francis Group, LLC.
PY - 2023
Y1 - 2023
N2 - Insufficient statistical reporting practices (ISRPs) involve failure to report effect sizes or the information necessary to compute them in quantitative research. ISRPs can present problems for advancing knowledge in the field of Communication. Because, among other issues, studies containing ISRPs cannot be included in meta-analytic reviews, this practice undermines our ability to quantitatively summarize the findings from communication research with precision. We examine the prevalence and consequences of ISRPs among 50 meta-analyses published in four flagship communication journals. Our findings indicate that 80% of meta-analyses excluded at least one otherwise qualified primary study due to ISRPs, with a median of 6.5% of studies (k = 2) excluded per meta-analysis. The amount of inaccuracy introduced by ISRPs in the results of meta-analyses was small. Implications of the findings for communication research are discussed.
AB - Insufficient statistical reporting practices (ISRPs) involve failure to report effect sizes or the information necessary to compute them in quantitative research. ISRPs can present problems for advancing knowledge in the field of Communication. Because, among other issues, studies containing ISRPs cannot be included in meta-analytic reviews, this practice undermines our ability to quantitatively summarize the findings from communication research with precision. We examine the prevalence and consequences of ISRPs among 50 meta-analyses published in four flagship communication journals. Our findings indicate that 80% of meta-analyses excluded at least one otherwise qualified primary study due to ISRPs, with a median of 6.5% of studies (k = 2) excluded per meta-analysis. The amount of inaccuracy introduced by ISRPs in the results of meta-analyses was small. Implications of the findings for communication research are discussed.
UR - http://www.scopus.com/inward/record.url?scp=85150388922&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85150388922&partnerID=8YFLogxK
U2 - 10.1080/19312458.2022.2088713
DO - 10.1080/19312458.2022.2088713
M3 - Article
AN - SCOPUS:85150388922
SN - 1931-2458
VL - 17
SP - 1
EP - 16
JO - Communication Methods and Measures
JF - Communication Methods and Measures
IS - 1
ER -