TY - JOUR
T1 - Interpreting internal consistency of des measurements
AU - Miranda, V.
AU - Rogozenski, P.
AU - Krause, E.
N1 - Publisher Copyright:
© 2021 The Author(s) Published by Oxford University Press on behalf of Royal Astronomical Society.
PY - 2022/2/1
Y1 - 2022/2/1
N2 - Bayesian evidence ratios are widely used to quantify the statistical consistency between different experiments. However, since the evidence ratio is prior dependent, the precise translation between its value and the degree of concordance/discordance requires additional information. The most commonly adopted metric, the Jeffreys scale, can falsely suggest agreement between data sets when priors are chosen to be sufficiently wide. This work examines evidence ratios in a DES-Y1 simulated analysis, focusing on the internal consistency between weak lensing and galaxy clustering. We study two scenarios using simulated data in controlled experiments. First, we calibrate the expected evidence ratio distribution given noise realizations around the best-fitting DES-Y1 ΛCDM cosmology. Secondly, we show the behaviour of evidence ratios for noiseless fiducial data vectors simulated using a modified gravity model, which generates internal tension in the LCDM analysis. We find that the evidence ratio of noise realizations generated at all confidence levels was biased towards agreement and show, with a modified gravity model, that the choice of prior could conceal the discrepancies between weak lensing and galaxy clustering induced by prior effects in unlike cosmological models, concluding that the evidence ratio in a DES-Y1 study is, indeed, biased towards agreement. Boundary effects can also influence conclusions about the inconsistency induced by modified gravity, even in a noiseless data vector simulation.
AB - Bayesian evidence ratios are widely used to quantify the statistical consistency between different experiments. However, since the evidence ratio is prior dependent, the precise translation between its value and the degree of concordance/discordance requires additional information. The most commonly adopted metric, the Jeffreys scale, can falsely suggest agreement between data sets when priors are chosen to be sufficiently wide. This work examines evidence ratios in a DES-Y1 simulated analysis, focusing on the internal consistency between weak lensing and galaxy clustering. We study two scenarios using simulated data in controlled experiments. First, we calibrate the expected evidence ratio distribution given noise realizations around the best-fitting DES-Y1 ΛCDM cosmology. Secondly, we show the behaviour of evidence ratios for noiseless fiducial data vectors simulated using a modified gravity model, which generates internal tension in the LCDM analysis. We find that the evidence ratio of noise realizations generated at all confidence levels was biased towards agreement and show, with a modified gravity model, that the choice of prior could conceal the discrepancies between weak lensing and galaxy clustering induced by prior effects in unlike cosmological models, concluding that the evidence ratio in a DES-Y1 study is, indeed, biased towards agreement. Boundary effects can also influence conclusions about the inconsistency induced by modified gravity, even in a noiseless data vector simulation.
KW - cosmological parameters
KW - cosmology: Theory
UR - http://www.scopus.com/inward/record.url?scp=85124912580&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85124912580&partnerID=8YFLogxK
U2 - 10.1093/mnras/stab3068
DO - 10.1093/mnras/stab3068
M3 - Article
AN - SCOPUS:85124912580
SN - 0035-8711
VL - 509
SP - 5218
EP - 5230
JO - Monthly Notices of the Royal Astronomical Society
JF - Monthly Notices of the Royal Astronomical Society
IS - 4
ER -