TY - JOUR
PY - 2023//
TI - Recalibrating single-study effect sizes using hierarchical Bayesian models
JO - Frontiers in neuroimaging
A1 - Cao, Zhipeng
A1 - McCabe, Matthew
A1 - Callas, Peter
A1 - Cupertino, Renata B.
A1 - Ottino-Gonzalez, Jonatan
A1 - Murphy, Alistair
A1 - Pancholi, Devarshi
A1 - Schwab, Nathan
A1 - Catherine, Orr
A1 - Hutchison, Kent
A1 - Cousijn, Janna
A1 - Dagher, Alain
A1 - Foxe, John J.
A1 - Goudriaan, Anna E.
A1 - Hester, Robert
A1 - Li, Chiang-Shan R.
A1 - Thompson, Wesley K.
A1 - Morales, Angelica M.
A1 - London, Edythe D.
A1 - Lorenzetti, Valentina
A1 - Luijten, Maartje
A1 - Martin-Santos, Rocio
A1 - Momenan, Reza
A1 - Paulus, Martin P.
A1 - Schmaal, Lianne
A1 - Sinha, Rajita
A1 - Solowij, Nadia
A1 - Stein, Dan J.
A1 - Stein, Elliot A.
A1 - Uhlmann, Anne
A1 - van Holst, Ruth J.
A1 - Veltman, Dick J.
A1 - Wiers, Reinout W.
A1 - Yücel, Murat
A1 - Zhang, Sheng
A1 - Conrod, Patricia
A1 - Mackey, Scott
A1 - Garavan, Hugh
SP - e1138193
EP - e1138193
VL - 2
IS -
N2 - INTRODUCTION: There are growing concerns about commonly inflated effect sizes in small neuroimaging studies, yet no study has addressed recalibrating effect size estimates for small samples. To tackle this issue, we propose a hierarchical Bayesian model to adjust the magnitude of single-study effect sizes while incorporating a tailored estimation of sampling variance.
METHODS: We estimated the effect sizes of case-control differences on brain structural features between individuals who were dependent on alcohol, nicotine, cocaine, methamphetamine, or cannabis and non-dependent participants for 21 individual studies (Total cases: 903; Total controls: 996). Then, the study-specific effect sizes were modeled using a hierarchical Bayesian approach in which the parameters of the study-specific effect size distributions were sampled from a higher-order overarching distribution. The posterior distribution of the overarching and study-specific parameters was approximated using the Gibbs sampling method.
RESULTS: The results showed shrinkage of the posterior distribution of the study-specific estimates toward the overarching estimates given the original effect sizes observed in individual studies. Differences between the original effect sizes (i.e., Cohen's d) and the point estimate of the posterior distribution ranged from 0 to 0.97. The magnitude of adjustment was negatively correlated with the sample size (r = -0.27, p < 0.001) and positively correlated with empirically estimated sampling variance (r = 0.40, p < 0.001), suggesting studies with smaller samples and larger sampling variance tended to have greater adjustments.
DISCUSSION: Our findings demonstrate the utility of the hierarchical Bayesian model in recalibrating single-study effect sizes using information from similar studies. This suggests that Bayesian utilization of existing knowledge can be an effective alternative approach to improve the effect size estimation in individual studies, particularly for those with smaller samples.
Language: en
LA - en SN - 2813-1193 UR - http://dx.doi.org/10.3389/fnimg.2023.1138193 ID - ref1 ER -