Calibration of credibility of agnostic genome‐wide associations

Abstract Genome‐wide testing platforms are increasingly used to promote “agnostic” approaches to the discovery of gene variants associated with the risk of many common diseases and quantitative traits. The early track record of genome‐wide association (GWA) studies suggests that some proposed associations are replicated quite consistently with large‐scale subsequent evidence from multiple studies, others have a more inconsistent replication record, some have failed to be replicated by independent investigators and many more early proposed associations await further replication. An important question is how to calibrate the credibility of these postulated associations. A simple Bayesian method is applied here to achieve such calibration. The variability of the estimated credibility is examined under different assumptions. Empirical examples are drawn from existing GWA studies. It is demonstrated that the credibility of different proposed associations can cover a very wide range. The credibility of specific associations usually remains relatively robust when different plausible assumptions are made (within a reasonable range) for the prior odds of an association being true, or the magnitude of the anticipated effect size for genetic associations. Heterogeneity and bias assumptions can have a more major impact on the credibility estimates and thus they need very careful consideration in each case. Credibility calibration may be used in conjunction with qualitative criteria for the appraisal of the cumulative evidence that take into consideration the amount, consistency, and protection from bias in the data. © 2008 Wiley‐Liss, Inc.