Degen, P. M.; Medo, M.

The high-dimensional and heterogeneous nature of transcriptomics data from RNA sequencing (RNA-Seq) experiments poses a challenge to routine downstream analysis steps, such as differential expression analysis and enrichment analysis. Additionally, due to practical and financial constraints, RNA-Seq experiments are often limited to a small number of biological replicates; three replicates is a commonly employed minimum cohort size. In light of recent studies on the low replicability of preclinical cancer research, it is essential to understand how the combination of population heterogeneity and underpowered cohort sizes affects the replicability of RNA-Seq research. Using 7\'000 simulated RNA-Seq experiments based on real gene expression data from seven different cancer types, we find that the analysis results from underpowered experiments exhibit inflated effect sizes and are unlikely to replicate well. However, the ground-truth results obtained by analyzing large cohorts show that the precision of differentially expressed genes can be high even for small cohort sizes. The poor replicability of underpowered experiments is thus a direct consequence of their low recall (sensitivity). In other words, the low replicability of underpowered RNA-Seq cancer studies does not necessarily indicate a high prevalence of false positives. Instead, the results obtained from such studies are limited to small and mostly random subsets of a larger ground truth. We conclude with a set of practical recommendations to alleviate problems with underpowered RNA-Seq studies.