The balance of reproducibility, sensitivity, and specificity of lists of differentially expressed genes in microarray studies

Simple item page
dc.contributor.authorShi, Lemingen
dc.contributor.authorJones, Wendell D.en
dc.contributor.authorJensen, Roderick V.en
dc.contributor.authorHarris, Stephen C.en
dc.contributor.authorPerkins, Roger G.en
dc.contributor.authorGoodsaid, Federico M.en
dc.contributor.authorGuo, Leien
dc.contributor.authorCroner, Lisa J.en
dc.contributor.authorBoysen, Cecilieen
dc.contributor.authorFang, Hongen
dc.contributor.authorQian, Fengen
dc.contributor.authorAmur, Shashien
dc.contributor.authorBao, Wenjunen
dc.contributor.authorBarbacioru, Catalin C.en
dc.contributor.authorBertholet, Vincenten
dc.contributor.authorCao, Xiaoxi M.en
dc.contributor.authorChu, Tzu-Mingen
dc.contributor.authorCollins, Patrick J.en
dc.contributor.authorFan, Xiao-huien
dc.contributor.authorFrueh, Felix W.en
dc.contributor.authorFuscoe, James C.en
dc.contributor.authorGuo, Xuen
dc.contributor.authorHan, Jingen
dc.contributor.authorHerman, Damiren
dc.contributor.authorHong, Huixiaoen
dc.contributor.authorKawasaki, Ernest S.en
dc.contributor.authorLi, Quan-Zhenen
dc.contributor.authorLuo, Yulingen
dc.contributor.authorMa, Yunqingen
dc.contributor.authorMei, Nanen
dc.contributor.authorPeterson, Ron L.en
dc.contributor.authorPuri, Raj K.en
dc.contributor.authorShippy, Richarden
dc.contributor.authorSu, Zhenqiangen
dc.contributor.authorSun, Yongming A.en
dc.contributor.authorSun, Hongmeien
dc.contributor.authorThorn, Bretten
dc.contributor.authorTurpaz, Yaronen
dc.contributor.authorWang, Charlesen
dc.contributor.authorWang, Sue J.en
dc.contributor.authorWarrington, Janet A.en
dc.contributor.authorWilley, James C.en
dc.contributor.authorWu, Jieen
dc.contributor.authorXie, Qianen
dc.contributor.authorZhang, Liangen
dc.contributor.authorZhang, Luen
dc.contributor.authorZhong, Shengen
dc.contributor.authorWolfinger, Russell D.en
dc.contributor.authorTong, Weidaen
dc.contributor.departmentBiological Sciencesen
dc.date.accessioned2012-08-24T11:54:47Zen
dc.date.available2012-08-24T11:54:47Zen
dc.date.issued2008-08-12en
dc.date.updated2012-08-24T11:54:47Zen
dc.description.abstractBackground Reproducibility is a fundamental requirement in scientific experiments. Some recent publications have claimed that microarrays are unreliable because lists of differentially expressed genes (DEGs) are not reproducible in similar experiments. Meanwhile, new statistical methods for identifying DEGs continue to appear in the scientific literature. The resultant variety of existing and emerging methods exacerbates confusion and continuing debate in the microarray community on the appropriate choice of methods for identifying reliable DEG lists. Results Using the data sets generated by the MicroArray Quality Control (MAQC) project, we investigated the impact on the reproducibility of DEG lists of a few widely used gene selection procedures. We present comprehensive results from inter-site comparisons using the same microarray platform, cross-platform comparisons using multiple microarray platforms, and comparisons between microarray results and those from TaqMan - the widely regarded "standard" gene expression platform. Our results demonstrate that (1) previously reported discordance between DEG lists could simply result from ranking and selecting DEGs solely by statistical significance (P) derived from widely used simple t-tests; (2) when fold change (FC) is used as the ranking criterion with a non-stringent P-value cutoff filtering, the DEG lists become much more reproducible, especially when fewer genes are selected as differentially expressed, as is the case in most microarray studies; and (3) the instability of short DEG lists solely based on P-value ranking is an expected mathematical consequence of the high variability of the t-values; the more stringent the P-value threshold, the less reproducible the DEG list is. These observations are also consistent with results from extensive simulation calculations. Conclusion We recommend the use of FC-ranking plus a non-stringent P cutoff as a straightforward and baseline practice in order to generate more reproducible DEG lists. Specifically, the P-value cutoff should not be stringent (too small) and FC should be as large as possible. Our results provide practical guidance to choose the appropriate FC and P-value cutoffs when selecting a given number of DEGs. The FC criterion enhances reproducibility, whereas the P criterion balances sensitivity and specificity.en
dc.description.versionPublished versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.citationBMC Bioinformatics. 2008 Aug 12;9(Suppl 9):S10en
dc.identifier.doihttps://doi.org/10.1186/1471-2105-9-S9-S10en
dc.identifier.urihttp://hdl.handle.net/10919/18884en
dc.language.isoenen
dc.rightsCreative Commons Attribution 4.0 Internationalen
dc.rights.holderLeming Shi et al.; licensee BioMed Central Ltd.en
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en
dc.titleThe balance of reproducibility, sensitivity, and specificity of lists of differentially expressed genes in microarray studiesen
dc.title.serialBMC Bioinformaticsen
dc.typeArticle - Refereeden
dc.type.dcmitypeTexten

Files

Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
1471-2105-9-S9-S10.pdf
Size:
1.32 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
Name:
license.txt
Size:
1.5 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Journal Articles, BioMed Central and SpringerOpen
Scholarly Works, Biological Sciences