© 2005 Oxford University Press
BRIEF COMMUNICATION |
Signal in Noise: Evaluating Reported Reproducibility of Serum Proteomic Tests for Ovarian Cancer
Affiliations of authors: Department of Biostatistics, M.D. Anderson Cancer Center, Houston, TX (KAB, JSM, KRC); Department of Family and Community Medicine, Baylor College of Medicine, Houston, TX (SRE)
Correspondence to: Keith A. Baggerly, Department of Biostatistics, 1515 Holcombe Blvd., Box 447, Houston, TX 77030–4009 (e-mail: kabagg{at}mdanderson.org).
Proteomic profiling of serum initially appeared to be dramatically effective for diagnosis of early-stage ovarian cancer, but these results have proven difficult to reproduce. A recent publication reported good classification in one dataset using results from training on a much earlier dataset, but the authors have since reported that they did not perform the analysis as described. We examined the reproducibility of the proteomic patterns across datasets in more detail. Our analysis reveals that the pattern that enabled successful classification is biologically implausible and that the method, properly applied, does not classify the data accurately. We show that the method used in previously published studies does not establish reproducibility and performs no better than chance for classifying the second dataset, in part because the second dataset is easy to classify correctly. We conclude that the reproducibility of the proteomic profiling approach has yet to be established.
CiteULike 
Connotea 
Del.icio.us What's this?
Related Commentaries in JNCI
- Importance of Communication Between Producers and Consumers of Publicly Available Experimental Data
- Lance A. Liotta, Mark Lowenthal, Arpita Mehta, Thomas P. Conrads, Timothy D. Veenstra, David A. Fishman, and Emanuel F. Petricoin, III
J Natl Cancer Inst 2005 97: 310-314.[Abstract] [Full Text] [PDF]
- Lessons from Controversy: Ovarian Cancer Screening and Serum Proteomics
- David F. Ransohoff
J Natl Cancer Inst 2005 97: 315-319.[Abstract] [Full Text] [PDF]
This article has been cited by other articles:
|
|
 |
|
  J. M.G. Taylor, D. P. Ankerst, and R. R. Andridge Validation of Biomarker-Based Risk Prediction Models Clin. Cancer Res., October 1, 2008; 14(19): 5977 - 5983. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. W. Duncan, H. Roder, and S. W. Hunsucker Quantitative matrix-assisted laser desorption/ionization mass spectrometry Brief Funct Genomic Proteomic, September 1, 2008; 7(5): 355 - 370. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. S. Tworoger, D. Spentzos, F. T. Grall, T. A. Liebermann, and S. E. Hankinson Reproducibility of Proteomic Profiles Over 3 Years in Postmenopausal Women Not Taking Postmenopausal Hormones Cancer Epidemiol. Biomarkers Prev., June 1, 2008; 17(6): 1480 - 1485. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Barla, G. Jurman, S. Riccadonna, S. Merler, M. Chierici, and C. Furlanello Machine learning methods for predictive proteomics Brief Bioinform, March 1, 2008; 9(2): 119 - 128. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. N. McGuire, J. Overgaard, and F. Pociot Mass spectrometry is only one piece of the puzzle in clinical proteomics Brief Funct Genomic Proteomic, February 28, 2008; (2008) eln005v1. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Harezlak, M. Wang, D. Christiani, and X. Lin Quantitative quality-assessment techniques to compare fractionation and depletion methods in SELDI-TOF mass spectrometry experiments Bioinformatics, September 15, 2007; 23(18): 2441 - 2448. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 F. K. Parekh and T. L. Richie Characterization of Immune Reactivity Profiles Using Microarray Technology May Expedite Identification of Candidate Antigens for Next Generation Malaria Vaccines Clin. Chem., July 1, 2007; 53(7): 1183 - 1185. [Full Text] [PDF]
|
|
|
|
|
|
E. P. Diamandis Oncopeptidomics: A Useful Approach for Cancer Diagnosis? Clin. Chem., June 1, 2007; 53(6): 1004 - 1006. [Full Text] [PDF]
|
|
|
|
|
|
M. F. Lopez, A. Mikulskis, S. Kuzdzal, E. Golenko, E. F. Petricoin III, L. A. Liotta, W. F. Patton, G. R. Whiteley, K. Rosenblatt, P. Gurnani, et al. A Novel, High-Throughput Workflow for Discovery and Identification of Serum Carrier Protein-Bound Peptide Biomarker Candidates in Ovarian Cancer Samples Clin. Chem., June 1, 2007; 53(6): 1067 - 1074. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. F. Timms, E. Arslan-Low, A. Gentry-Maharaj, Z. Luo, D. T'Jampens, V. N. Podust, J. Ford, E. T. Fung, A. Gammerman, I. Jacobs, et al. Preanalytic Influence of Sample Handling on SELDI-TOF Serum Protein Profiles Clin. Chem., April 1, 2007; 53(4): 645 - 656. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 D. Nedelkov, U. A. Kiernan, E. E. Niederkofler, K. A. Tubbs, and R. W. Nelson Population Proteomics: The Concept, Attributes, and Potential for Cancer Biomarker Research Mol. Cell. Proteomics, October 1, 2006; 5(10): 1811 - 1818. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. E. Moore, E. T. Fung, M. McGuire, C. C. Rabkin, A. Molinaro, Z. Wang, F. Zhang, J. Wang, C. Yip, X.-Y. Meng, et al. Evaluation of apolipoprotein A1 and posttranslationally modified forms of transthyretin as biomarkers for ovarian cancer detection in an independent study population. Cancer Epidemiol. Biomarkers Prev., September 1, 2006; 15(9): 1641 - 1646. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Fisher Wilson The rocky road to useful cancer biomarkers. Ann Intern Med, June 20, 2006; 144(12): 945 - 948. [Full Text] [PDF]
|
|
|
|
 |
|
 E. P. Diamandis Serum Proteomic Profiling by Matrix-Assisted Laser Desorption-Ionization Time-of-Flight Mass Spectrometry for Cancer Diagnosis: Next Steps Cancer Res., June 1, 2006; 66(11): 5540 - 5541. [Full Text] [PDF]
|
|
|
|
 |
|
 R. C Millikan Commentary: The Human Genome: philosopher's stone or magic wand? Int. J. Epidemiol., June 1, 2006; 35(3): 578 - 581. [Full Text] [PDF]
|
|
|
|
|
|
E. P. Diamandis Validation of breast cancer biomarkers identified by mass spectrometry. Clin. Chem., April 1, 2006; 52(4): 771 - 772. [Full Text] [PDF]
|
|
|
|
 |
|
 L. Y. Han, C. N. Landen Jr, A. A. Kamat, A. Lopez, D. P. Bender, P. Mueller, R. Schmandt, D. M. Gershenson, and A. K. Sood Preoperative Serum Tissue Factor Levels Are an Independent Prognostic Factor in Patients With Ovarian Carcinoma J. Clin. Oncol., February 10, 2006; 24(5): 755 - 761. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. W. Duncan and S. W. Hunsucker Proteomics as a Tool for Clinically Relevant Biomarker Discovery and Validation Experimental Biology and Medicine, December 1, 2005; 230(11): 808 - 817. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Findeisen, D. Sismanidis, M. Riedl, V. Costina, and M. Neumaier Preanalytical Impact of Sample Handling on Proteome Profiling Experiments with Matrix-Assisted Laser Desorption/Ionization Time-of-Flight Mass Spectrometry Clin. Chem., December 1, 2005; 51(12): 2409 - 2411. [Full Text] [PDF]
|
|
|
|
|
|
T. W. Randolph, B. L. Mitchell, D. F. McLerran, P. D. Lampe, and Z. Feng Quantifying Peptide Signal in MALDI-TOF Mass Spectrometry Data Mol. Cell. Proteomics, December 1, 2005; 4(12): 1990 - 1999. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Z. Zhang and D. W. Chan Cancer Proteomics: In Pursuit of "True" Biomarker Discovery Cancer Epidemiol. Biomarkers Prev., October 1, 2005; 14(10): 2283 - 2286. [Full Text] [PDF]
|
|
|
|
|
|
N. L. Anderson The Roles of Multiple Proteomic Platforms in a Pipeline for New Diagnostics Mol. Cell. Proteomics, October 1, 2005; 4(10): 1441 - 1444. [Full Text] [PDF]
|
|
|
|
|
|
M. F. Lopez, A. Mikulskis, S. Kuzdzal, D. A. Bennett, J. Kelly, E. Golenko, J. DiCesare, E. Denoyer, W. F. Patton, R. Ediger, et al. High-Resolution Serum Proteomic Profiling of Alzheimer Disease Samples Reveals Disease-Specific, Carrier-Protein-Bound Mass Signatures Clin. Chem., October 1, 2005; 51(10): 1946 - 1954. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. Karsan, B. J. Eigl, S. Flibotte, K. Gelmon, P. Switzer, P. Hassell, D. Harrison, J. Law, M. Hayes, M. Stillwell, et al. Analytical and Preanalytical Biases in Serum Proteomic Pattern Analysis for Breast Cancer Diagnosis Clin. Chem., August 1, 2005; 51(8): 1525 - 1528. [Full Text] [PDF]
|
|
|
|
|
|
M. Goggins Molecular Markers of Early Pancreatic Cancer J. Clin. Oncol., July 10, 2005; 23(20): 4524 - 4531. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L. A. Liotta, M. Lowenthal, A. Mehta, T. P. Conrads, T. D. Veenstra, D. A. Fishman, and E. F. Petricoin III Importance of Communication Between Producers and Consumers of Publicly Available Experimental Data J Natl Cancer Inst, February 16, 2005; 97(4): 310 - 314. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. F. Ransohoff Lessons from Controversy: Ovarian Cancer Screening and Serum Proteomics J Natl Cancer Inst, February 16, 2005; 97(4): 315 - 319. [Abstract] [Full Text] [PDF]
|
|