Assessing the performance of spectroscopic models for cancer diagnostics using cross-validation and permutation testing

G. R. Lloyd; J. Hutchings; L. M. Almond; H. Barr; C. Kendall; N. Stone

doi:10.1117/12.919864

1 February 2012 Assessing the performance of spectroscopic models for cancer diagnostics using cross-validation and permutation testing

G. R. Lloyd, J. Hutchings, L. M. Almond, H. Barr, C. Kendall, N. Stone

Author Affiliations +

Proceedings Volume 8219, Biomedical Vibrational Spectroscopy V: Advances in Research and Industry; 82190C (2012) https://doi.org/10.1117/12.919864
Event: SPIE BiOS, 2012, San Francisco, California, United States

Abstract

Multivariate classifiers (such as Linear Discriminant Analysis, Support Vector Machines etc) are known to be useful tools for making diagnostic decisions based on spectroscopic data. However, robust techniques for assessing their performance (e.g. by sensitivity and specificity) are vital if the application of these methods is to be successful in the clinic. In this work the application of repeated cross-validation for estimating confidence intervals for sensitivity and specificity of multivariate classifiers is presented. Furthermore, permutation testing is presented as a suitable technique for estimating the probability of obtaining the observed sensitivity and specificity by chance. Both approaches are demonstrated through their application to a Raman spectroscopic model of gastrointestinal cancer.

Citation Download Citation

G. R. Lloyd, J. Hutchings, L. M. Almond, H. Barr, C. Kendall, and N. Stone "Assessing the performance of spectroscopic models for cancer diagnostics using cross-validation and permutation testing", Proc. SPIE 8219, Biomedical Vibrational Spectroscopy V: Advances in Research and Industry, 82190C (1 February 2012); https://doi.org/10.1117/12.919864

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available