Predicting cognitive scores from resting fMRI data and geometric features of the brain

Anand A. Joshi; Jian Li; Haleh Akrami; Richard M. Leahy

doi:10.1117/12.2512063

15 March 2019 Predicting cognitive scores from resting fMRI data and geometric features of the brain

Anand A. Joshi, Jian Li, Haleh Akrami, Richard M. Leahy

Proceedings Volume 10949, Medical Imaging 2019: Image Processing; 109492E (2019) https://doi.org/10.1117/12.2512063
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

Anatomical T1 weighted Magnetic Resonance Imaging (MRI) and functional magnetic resonance imaging collected during resting (rfMRI) are promising markers that offer insight into structure and function of the human brain. The objective of this work is to explore the use of a deep learning neural network to predict cognitive performance scores and ADHD indices in a group of ADHD and control subjects. First, we processed the rfMRI and MRI data of subjects using the BrainSuite fMRI Processing (BFP) pipeline to perform anatomical and functional preprocessing. This produces for each subject fMRI and geometric (anatomical) features represented in a standardized grayordinate system. The geometric and functional cortical data corresponding to the two hemispheres were then transformed to 128x128 multichannel images and input to a convolutional component of the neural network. Subcortical data were presented in a standard vector form and input to a standard input layer of the network. The neural network was implemented in Python using the Keras library with a TensorFlow backend. Training was performed on 168 images with 90 images used for testing. We observed significant correlation between predicted and actual values of the indices tested: Performance IQ: 0.47; Verbal IQ: 0.41, ADHD: 0.57. Comparing these values to those from network trained on functional-only and structural-only data, we saw that rfMRI is more informative than MRI, but the two modalities are highly complementary in terms of predicting these indices.

Citation Download Citation

Anand A. Joshi, Jian Li, Haleh Akrami, and Richard M. Leahy "Predicting cognitive scores from resting fMRI data and geometric features of the brain", Proc. SPIE 10949, Medical Imaging 2019: Image Processing, 109492E (15 March 2019); https://doi.org/10.1117/12.2512063

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available