Kepler Science Operations Center pipeline framework

Todd C. Klaus; Sean McCauliff; Miles T. Cote; Forrest R. Girouard; Bill Wohler; Christopher Allen; Christopher Middour; Douglas A. Caldwell; Jon M. Jenkins

doi:10.1117/12.856634

19 July 2010 Kepler Science Operations Center pipeline framework

Todd C. Klaus, Sean McCauliff, Miles T. Cote, Forrest R. Girouard, Bill Wohler, Christopher Allen, Christopher Middour, Douglas A. Caldwell, Jon M. Jenkins

Author Affiliations +

Proceedings Volume 7740, Software and Cyberinfrastructure for Astronomy; 774017 (2010) https://doi.org/10.1117/12.856634
Event: SPIE Astronomical Telescopes + Instrumentation, 2010, San Diego, California, United States

Abstract

The Kepler Mission is designed to continuously monitor up to 170,000 stars at a 30-minute cadence for 3.5 years searching for Earth-size planets. The data are processed at the Science Operations Center at NASA Ames Research Center. Because of the large volume of data and the memory needed, as well as the CPU-intensive nature of the analyses, significant computing hardware is required. We have developed generic pipeline framework software that is used to distribute and synchronize processing across a cluster of CPUs and provide data accountability for the resulting products. The framework is written in Java and is, therefore, platform-independent. The framework scales from a single, standalone workstation (for development and research on small data sets) to a full cluster of homogeneous or heterogeneous hardware with minimal configuration changes. A plug-in architecture provides customized, dynamic control of the unit of work without the need to modify the framework. Distributed transaction services provide for atomic storage of pipeline products for a unit of work across a relational database and the custom Kepler DB. Generic parameter management and data accountability services record parameter values, software versions, and other metadata used for each pipeline execution. A graphical user interface allows for configuration, execution, and monitoring of pipelines. The framework was developed for the Kepler Mission based on Kepler requirements, but the framework itself is generic and could be used for a variety of applications where these features are needed.

Citation Download Citation

Todd C. Klaus, Sean McCauliff, Miles T. Cote, Forrest R. Girouard, Bill Wohler, Christopher Allen, Christopher Middour, Douglas A. Caldwell, and Jon M. Jenkins "Kepler Science Operations Center pipeline framework", Proc. SPIE 7740, Software and Cyberinfrastructure for Astronomy, 774017 (19 July 2010); https://doi.org/10.1117/12.856634

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available