Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey

Jason J. Wang; Marshall D. Perrin; Dmitry Savransky; Pauline Arriaga; Jeffrey K. Chilcote; Robert J. De Rosa; Maxwell A. Millar-Blanchaer; Christian Marois; Julien Rameau; Schuyler G. Wolff; Jacob Shapiro; Jean-Baptiste Ruffio; Jérôme Maire; Franck Marchis; James R. Graham; Bruce Macintosh; S. Mark Ammons; Vanessa P. Bailey; Travis S. Barman; Sebastian Bruzzone; Joanna Bulger; Tara Cotten; René Doyon; Gaspard Duchêne; Michael P. Fitzgerald; Katherine B. Follette; Stephen Goodsell; Alexandra Z. Greenbaum; Pascale Hibon; Li-Wei Hung; Patrick Ingraham; Paul Kalas; Quinn M. Konopacky; James E. Larkin; Mark S. Marley; Stanimir Metchev; Eric L. Nielsen; Rebecca Oppenheimer; David W. Palmer; Jennifer Patience; Lisa A. Poyneer; Laurent Pueyo; Abhijith Rajan; Fredrik T. Rantakyrö; Adam C. Schneider; Anand Sivaramakrishnan; Inseok Song; Rémi Soummer; Sandrine Thomas; J. Kent Wallace; Kimberly Ward-Duong; Sloane J. Wiktorowicz

doi:10.1117/1.JATIS.4.1.018002

18 January 2018 Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey

Jason J. Wang, Marshall D. Perrin, Dmitry Savransky, Pauline Arriaga, Jeffrey K. Chilcote, Robert J. De Rosa, Maxwell A. Millar-Blanchaer, Christian Marois, Julien Rameau, Schuyler G. Wolff, Jacob Shapiro, Jean-Baptiste Ruffio, Jérôme Maire, Franck Marchis, James R. Graham, Bruce Macintosh, S. Mark Ammons, Vanessa P. Bailey, Travis S. Barman, Sebastian Bruzzone, Joanna Bulger, Tara Cotten, René Doyon, Gaspard Duchêne, Michael P. Fitzgerald, Katherine B. Follette, Stephen Goodsell, Alexandra Z. Greenbaum, Pascale Hibon, Li-Wei Hung, Patrick Ingraham, Paul Kalas, Quinn M. Konopacky, James E. Larkin, Mark S. Marley, Stanimir Metchev, Eric L. Nielsen, Rebecca Oppenheimer, David W. Palmer, Jennifer Patience, Lisa A. Poyneer, Laurent Pueyo, Abhijith Rajan, Fredrik T. Rantakyrö, Adam C. Schneider, Anand Sivaramakrishnan, Inseok Song, Rémi Soummer, Sandrine Thomas, J. Kent Wallace, Kimberly Ward-Duong, Sloane J. Wiktorowicz

Author Affiliations +

Journal of Astronomical Telescopes, Instruments, and Systems, Vol. 4, Issue 1, 018002 (January 2018). https://doi.org/10.1117/1.JATIS.4.1.018002

Abstract

The Gemini Planet Imager Exoplanet Survey (GPIES) is a multiyear direct imaging survey of 600 stars to discover and characterize young Jovian exoplanets and their environments. We have developed an automated data architecture to process and index all data related to the survey uniformly. An automated and flexible data processing framework, which we term the Data Cruncher, combines multiple data reduction pipelines (DRPs) together to process all spectroscopic, polarimetric, and calibration data taken with GPIES. With no human intervention, fully reduced and calibrated data products are available less than an hour after the data are taken to expedite follow up on potential objects of interest. The Data Cruncher can run on a supercomputer to reprocess all GPIES data in a single day as improvements are made to our DRPs. A backend MySQL database indexes all files, which are synced to the cloud, and a front-end web server allows for easy browsing of all files associated with GPIES. To help observers, quicklook displays show reduced data as they are processed in real time, and chatbots on Slack post observing information as well as reduced data products. Together, the GPIES automated data processing architecture reduces our workload, provides real-time data reduction, optimizes our observing strategy, and maintains a homogeneously reduced dataset to study planet occurrence and instrument performance.

Citation Download Citation

Jason J. Wang, Marshall D. Perrin, Dmitry Savransky, Pauline Arriaga, Jeffrey K. Chilcote, Robert J. De Rosa, Maxwell A. Millar-Blanchaer, Christian Marois, Julien Rameau, Schuyler G. Wolff, Jacob Shapiro, Jean-Baptiste Ruffio, Jérôme Maire, Franck Marchis, James R. Graham, Bruce Macintosh, S. Mark Ammons, Vanessa P. Bailey, Travis S. Barman, Sebastian Bruzzone, Joanna Bulger, Tara Cotten, René Doyon, Gaspard Duchêne, Michael P. Fitzgerald, Katherine B. Follette, Stephen Goodsell, Alexandra Z. Greenbaum, Pascale Hibon, Li-Wei Hung, Patrick Ingraham, Paul Kalas, Quinn M. Konopacky, James E. Larkin, Mark S. Marley, Stanimir Metchev, Eric L. Nielsen, Rebecca Oppenheimer, David W. Palmer, Jennifer Patience, Lisa A. Poyneer, Laurent Pueyo, Abhijith Rajan, Fredrik T. Rantakyrö, Adam C. Schneider, Anand Sivaramakrishnan, Inseok Song, Rémi Soummer, Sandrine Thomas, J. Kent Wallace, Kimberly Ward-Duong, and Sloane J. Wiktorowicz "Automated data processing architecture for the Gemini Planet Imager Exoplanet Survey," Journal of Astronomical Telescopes, Instruments, and Systems 4(1), 018002 (18 January 2018). https://doi.org/10.1117/1.JATIS.4.1.018002

Received: 18 September 2017; Accepted: 18 December 2017; Published: 18 January 2018

ACCESS THE FULL ARTICLE

JOURNAL ARTICLE
14 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY