The sky at one terabit per second: architecture and implementation of the Argus Array Hierarchical Data Processing System

Hank Corbett; Alan Vasquez Soto; Lawrence Machia; Nathan Galliher; Ramses Gonzalez; Nicholas M. Law

doi:10.1117/12.2629533

29 August 2022 The sky at one terabit per second: architecture and implementation of the Argus Array Hierarchical Data Processing System

Hank Corbett, Alan Vasquez Soto, Lawrence Machia, Nathan Galliher, Ramses Gonzalez, Nicholas M. Law

Author Affiliations +

Proceedings Volume 12189, Software and Cyberinfrastructure for Astronomy VII; 1218910 (2022) https://doi.org/10.1117/12.2629533
Event: SPIE Astronomical Telescopes + Instrumentation, 2022, Montréal, Québec, Canada

Abstract

The Argus Optical Array is a synoptic survey observatory, currently in development, that will have a total collecting area equivalent to a 5-meter monolithic telescope and an all-sky field of view, multiplexed from 900 commercial off-the-shelf telescopes. The Array will observe 7916 deg2 every second during high-speed operations (mg ≤ 16.1) and every 30 seconds at base cadence (mg ≤ 19.1), producing 4.3 PB and 145 TB respectively of data per night with its 55-gigapixel mosaic of cameras. The Argus Array Hierarchical Data Processing System (Argus-HDPS) is the instrument control and analysis pipeline for the Argus Array project, able to create fullyreduced data products in real time. We pair sub-arrays of cameras with co-located compute nodes, responsible for distilling the raw 11 Tbps data rate into transient alerts, full-resolution image segments around selected targets at 30-second cadence, and full-resolution coadds of the entire field of view at 15+-min cadences. Production of long-term light curves and transient discovery in deep coadds out to 5-day cadence (mg ≤ 24.0) will be scheduled for daytime operations. In this paper, we describe the data reduction strategy for the Argus Optical Array and demonstrate image segmentation, coaddition, and difference image analysis using the GPU-enabled Argus-HDPS pipelines on representative data from the Argus Array Technology Demonstrator.

Conference Presentation

Citation Download Citation

Hank Corbett, Alan Vasquez Soto, Lawrence Machia, Nathan Galliher, Ramses Gonzalez, and Nicholas M. Law "The sky at one terabit per second: architecture and implementation of the Argus Array Hierarchical Data Processing System", Proc. SPIE 12189, Software and Cyberinfrastructure for Astronomy VII, 1218910 (29 August 2022); https://doi.org/10.1117/12.2629533

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available