Status of the Automated Data Extraction, Processing, and Tracking System (ADEPTS) for CHARIS/SCExAO

Taylor L. Tobin; Jonathan Pal; Jeffrey Chilcote; Timothy Brandt; Thayne Currie; Tyler Groff; Julien Lozi; Olivier Guyon

doi:10.1117/12.2630368

Status of the Automated Data Extraction, Processing, and Tracking System (ADEPTS) for CHARIS/SCExAO

Taylor L. Tobin, Jonathan Pal, Jeffrey Chilcote, Timothy Brandt, Thayne Currie, Tyler Groff, Julien Lozi, Olivier Guyon

Optical Sciences

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

CHARIS is a near-infrared (JHK) coronagraphic integral field spectrograph (IFS) housed on the Subaru Telescope. In conjunction with the extreme adaptive optics system, SCExAO, it provides high-contrast spectral imaging of substellar companions and circumstellar disks. However, data extraction, calibration, and processing are time consuming processes with a steep learning curve, creating a bottleneck and slowing the production of scientific results. The new Automated Data Extraction, Processing, and Tracking System (ADEPTS) will automatically process all data taken by CHARIS, building calibration files and extracting science-grade data cubes, as well as performing post-processing on the results using default parameters. ADEPTS also serves as a backend for CHARIS in terms of file organization, logging all raw and produced files in a searchable SQLite database and providing a mechanism for user flagging of bad files. By using automation to remove wait times and reducing elapsed computation time via parallelization on its home 72-CPU processor, ADEPTS will be able to produce science-grade data products within a day of observations. We present an update on the current status of ADEPTS, as well as new features and design modifications.

Original language	English (US)
Title of host publication	Software and Cyberinfrastructure for Astronomy VII
Editors	Jorge Ibsen, Gianluca Chiozzi
Publisher	SPIE
ISBN (Electronic)	9781510653597
DOIs	https://doi.org/10.1117/12.2630368
State	Published - 2022
Event	Software and Cyberinfrastructure for Astronomy VII 2022 - Montreal, Canada Duration: Jul 17 2022 → Jul 21 2022

Publication series

Name	Proceedings of SPIE - The International Society for Optical Engineering
Volume	12189
ISSN (Print)	0277-786X
ISSN (Electronic)	1996-756X

Conference

Conference	Software and Cyberinfrastructure for Astronomy VII 2022
Country/Territory	Canada
City	Montreal
Period	7/17/22 → 7/21/22

Keywords

ADEPTS
CHARIS
Data archive systems
Data management
Databases
Image processing
SCExAO
Software development

ASJC Scopus subject areas

Electronic, Optical and Magnetic Materials
Condensed Matter Physics
Computer Science Applications
Applied Mathematics
Electrical and Electronic Engineering

Access to Document

10.1117/12.2630368

Cite this

Tobin, T. L., Pal, J., Chilcote, J., Brandt, T., Currie, T., Groff, T., Lozi, J., & Guyon, O. (2022). Status of the Automated Data Extraction, Processing, and Tracking System (ADEPTS) for CHARIS/SCExAO. In J. Ibsen, & G. Chiozzi (Eds.), Software and Cyberinfrastructure for Astronomy VII [121892C] (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 12189). SPIE. https://doi.org/10.1117/12.2630368

Status of the Automated Data Extraction, Processing, and Tracking System (ADEPTS) for CHARIS/SCExAO. / Tobin, Taylor L.; Pal, Jonathan; Chilcote, Jeffrey et al.

Software and Cyberinfrastructure for Astronomy VII. ed. / Jorge Ibsen; Gianluca Chiozzi. SPIE, 2022. 121892C (Proceedings of SPIE - The International Society for Optical Engineering; Vol. 12189).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Tobin, TL, Pal, J, Chilcote, J, Brandt, T, Currie, T, Groff, T, Lozi, J & Guyon, O 2022, Status of the Automated Data Extraction, Processing, and Tracking System (ADEPTS) for CHARIS/SCExAO. in J Ibsen & G Chiozzi (eds), Software and Cyberinfrastructure for Astronomy VII., 121892C, Proceedings of SPIE - The International Society for Optical Engineering, vol. 12189, SPIE, Software and Cyberinfrastructure for Astronomy VII 2022, Montreal, Canada, 7/17/22. https://doi.org/10.1117/12.2630368

@inproceedings{5c427933fd574e4bba3bd44d43634c92,

title = "Status of the Automated Data Extraction, Processing, and Tracking System (ADEPTS) for CHARIS/SCExAO",

abstract = "CHARIS is a near-infrared (JHK) coronagraphic integral field spectrograph (IFS) housed on the Subaru Telescope. In conjunction with the extreme adaptive optics system, SCExAO, it provides high-contrast spectral imaging of substellar companions and circumstellar disks. However, data extraction, calibration, and processing are time consuming processes with a steep learning curve, creating a bottleneck and slowing the production of scientific results. The new Automated Data Extraction, Processing, and Tracking System (ADEPTS) will automatically process all data taken by CHARIS, building calibration files and extracting science-grade data cubes, as well as performing post-processing on the results using default parameters. ADEPTS also serves as a backend for CHARIS in terms of file organization, logging all raw and produced files in a searchable SQLite database and providing a mechanism for user flagging of bad files. By using automation to remove wait times and reducing elapsed computation time via parallelization on its home 72-CPU processor, ADEPTS will be able to produce science-grade data products within a day of observations. We present an update on the current status of ADEPTS, as well as new features and design modifications.",

keywords = "ADEPTS, CHARIS, Data archive systems, Data management, Databases, Image processing, SCExAO, Software development",

author = "Tobin, {Taylor L.} and Jonathan Pal and Jeffrey Chilcote and Timothy Brandt and Thayne Currie and Tyler Groff and Julien Lozi and Olivier Guyon",

note = "Funding Information: This research is based on data collected at Subaru Telescope, which is operated by the National Astronomical Observatory of Japan. The authors wish to recognize and acknowledge the very significant cultural role and reverence that the summit of Mauna Kea has always had within the indigenous Hawaiian community. We are most fortunate to have the opportunity to conduct observations from this mountain. This research was supported in part by the Notre Dame Center for Research Computing. We specifically acknowledge the assistance of Dodi Heryadi and Scott Hampton. Publisher Copyright: {\textcopyright} COPYRIGHT SPIE. Downloading of the abstract is permitted for personal use only.; Software and Cyberinfrastructure for Astronomy VII 2022 ; Conference date: 17-07-2022 Through 21-07-2022",

year = "2022",

doi = "10.1117/12.2630368",

language = "English (US)",

series = "Proceedings of SPIE - The International Society for Optical Engineering",

publisher = "SPIE",

editor = "Jorge Ibsen and Gianluca Chiozzi",

booktitle = "Software and Cyberinfrastructure for Astronomy VII",

}

TY - GEN

T1 - Status of the Automated Data Extraction, Processing, and Tracking System (ADEPTS) for CHARIS/SCExAO

AU - Tobin, Taylor L.

AU - Pal, Jonathan

AU - Chilcote, Jeffrey

AU - Brandt, Timothy

AU - Currie, Thayne

AU - Groff, Tyler

AU - Lozi, Julien

AU - Guyon, Olivier

N1 - Funding Information: This research is based on data collected at Subaru Telescope, which is operated by the National Astronomical Observatory of Japan. The authors wish to recognize and acknowledge the very significant cultural role and reverence that the summit of Mauna Kea has always had within the indigenous Hawaiian community. We are most fortunate to have the opportunity to conduct observations from this mountain. This research was supported in part by the Notre Dame Center for Research Computing. We specifically acknowledge the assistance of Dodi Heryadi and Scott Hampton. Publisher Copyright: © COPYRIGHT SPIE. Downloading of the abstract is permitted for personal use only.

PY - 2022

Y1 - 2022

N2 - CHARIS is a near-infrared (JHK) coronagraphic integral field spectrograph (IFS) housed on the Subaru Telescope. In conjunction with the extreme adaptive optics system, SCExAO, it provides high-contrast spectral imaging of substellar companions and circumstellar disks. However, data extraction, calibration, and processing are time consuming processes with a steep learning curve, creating a bottleneck and slowing the production of scientific results. The new Automated Data Extraction, Processing, and Tracking System (ADEPTS) will automatically process all data taken by CHARIS, building calibration files and extracting science-grade data cubes, as well as performing post-processing on the results using default parameters. ADEPTS also serves as a backend for CHARIS in terms of file organization, logging all raw and produced files in a searchable SQLite database and providing a mechanism for user flagging of bad files. By using automation to remove wait times and reducing elapsed computation time via parallelization on its home 72-CPU processor, ADEPTS will be able to produce science-grade data products within a day of observations. We present an update on the current status of ADEPTS, as well as new features and design modifications.

AB - CHARIS is a near-infrared (JHK) coronagraphic integral field spectrograph (IFS) housed on the Subaru Telescope. In conjunction with the extreme adaptive optics system, SCExAO, it provides high-contrast spectral imaging of substellar companions and circumstellar disks. However, data extraction, calibration, and processing are time consuming processes with a steep learning curve, creating a bottleneck and slowing the production of scientific results. The new Automated Data Extraction, Processing, and Tracking System (ADEPTS) will automatically process all data taken by CHARIS, building calibration files and extracting science-grade data cubes, as well as performing post-processing on the results using default parameters. ADEPTS also serves as a backend for CHARIS in terms of file organization, logging all raw and produced files in a searchable SQLite database and providing a mechanism for user flagging of bad files. By using automation to remove wait times and reducing elapsed computation time via parallelization on its home 72-CPU processor, ADEPTS will be able to produce science-grade data products within a day of observations. We present an update on the current status of ADEPTS, as well as new features and design modifications.

KW - ADEPTS

KW - CHARIS

KW - Data archive systems

KW - Data management

KW - Databases

KW - Image processing

KW - SCExAO

KW - Software development

UR - http://www.scopus.com/inward/record.url?scp=85140086901&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85140086901&partnerID=8YFLogxK

U2 - 10.1117/12.2630368

DO - 10.1117/12.2630368

M3 - Conference contribution

AN - SCOPUS:85140086901

T3 - Proceedings of SPIE - The International Society for Optical Engineering

BT - Software and Cyberinfrastructure for Astronomy VII

A2 - Ibsen, Jorge

A2 - Chiozzi, Gianluca

PB - SPIE

T2 - Software and Cyberinfrastructure for Astronomy VII 2022

Y2 - 17 July 2022 through 21 July 2022

ER -

Status of the Automated Data Extraction, Processing, and Tracking System (ADEPTS) for CHARIS/SCExAO

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this