Python and pipelines: Python interfaces for ESO’s CPL and HDRL data reduction libraries

Anthony Horton; Anthony Heng; Aidan Farrell; Mrunmayi Deshpande; Brent Miszalski; Nuwanthika Fernando; Nuria Lorente; Ralf Palsa; Lars Lundin; Armin Gabasch

doi:10.1117/12.3019678

25 July 2024 Python and pipelines: Python interfaces for ESO’s CPL and HDRL data reduction libraries

Anthony Horton, Anthony Heng, Aidan Farrell, Mrunmayi Deshpande, Brent Miszalski, Nuwanthika Fernando, Nuria Lorente, Ralf Palsa, Lars Lundin, Armin Gabasch

Author Affiliations +

Proceedings Volume 13101, Software and Cyberinfrastructure for Astronomy VIII; 131013Q (2024) https://doi.org/10.1117/12.3019678
Event: SPIE Astronomical Telescopes + Instrumentation, 2024, Yokohama, Japan

Conference Poster

Abstract

The ESO Common Pipeline Library (CPL) and High-Level Data Reduction Library (HDRL) together form a comprehensive, efficient and robust software toolkit for data reduction pipelines. They were developed in C for reasons of efficiency and speed, however, with the community’s preference towards Python for algorithm prototyping and data reduction, there is a need for access from Python. PyCPL and PyHDRL provide this, making it possible to run existing CPL data reduction recipes from Python as well as developing new recipes in Python. These new recipes are built using the PyCPL and PyHDRL libraries, which provide idiomatic Python interfaces to CPL and HDRL while allowing users to take advantage of the scientific Python ecosystem. PyCPL and PyHDRL are already being used to prototype recipes for the MAVIS instrument pipeline and have been used to develop an extensible pipeline development framework. Here we describe their design, implementation and usage.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Anthony Horton, Anthony Heng, Aidan Farrell, Mrunmayi Deshpande, Brent Miszalski, Nuwanthika Fernando, Nuria Lorente, Ralf Palsa, Lars Lundin, and Armin Gabasch "Python and pipelines: Python interfaces for ESO’s CPL and HDRL data reduction libraries", Proc. SPIE 13101, Software and Cyberinfrastructure for Astronomy VIII, 131013Q (25 July 2024); https://doi.org/10.1117/12.3019678

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE