Hostname: page-component-7b7567c8c-9cwtv Total loading time: 0 Render date: 2026-11-19T07:20:00.433Z Has data issue: false hasContentIssue false

Learning from the present for the future: the Jülich LOFAR Long-term Archive

Published online by Cambridge University Press:  05 October 2026

H. Stiele*
Affiliation:
Jülich Supercopmuting Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Straße, 52425 Jülich, Germany
C. Manzano*
Affiliation:
Jülich Supercopmuting Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Straße, 52425 Jülich, Germany
A. Miskolczi*
Affiliation:
Jülich Supercopmuting Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Straße, 52425 Jülich, Germany
V. Vybornov*
Affiliation:
Jülich Supercopmuting Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Straße, 52425 Jülich, Germany
T. Fieseler*
Affiliation:
Jülich Supercopmuting Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Straße, 52425 Jülich, Germany
S. Pfalzner*
Affiliation:
Jülich Supercopmuting Centre, Forschungszentrum Jülich, Wilhelm-Johnen-Straße, 52425 Jülich, Germany
Rights & Permissions [Opens in a new window]

Abstract

Since 2013, Forschungszentrum Jülich has hosted the German segment of the LOFAR long-term archive, with current storage amounting to approximately 22 petabytes (PB), exhibiting an annual growth rate of approximately 2 PB. The advent of next-generation radio telescopes is anticipated to generate data at a substantially higher rate, thereby introducing novel challenges in the domains of data processing and storage. Here we present a concise overview of the current data management of the Jülich LOFAR Data Archive, encompassing the ingestion, storage system, export to the long-term archive, and request chain. A detailed analysis of data access over the past decade has been conducted, along with an estimation of energy consumption. The study has identified hardware-related constraints and software aspects as the predominant data storage bottlenecks. From the analysis, we derived requirements for the future expansion of long-term data storage capacity.

Information

Type
Contributed Paper
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2026. Published by Cambridge University Press on behalf of The International Astronomical Union