Zobrazit v EDS

Data discovery, analysis and reproducibility in Virtual Research Environments.

Uloženo v:
Podrobná bibliografie
Název: Data discovery, analysis and reproducibility in Virtual Research Environments.
Autoři: García García, Enrique, Guerrieri, Giovanni, Pérez Mercado, Rubén, Zengel, Michael Ryan, Skorobogatov, Georgy, González Labrador, Hugo, Espinal Curull, Xavier
Zdroj: EPJ Web of Conferences; 10/7/2025, Vol. 337, p1-8, 8p
Abstrakt: During the ESCAPE project, a pilot analysis facility was developed with a bottom-up approach, in collaboration with all the project partners. As a result, the CERN Virtual Research Environment (VRE) initiative proposes a workspace that facilitates data access from the ESCAPE Data Lake, managed by Rucio, a data management framework, and supports interactive analysis via Jupyter notebooks. The facility offers custom software stacks and access to CVMFS, and connects to local data processing resources through REANA, an open-source framework developed by CERN IT for reanalysis and reproducibility. The CERN VRE deploys an instance of REANA, allowing users to utilise its features together with the analysis facility's services. Integrating heterogeneous services with a unified interface significantly eases the user experience. Furthermore, in line with the ESCAPE Open Collaboration, the development of open source tools that can be leveraged by different physics communities with similar analysis strategies, laying the foundation of common lifecycle analysis practices. Therefore, in order to foster accessibility, as well as interactivity, reproducibility and data preservation to more complex infrastructure services, the development of user-friendly middleware should be prioritized. This contribution focuses on the connection of REANA and Zenodo to the CERN Virtual Research Environment's interface through Jupyter extensions. The development of these extensions makes it possible to use the Virtual Research Environment as a single workspace to enhance the lifecycle of research analysis: from data discovery and data access, through interactive analysis and offload to computing resources, to reproducibility and preservation of results. [ABSTRACT FROM AUTHOR]
Copyright of EPJ Web of Conferences is the property of EDP Sciences and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)
Databáze: Complementary Index
Popis
Abstrakt:During the ESCAPE project, a pilot analysis facility was developed with a bottom-up approach, in collaboration with all the project partners. As a result, the CERN Virtual Research Environment (VRE) initiative proposes a workspace that facilitates data access from the ESCAPE Data Lake, managed by Rucio, a data management framework, and supports interactive analysis via Jupyter notebooks. The facility offers custom software stacks and access to CVMFS, and connects to local data processing resources through REANA, an open-source framework developed by CERN IT for reanalysis and reproducibility. The CERN VRE deploys an instance of REANA, allowing users to utilise its features together with the analysis facility's services. Integrating heterogeneous services with a unified interface significantly eases the user experience. Furthermore, in line with the ESCAPE Open Collaboration, the development of open source tools that can be leveraged by different physics communities with similar analysis strategies, laying the foundation of common lifecycle analysis practices. Therefore, in order to foster accessibility, as well as interactivity, reproducibility and data preservation to more complex infrastructure services, the development of user-friendly middleware should be prioritized. This contribution focuses on the connection of REANA and Zenodo to the CERN Virtual Research Environment's interface through Jupyter extensions. The development of these extensions makes it possible to use the Virtual Research Environment as a single workspace to enhance the lifecycle of research analysis: from data discovery and data access, through interactive analysis and offload to computing resources, to reproducibility and preservation of results. [ABSTRACT FROM AUTHOR]
ISSN:21016275
DOI:10.1051/epjconf/202533701018