Massive Scale Data Analytics at LCLS-II.
Saved in:
| Title: | Massive Scale Data Analytics at LCLS-II. |
|---|---|
| Authors: | Thayer, Jana, Chen, Zhantao, Claus, Richard, Damiani, Daniel, Ford, Christopher, Dubrovin, Mikhail, Elmir, Victor, Kroeger, Wilko, Li, Xiang, Marchesini, Stefano, Mariani, Valerio, Melcchiori, Riccardo, Nelson, Silke, Peck, Ariana, Perazzo, Amedeo, Poitevin, Frederic, O'Grady, Christopher Paul, Otero, Julieth, Quijano, Omar, Shankar, Murali |
| Source: | EPJ Web of Conferences; 5/6/2024, Vol. 295, p1-12, 12p |
| Subject Terms: | LIGHT sources, DATA analysis, ACQUISITION of data, DATA reduction, DATA visualization |
| Abstract: | The increasing volumes of data produced at light sources such as the Linac Coherent Light Source (LCLS) enable the direct observation of materials and molecular assemblies at the length and timescales of molecular and atomic motion. This exponential increase in the scale and speed of data production is prohibitive to traditional analysis workflows that rely on scientists tuning parameters during live experiments to adapt data collection and analysis. User facilities will increasingly rely on the automated delivery of actionable information in real time for rapid experiment adaptation which presents a considerable challenge for data acquisition, data processing, data management, and workflow orchestration. In addition, the desire from researchers to accelerate science requires rapid analysis, dynamic integration of experiment and theory, the ability to visualize results in near real-time, and the introduction of ML and AI techniques. We present the LCLS-II Data System architecture which is designed to address these challenges via an adaptable data reduction pipeline (DRP) to reduce data volume on-thefly, online monitoring analysis software for real-time data visualization and experiment feedback, and the ability to scale to computing needs by utilizing local and remote compute resources, such as the ASCR Leadership Class Facilities, to enable quasi-real-time data analysis in minutes. We discuss the overall challenges facing LCLS, our ongoing work to develop a system responsive to these challenges, and our vision for future developments. [ABSTRACT FROM AUTHOR] |
| Copyright of EPJ Web of Conferences is the property of EDP Sciences and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Complementary Index |
Full Text Finder 
Nájsť tento článok vo Web of Science Be the first to leave a comment!