Simultaneous analysis of large INTEGRAL/SPI datasets: optimizing the computation of the solution and its variance using sparse matrix algorithms

Nowadays, analyzing and reducing the ever larger astronomical datasets is becoming a crucial challenge, especially for long cumulated observation times. The INTEGRAL/SPI X-gamma-ray spectrometer is an instrument for which it is essential to process many exposures at the same time in order to increas...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:arXiv.org
Hlavní autoři: Bouchet, L, Amestoy, P, Buttari, A, F -H Rouet, Chauvin, M
Médium: Paper
Jazyk:angličtina
Vydáno: Ithaca Cornell University Library, arXiv.org 24.05.2013
Témata:
Algorithms
Celestial bodies
Computation
Computer memory
Data processing
Data reduction
Datasets
Emission analysis
Galaxies
Gamma rays
Integrals
Linear systems
Matrix methods
Mumps
Sparsity
Transfer functions
ISSN:2331-8422
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract Nowadays, analyzing and reducing the ever larger astronomical datasets is becoming a crucial challenge, especially for long cumulated observation times. The INTEGRAL/SPI X-gamma-ray spectrometer is an instrument for which it is essential to process many exposures at the same time in order to increase the low signal-to-noise ratio of the weakest sources. In this context, the conventional methods for data reduction are inefficient and sometimes not feasible at all. Processing several years of data simultaneously requires computing not only the solution of a large system of equations, but also the associated uncertainties. We aim at reducing the computation time and the memory usage. Since the SPI transfer function is sparse, we have used some popular methods for the solution of large sparse linear systems; we briefly review these methods. We use the Multifrontal Massively Parallel Solver (MUMPS) to compute the solution of the system of equations. We also need to compute the variance of the solution, which amounts to computing selected entries of the inverse of the sparse matrix corresponding to our linear system. This can be achieved through one of the latest features of the MUMPS software that has been partly motivated by this work. In this paper we provide a brief presentation of this feature and evaluate its effectiveness on astrophysical problems requiring the processing of large datasets simultaneously, such as the study of the entire emission of the Galaxy. We used these algorithms to solve the large sparse systems arising from SPI data processing and to obtain both their solutions and the associated variances. In conclusion, thanks to these newly developed tools, processing large datasets arising from SPI is now feasible with both a reasonable execution time and a low memory usage.
AbstractList Nowadays, analyzing and reducing the ever larger astronomical datasets is becoming a crucial challenge, especially for long cumulated observation times. The INTEGRAL/SPI X-gamma-ray spectrometer is an instrument for which it is essential to process many exposures at the same time in order to increase the low signal-to-noise ratio of the weakest sources. In this context, the conventional methods for data reduction are inefficient and sometimes not feasible at all. Processing several years of data simultaneously requires computing not only the solution of a large system of equations, but also the associated uncertainties. We aim at reducing the computation time and the memory usage. Since the SPI transfer function is sparse, we have used some popular methods for the solution of large sparse linear systems; we briefly review these methods. We use the Multifrontal Massively Parallel Solver (MUMPS) to compute the solution of the system of equations. We also need to compute the variance of the solution, which amounts to computing selected entries of the inverse of the sparse matrix corresponding to our linear system. This can be achieved through one of the latest features of the MUMPS software that has been partly motivated by this work. In this paper we provide a brief presentation of this feature and evaluate its effectiveness on astrophysical problems requiring the processing of large datasets simultaneously, such as the study of the entire emission of the Galaxy. We used these algorithms to solve the large sparse systems arising from SPI data processing and to obtain both their solutions and the associated variances. In conclusion, thanks to these newly developed tools, processing large datasets arising from SPI is now feasible with both a reasonable execution time and a low memory usage.
Author Chauvin, M
Amestoy, P
Bouchet, L
Buttari, A
F -H Rouet
Author_xml – sequence: 1
  givenname: L
  surname: Bouchet
  fullname: Bouchet, L
– sequence: 2
  givenname: P
  surname: Amestoy
  fullname: Amestoy, P
– sequence: 3
  givenname: A
  surname: Buttari
  fullname: Buttari, A
– sequence: 4
  fullname: F -H Rouet
– sequence: 5
  givenname: M
  surname: Chauvin
  fullname: Chauvin, M
BookMark eNotj01PAjEYhBujiYjcPTbxvNDP3eKNEEQSoka4k3e3BUp227XtGvRX-JMF9TSZmTyTzA26dN4ZhO4oGQolJRlBONqPIeVEDmWu-AXqMc5ppgRj12gQ44EQwvKCScl76Htlm65O4IzvIgYH9We0EfstriHsDF48r2fzt8lytHpdYA0JoknxAfs22cZ-WbfDaW9w5Zu2S5Csd2f0HEVfd78enMY2RfwBwYKrDO7iGYsthGhwAynYI4Z654NN-ybeoqst1NEM_rWP1o-z9fQpW77MF9PJMgNJeWYqkLJSGghnudJacl2eHhVSjbd5firH0gjB81LkhpdqTEvKigIoSC6Y1pz30f3fbBv8e2di2hx8F07344YRJZlgVHD-A8GCacI
ContentType Paper
Copyright 2013. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
Copyright_xml – notice: 2013. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.
DBID 8FE
8FG
ABJCF
ABUWG
AFKRA
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
HCIFZ
L6V
M7S
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PTHSS
DOI 10.48550/arxiv.1305.5683
DatabaseName ProQuest SciTech Collection
ProQuest Technology Collection
Materials Science & Engineering Collection
ProQuest Central
ProQuest Central UK/Ireland
ProQuest Central Essentials
ProQuest Central
ProQuest Technology Collection
ProQuest One Community College
ProQuest Central Korea
SciTech Premium Collection
ProQuest Engineering Collection
Engineering Database
ProQuest Central Premium
ProQuest One Academic (New)
ProQuest Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest Central China
Engineering Collection
DatabaseTitle Publicly Available Content Database
Engineering Database
Technology Collection
ProQuest One Academic Middle East (New)
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Technology Collection
ProQuest SciTech Collection
ProQuest Central China
ProQuest Central
ProQuest One Applied & Life Sciences
ProQuest Engineering Collection
ProQuest One Academic UKI Edition
ProQuest Central Korea
Materials Science & Engineering Collection
ProQuest Central (New)
ProQuest One Academic
ProQuest One Academic (New)
Engineering Collection
DatabaseTitleList Publicly Available Content Database
Database_xml – sequence: 1
  dbid: PIMPY
  name: ProQuest Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Physics
EISSN 2331-8422
Genre Working Paper/Pre-Print
GroupedDBID 8FE
8FG
ABJCF
ABUWG
AFKRA
ALMA_UNASSIGNED_HOLDINGS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
FRJ
HCIFZ
L6V
M7S
M~E
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
PTHSS
ID FETCH-LOGICAL-a513-eca55c8da03268dd53db7257589f66ca595e4436b46e3b891b1277a1a5342dd33
IEDL.DBID PIMPY
IngestDate Mon Jun 30 09:28:08 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-a513-eca55c8da03268dd53db7257589f66ca595e4436b46e3b891b1277a1a5342dd33
Notes SourceType-Working Papers-1
ObjectType-Working Paper/Pre-Print-1
content type line 50
OpenAccessLink https://www.proquest.com/publiccontent/docview/2085242143?pq-origsite=%requestingapplication%
PQID 2085242143
PQPubID 2050157
ParticipantIDs proquest_journals_2085242143
PublicationCentury 2000
PublicationDate 20130524
PublicationDateYYYYMMDD 2013-05-24
PublicationDate_xml – month: 05
  year: 2013
  text: 20130524
  day: 24
PublicationDecade 2010
PublicationPlace Ithaca
PublicationPlace_xml – name: Ithaca
PublicationTitle arXiv.org
PublicationYear 2013
Publisher Cornell University Library, arXiv.org
Publisher_xml – name: Cornell University Library, arXiv.org
SSID ssj0002672553
Score 1.5095451
SecondaryResourceType preprint
Snippet Nowadays, analyzing and reducing the ever larger astronomical datasets is becoming a crucial challenge, especially for long cumulated observation times. The...
SourceID proquest
SourceType Aggregation Database
SubjectTerms Algorithms
Celestial bodies
Computation
Computer memory
Data processing
Data reduction
Datasets
Emission analysis
Galaxies
Gamma rays
Integrals
Linear systems
Matrix methods
Mumps
Sparsity
Transfer functions
Title Simultaneous analysis of large INTEGRAL/SPI datasets: optimizing the computation of the solution and its variance using sparse matrix algorithms
URI https://www.proquest.com/docview/2085242143
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1LS8QwEA66q-DJNz6XHLzGtU3SNl5ExRfoUlwPepI0SbXg7mpTF_FX-JOdqV0FD568JrQMyWRmknz5PkJ2dK6UtbliCvIZE5kwLIG6gykhjXQxd9zUM30Z93rJ7a1Km-fRvoFVTmJiHai_2J4Rtw1BuGtHBk_Mu6gsiZeZgh88vzDUkMK71kZQY5q0kXhrr0Xa6cVVevd95hJGMVTQ_Ou2sqby6uryrRijJLLclRFyB_6KyHWaOZ3_XwMXwDD97MpFMuWGS2S2Bnsav0w--gXiCPXQwbaf6oaWhI5y-oS4cIo0uWfXh5fdfnpBEULqXeX36Qiiy6B4h1xHoWqkptaDqCcWP8WmiR_DPy0tKk_HsBNHt6IIr3-gEL1K7-gAZQHeqH56AIurx4FfITenJzfH56xRZmBaBpw5o6U0idV7UPwl1kokaYa1LxOVRxF0KumE4FEmIsezRAVZEMaxDrTkIrSW81XSGo6Gbo3QJBdJFud5FpgA3CPQVsdOQ9mTQ1sos3WyNRnt-2Z1-fufwd34u3uTzIW1fIVkodgirap8ddtkxoyrwpcd0j466aXXHcR79juNs3wCZtvSkw
linkProvider ProQuest
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V3NTtwwELbQLoiegAKi_PrQHt0liZ3ElaoK8btiWa3KHuC0cmxnicRuIM5uaZ-iL9J3ZCZsQOLAjUOvtmIpM5NvJjPj-Qj5rFIpjUklk-DPGE-4ZjHEHUxyoYWNAhvoStOdqNuNr65kb478q-_CYFtljYkVUJtcY468hVySWL7kwY-7e4asUVhdrSk0nszi3P7-Bb9s7nv7CPT7xfdPjvuHZ2zGKsCU8AJmtRJCx0btQ-ASGyNwwDDYrYhlGoawKYXlPAgTHtogiaWXeH4UKU-JgPvGYP4TEL_Jwdb3G6TZa1_0rp-TOn4IR4ngqRxazQprqeIhmyLnsvgqQhxO-AryKz92svSfSWAZ3lzd2WKFzNnxR7JQtatqt0r-XmbYCanGNp84qmaDVWie0lvsbKc46Pf050GnddlrU2yCdbZ032gO-DjK_oC3phD3Ul0xWlSmiY_iUv0lwpmGZqWjU1Vg2sdSvCAwpIC_hbN0hMQGD1TdDkFA5c3IrZH-e8hgnTTG-dhuEBqnPE6iNE087YGBe8qoyCoI3FJY80XyiWzX6hzM8MENXnS5-fb2Hlk86190Bp1293yLfPArMg7BfL5NGmUxsTtkXk_LzBW7M1ukZPDOun8EXfcexQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Simultaneous+analysis+of+large+INTEGRAL%2FSPI+datasets%3A+optimizing+the+computation+of+the+solution+and+its+variance+using+sparse+matrix+algorithms&rft.jtitle=arXiv.org&rft.au=Bouchet%2C+L&rft.au=Amestoy%2C+P&rft.au=Buttari%2C+A&rft.au=F+-H+Rouet&rft.date=2013-05-24&rft.pub=Cornell+University+Library%2C+arXiv.org&rft.eissn=2331-8422&rft_id=info:doi/10.48550%2Farxiv.1305.5683