A prototype for JDEM science data processing

Fermilab is developing a prototype science data processing and data quality monitoring system for dark energy science. The purpose of the prototype is to demonstrate distributed data processing capabilities for astrophysics applications, and to evaluate candidate technologies for trade-off studies....

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of physics. Conference series Jg. 331; H. 7; S. 072016 - 6
1. Verfasser: Gottschalk, Erik E
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Bristol IOP Publishing 23.12.2011
Schlagworte:
Astrophysics
Dark energy
Data processing
Freeware
Message passing
Monitoring
Physics
Prototypes
Quality control
Technology assessment
Tradeoffs
ISSN:1742-6596, 1742-6588, 1742-6596
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Abstract Fermilab is developing a prototype science data processing and data quality monitoring system for dark energy science. The purpose of the prototype is to demonstrate distributed data processing capabilities for astrophysics applications, and to evaluate candidate technologies for trade-off studies. We present the architecture and technical aspects of the prototype, including an open source scientific execution and application development framework, distributed data processing, and publish/subscribe message passing for quality control.
AbstractList Fermilab is developing a prototype science data processing and data quality monitoring system for dark energy science. The purpose of the prototype is to demonstrate distributed data processing capabilities for astrophysics applications, and to evaluate candidate technologies for trade-off studies. We present the architecture and technical aspects of the prototype, including an open source scientific execution and application development framework, distributed data processing, and publish/subscribe message passing for quality control.
Author Gottschalk, Erik E
Author_xml – sequence: 1
  fullname: Gottschalk, Erik E
BookMark eNqNkM1LwzAchoNMcJv-C1Lw4sHafDRfxzHnFxMveg5plkjH1tSkPey_N6UiIjuYSwLv8-b345mBSeMbC8AlgrcIClEgXuKcUckKQlDBC8gxROwETH-Cya_3GZjFuIWQpMOn4GaRtcF3vju0NnM-ZM93q5csmto2xmYb3ekhNzbGuvk4B6dO76K9-L7n4P1-9bZ8zNevD0_LxTo3RKIul5VjVlDDkBE0rWKwK42GhqfAYbwxuiJIY0iRk7DUnJSVrSTVXHAmGcVkDq7Hf9Poz97GTu3raOxupxvr-6iQwJRihhBP6NUfdOv70KTtFKZcllxKKBLFRsoEH2OwTrWh3utwUAiqQaIa_KjBj0oSFVejxFREY7H27f87-ZHOUVa1G0e-AA_Tf_I
Cites_doi 10.1086/498731
ContentType Journal Article
Copyright Copyright IOP Publishing Dec 2011
Copyright_xml – notice: Copyright IOP Publishing Dec 2011
DBID AAYXX
CITATION
8FD
8FE
8FG
ABUWG
AFKRA
ARAPS
AZQEC
BENPR
BGLVJ
CCPQU
DWQXO
H8D
HCIFZ
L7M
P5Z
P62
PHGZM
PHGZT
PIMPY
PKEHL
PQEST
PQGLB
PQQKQ
PQUKI
PRINS
7U5
8BQ
JG9
DOI 10.1088/1742-6596/331/7/072016
DatabaseName CrossRef
Technology Research Database
ProQuest SciTech Collection
ProQuest Technology Collection
ProQuest Central (Alumni)
ProQuest Central UK/Ireland
Advanced Technologies & Computer Science Collection
ProQuest Central Essentials - QC
ProQuest Central
ProQuest Technology Collection
ProQuest One Community College
ProQuest Central Korea
Aerospace Database
SciTech Premium Collection
Advanced Technologies Database with Aerospace
Advanced Technologies & Aerospace Database
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Premium
ProQuest One Academic (New)
ProQuest Publicly Available Content Database
ProQuest One Academic Middle East (New)
ProQuest One Academic Eastern Edition (DO NOT USE)
ProQuest One Applied & Life Sciences
ProQuest One Academic (retired)
ProQuest One Academic UKI Edition
ProQuest Central China
Solid State and Superconductivity Abstracts
METADEX
Materials Research Database
DatabaseTitle CrossRef
Publicly Available Content Database
Advanced Technologies & Aerospace Collection
Technology Collection
Technology Research Database
ProQuest One Academic Middle East (New)
ProQuest Advanced Technologies & Aerospace Collection
ProQuest Central Essentials
ProQuest One Academic Eastern Edition
ProQuest Central (Alumni Edition)
SciTech Premium Collection
ProQuest One Community College
ProQuest Technology Collection
ProQuest SciTech Collection
ProQuest Central China
ProQuest Central
Advanced Technologies & Aerospace Database
ProQuest One Applied & Life Sciences
Aerospace Database
ProQuest One Academic UKI Edition
ProQuest Central Korea
ProQuest Central (New)
ProQuest One Academic
Advanced Technologies Database with Aerospace
ProQuest One Academic (New)
Materials Research Database
Solid State and Superconductivity Abstracts
METADEX
DatabaseTitleList Publicly Available Content Database
Materials Research Database
Database_xml – sequence: 1
  dbid: PIMPY
  name: Publicly Available Content Database
  url: http://search.proquest.com/publiccontent
  sourceTypes: Aggregation Database
DeliveryMethod fulltext_linktorsrc
Discipline Physics
EISSN 1742-6596
EndPage 6
ExternalDocumentID 10_1088_1742_6596_331_7_072016
GroupedDBID 02
1JI
1WK
29L
2WC
4.4
5B3
5GY
5PX
5VS
7.Q
AAJIO
AALHV
ABHWH
AEFHF
AFYNE
AHSEE
ALMA_UNASSIGNED_HOLDINGS
ASPBG
ATQHT
AVWKF
AZFZN
BBWZM
C1A
CJUJL
CS3
DU5
E3Z
EBS
EDWGO
EJD
EQZZN
F5P
FEDTE
FRP
GROUPED_DOAJ
GX1
HH5
HVGLF
IOP
IZVLO
J9A
KNG
KQ8
LAP
N5L
N9A
O3W
OK1
P2P
Q02
RIN
RNS
RO9
ROL
RPA
S3P
SY9
T37
UCJ
W28
AAJKP
AAYXX
ACAFW
ACARI
ACHIP
AEINN
AEJGL
AERVB
AFFHD
AFKRA
AGQPQ
AIYBF
AKPSB
ARAPS
ARNYC
BENPR
BGLVJ
CCPQU
CITATION
CRLBU
HCIFZ
IJHAN
JCGBZ
OVT
PHGZM
PHGZT
PIMPY
PJBAE
PQGLB
TR2
XSB
~02
8FD
8FE
8FG
ABUWG
AZQEC
DWQXO
H8D
L7M
P62
PKEHL
PQEST
PQQKQ
PQUKI
PRINS
7U5
8BQ
JG9
ID FETCH-LOGICAL-c391t-9bf6e85c61c85016c2f4ca0c79bff22dcab31a2051f904a734beb95a787696523
IEDL.DBID P5Z
ISICitedReferencesCount 0
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000301299200016&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1742-6596
1742-6588
IngestDate Sun Nov 09 09:59:47 EST 2025
Sun Nov 09 08:09:30 EST 2025
Sat Nov 29 04:09:39 EST 2025
Tue Nov 10 14:15:01 EST 2020
Mon May 13 15:52:44 EDT 2019
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 7
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c391t-9bf6e85c61c85016c2f4ca0c79bff22dcab31a2051f904a734beb95a787696523
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
OpenAccessLink https://www.proquest.com/docview/2579479908?pq-origsite=%requestingapplication%
PQID 2579479908
PQPubID 4998668
PageCount 6
ParticipantIDs proquest_journals_2579479908
crossref_primary_10_1088_1742_6596_331_7_072016
proquest_miscellaneous_1825526117
iop_primary_10_1088_1742_6596_331_7_072016
PublicationCentury 2000
PublicationDate 20111223
PublicationDateYYYYMMDD 2011-12-23
PublicationDate_xml – month: 12
  year: 2011
  text: 20111223
  day: 23
PublicationDecade 2010
PublicationPlace Bristol
PublicationPlace_xml – name: Bristol
PublicationTitle Journal of physics. Conference series
PublicationYear 2011
Publisher IOP Publishing
Publisher_xml – name: IOP Publishing
References 2
3
4
5
6
7
(1) 2010
References_xml – ident: 3
– ident: 5
– ident: 4
– ident: 2
  doi: 10.1086/498731
– ident: 6
– ident: 7
– year: 2010
  ident: 1
  publication-title: New Worlds, New Horizons in Astronomy and Astrophysics
SSID ssj0033337
Score 1.9002216
Snippet Fermilab is developing a prototype science data processing and data quality monitoring system for dark energy science. The purpose of the prototype is to...
SourceID proquest
crossref
iop
SourceType Aggregation Database
Index Database
Enrichment Source
Publisher
StartPage 072016
SubjectTerms Astrophysics
Dark energy
Data processing
Freeware
Message passing
Monitoring
Physics
Prototypes
Quality control
Technology assessment
Tradeoffs
SummonAdditionalLinks – databaseName: Institute of Physics Open Access Journal Titles
  dbid: O3W
  link: http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1LSwMxEB7aquDFt1itsoJ4ENdukt08jkUsIlI9KPYWstkEemlLH_5-Z19CsQe7p4Vkk_DtzHyZJDMBuGHUEZUkNFRK2DDm0qFKKRf6zFArkXNiX2TXfxWDgRwO1XsD6ksQR5NpZfkf8LXcyUfnLeSJ4l3GSFd0I4GcxZuwhcQb5ZL9xr5q28vwEWUIZPlNHROMbt76dlboqIl9_rHJBdH09zcf4gHsVZPKoFdKwSE03PgIdorDnXZ-DPe9IE_HMMmXWwOcpAYviH5QNR_kZ0SDaRkvgDx2Ap_9p4_H57C6JSG0TJFFqFLPnUwsJ1Ym2K2lPrYmsgILPKWZNSkjhqLyeRXFRrA4dalKDGoqVxz90FNojSdjdwaBIVFGvJcu95IEk8Y4lRqHSm5IRmnUhm4Nlp6WyTB0sYktpc4x0DkGGjHQQpcYtOEOQfp35duVymsr6Wnm29Cp_5GuVG6u0faoWCC5yjZc_xajsuQ7IGbsJsu5RmcK5ZITIs43GdgF7BZLyYSGlHWgtZgt3SVs2-_FaD67KiTwBzovy5s
  priority: 102
  providerName: IOP Publishing
Title A prototype for JDEM science data processing
URI http://iopscience.iop.org/1742-6596/331/7/072016
https://www.proquest.com/docview/2579479908
https://www.proquest.com/docview/1825526117
Volume 331
WOSCitedRecordID wos000301299200016&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
journalDatabaseRights – providerCode: PRVIOP
  databaseName: Institute of Physics Open Access Journal Titles
  customDbUrl:
  eissn: 1742-6596
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0033337
  issn: 1742-6596
  databaseCode: O3W
  dateStart: 20040101
  isFulltext: true
  titleUrlDefault: http://iopscience.iop.org/
  providerName: IOP Publishing
– providerCode: PRVPQU
  databaseName: ProQuest advanced technologies & aerospace journals
  customDbUrl:
  eissn: 1742-6596
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0033337
  issn: 1742-6596
  databaseCode: P5Z
  dateStart: 20040801
  isFulltext: true
  titleUrlDefault: https://search.proquest.com/hightechjournals
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: ProQuest Central
  customDbUrl:
  eissn: 1742-6596
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0033337
  issn: 1742-6596
  databaseCode: BENPR
  dateStart: 20040801
  isFulltext: true
  titleUrlDefault: https://www.proquest.com/central
  providerName: ProQuest
– providerCode: PRVPQU
  databaseName: Publicly Available Content Database
  customDbUrl:
  eissn: 1742-6596
  dateEnd: 99991231
  omitProxy: false
  ssIdentifier: ssj0033337
  issn: 1742-6596
  databaseCode: PIMPY
  dateStart: 20040801
  isFulltext: true
  titleUrlDefault: http://search.proquest.com/publiccontent
  providerName: ProQuest
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwpV3da9UwFD_sbhN82eZUvG5eKgwfhqFN0jbJ05iyoeKuZWw4fQlpmsB9ua3rnX__TvqxMSYi2MfkUNrz9cs5Sc4BOODMUZVljCglLElz6dCklCO-MsxKxJzUd9X1v4r5XF5dqWJIuLXDscrRJ3aOuqptyJHHqFoqFeg75VHzi4SuUWF3dWihMYGNUCUhtG4osp-jJ-b4iP5CJCOItHK8IYxB3zCm8phzGos4EYiE-QNwmizq5pGH7mDndPt_P3gHtoYFZ3Tca8gzWHPLXXjSHfy07XN4fxyFUg11SMVGuICNvqBkogEXo3B-NGr6uwSIcS_g8vTk4uMnMnRQIJYruiKq9LmTmc2plRn-n2U-tSaxAic8Y5U1JaeGoWF6laRG8LR0pcoMWnGucoxRX8L6sl66VxAZmlTUe-lCBCW4NMap0jh0AIZWjCVTiEfW6aYvlKG7DW4pdWC2DszWyGwtdM_sKRwih_-Z-N0D4j8S6abyU9gfxaEHc2z1vSym8PZuGg0p7I6YpatvWo2BFupsTql4_fdX7MHTLrFMGWF8H9ZX1zfuDWza36tFez2DjQ8n8-J8BpNv_Pus00ccKz6fFT9uATMW3ks
linkProvider ProQuest
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1Nb9QwEB2VLQgufKMuFDAScEBYie0ktg8IVUDVpdvVHopUTq7j2FIvm7TZgvhT_EbG-QBVIMSlB3JMrCjKe37PY3vGAM8F90znOadaS0ezQnnsUtrTUFnuFHpOFrrq-nO5WKijI73cgO9jLkzcVjlqYifUVe3iHHmC1NKZRO1Ub5tTGk-Niqur4xEaPS32_bevGLK1b2bvEd8XnO9-OHy3R4dTBagTmq2pLkPhVe4K5lSOAx7HQ-Zs6iQ-CJxXzpaCWY5kDTrNrBRZ6UudW2R2oYs8FjpAyd_MItknsLmcHSw_j9ov8JJ9Cian6O1qzEnGMHO4p4tECJbIJJXovcUFO7xyUje_eUJndLu3_rdfdBtuDkNqstP3gTuw4Vd34Vq3tdW19-D1DonFKOo42UxwiE4-IvfI4Pwk7pAlTZ8tgS5-Hz5dyqc-gMmqXvktIJalFQtB-RgjSqGs9bq0HiXOsorzdArJCJVp-lIgplvCV8pEcE0E1yC4Rpoe3Cm8QkT_ufHLC43_2Mg0VZjC9gi_GQSnNb-wn8Kzn49RKuL6j135-rw1GEpirywYkw___oqncH3v8GBu5rPF_iO40U2jM0652IbJ-uzcP4ar7sv6pD17MvCfwPFl8-kHDRE4IQ
linkToPdf http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrV1bS8MwFD7ovOCLd3FeK4gPYm2TtE3yKOrwMuYeFH0LaZqAL9vYpr_fk7YbiAoK9qmQpAlfzjU55xTgmFFLZJrSUEpuwiQTFllK2tAVmhqBOidxZXX9Nu90xMuL7M7A9TQXpj-oRf85vlaFgisI64A4EaENTcMslVnEGIl4FHPqI7YGhZuFuZSl0pP7A3ueCGSGD6_yIqtxk0ThH7_1SUfN4jq-COpS-7RW_mndq7Bcm5_BRTVoDWZsbx0WyjBQM9qAs4vAF27o-4PZAM3Z4A73KainDHw0aTCoMgtQ423CU-v68fImrP-nEBomyTiUucusSE1GjEhxakNdYnRsODY4Sgujc0Y0RTZ1Mk40Z0luc5lq5OlMZuixbkGj1-_ZbQg0iQvinLDen-JMaG1lri2KA00KSuMmRBME1aAqm6HK624hlMdBeRwU4qC4qnBowikC9-vOJ586f9tJIbJN2JtsnKqZc6RQSsmEoxoWTTiaNiNb-bsS3bP9t5FCtwspOCOE7_xlYYew2L1qqfZt534XlsrzZ0JDyvagMR6-2X2YN-_j19HwoKTQD_7B21k
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+prototype+for+JDEM+science+data+processing&rft.jtitle=Journal+of+physics.+Conference+series&rft.au=Gottschalk%2C+Erik+E&rft.date=2011-12-23&rft.issn=1742-6596&rft.eissn=1742-6596&rft.volume=331&rft.issue=7&rft.spage=72016&rft_id=info:doi/10.1088%2F1742-6596%2F331%2F7%2F072016&rft.externalDBID=n%2Fa&rft.externalDocID=10_1088_1742_6596_331_7_072016
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1742-6596&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1742-6596&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1742-6596&client=summon