I/O-efficient statistical computing with RIOT

Statistical analysis of massive data is becoming indispensable to science, commerce, and society today. Such analysis requires efficient, flexible storage support and special optimization techniques. In this demo, we present RIOT (R with I/O Transparency), a system that extends R, a popular computin...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2010 IEEE 26th International Conference on Data Engineering (ICDE 2010) s. 1157 - 1160
Hlavní autoři: Yi Zhang, Weiping Zhang, Jun Yang
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.03.2010
Témata:
Adaptive arrays
Business
Computer science
Data analysis
Database systems
Libraries
MATLAB
Multidimensional systems
Spatial databases
Switches
ISBN:142445445X, 9781424454457
ISSN:1063-6382
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Abstract Statistical analysis of massive data is becoming indispensable to science, commerce, and society today. Such analysis requires efficient, flexible storage support and special optimization techniques. In this demo, we present RIOT (R with I/O Transparency), a system that extends R, a popular computing environment for statistical data analysis. RIOT makes R programs I/O-efficient in a way transparent to users. It features a flexible array storage manager and an optimization engine suitable for statistical and numerical operations. RIOT also seamlessly integrates with external database systems, offering additional opportunities for processing data that reside in databases by blurring the boundary between database and host-language processing. This demo will show how statistical computation can be effectively and efficiently handled by RIOT.
AbstractList Statistical analysis of massive data is becoming indispensable to science, commerce, and society today. Such analysis requires efficient, flexible storage support and special optimization techniques. In this demo, we present RIOT (R with I/O Transparency), a system that extends R, a popular computing environment for statistical data analysis. RIOT makes R programs I/O-efficient in a way transparent to users. It features a flexible array storage manager and an optimization engine suitable for statistical and numerical operations. RIOT also seamlessly integrates with external database systems, offering additional opportunities for processing data that reside in databases by blurring the boundary between database and host-language processing. This demo will show how statistical computation can be effectively and efficiently handled by RIOT.
Author Weiping Zhang
Jun Yang
Yi Zhang
Author_xml – sequence: 1
  surname: Yi Zhang
  fullname: Yi Zhang
  email: yizhang@cs.duke.edu
  organization: Dept. of Comput. Sci., Duke Univ., Durham, NC, USA
– sequence: 2
  surname: Weiping Zhang
  fullname: Weiping Zhang
  email: wz14@duke.edu
  organization: Dept. of Comput. Sci., Duke Univ., Durham, NC, USA
– sequence: 3
  surname: Jun Yang
  fullname: Jun Yang
  email: junyang@cs.duke.edu
  organization: Dept. of Comput. Sci., Duke Univ., Durham, NC, USA
BookMark eNpFz81Kw0AUBeARK9jWPoC4yQtMOzczk5tZSqwaKASkhe7KzfzoSJuWZkR8ewMWPJvDtzlwJmzUHTvP2D2IOYAwi7p6Ws5zMVArhSWYKzYBlSs1UMH1P_R2xMYgCskLWea3bNb3n2KIUQBajBmvFw33IUQbfZeyPlGKfYqW9pk9Hk5fKXbv2XdMH9lb3azv2E2gfe9nl56yzfNyXb3yVfNSV48rHgF14l4QGcTgBTgtpUOHqqXWkQqOKLSY-xKD9M5QQCstGo3K6tJgAdrlhZyyh7_d6L3fnc7xQOef3eWq_AWdSkbH
ContentType Conference Proceeding
DBID 6IE
6IH
CBEJK
RIE
RIO
DOI 10.1109/ICDE.2010.5447819
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan (POP) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE Electronic Library (IEL)
IEEE Proceedings Order Plans (POP) 1998-present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
Business
EISBN 1424454441
1424454468
9781424454440
9781424454464
EndPage 1160
ExternalDocumentID 5447819
Genre orig-research
GroupedDBID 6IE
6IH
6IL
6IN
AAWTH
ABLEC
ADZIZ
ALMA_UNASSIGNED_HOLDINGS
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CBEJK
CHZPO
IEGSK
IJVOP
OCL
RIE
RIL
RIO
ID FETCH-LOGICAL-i175t-e0aa977fe01d533d7d74babda4fdaafb72e87f3ed9af7c3c79574c5897615d263
IEDL.DBID RIE
ISBN 142445445X
9781424454457
ISICitedReferencesCount 43
ISICitedReferencesURI http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000286933100139&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
ISSN 1063-6382
IngestDate Wed Aug 27 03:24:37 EDT 2025
IsPeerReviewed false
IsScholarly true
Language English
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-i175t-e0aa977fe01d533d7d74babda4fdaafb72e87f3ed9af7c3c79574c5897615d263
PageCount 4
ParticipantIDs ieee_primary_5447819
PublicationCentury 2000
PublicationDate 2010-March
PublicationDateYYYYMMDD 2010-03-01
PublicationDate_xml – month: 03
  year: 2010
  text: 2010-March
PublicationDecade 2010
PublicationTitle 2010 IEEE 26th International Conference on Data Engineering (ICDE 2010)
PublicationTitleAbbrev ICDE
PublicationYear 2010
Publisher IEEE
Publisher_xml – name: IEEE
SSID ssj0000941150
ssj0000452015
Score 1.9446796
Snippet Statistical analysis of massive data is becoming indispensable to science, commerce, and society today. Such analysis requires efficient, flexible storage...
SourceID ieee
SourceType Publisher
StartPage 1157
SubjectTerms Adaptive arrays
Business
Computer science
Data analysis
Database systems
Libraries
MATLAB
Multidimensional systems
Spatial databases
Switches
Title I/O-efficient statistical computing with RIOT
URI https://ieeexplore.ieee.org/document/5447819
WOSCitedRecordID wos000286933100139&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3fS8MwED62IeLTdJv4mzz4aFzapk37PDfcyzZkQt9GmlxBkU3G5t_vJW0ngi--taVN01zDfdzd9x3AvXYKITKzHGMjuETa6VoUCQ8KQnK6NEKnxjebULNZmufZogUPBy4MIvriM3x0hz6Xbzdm70Jlw1g6YmTWhrZSScXVOsRTnDR449req4o5B3Z8sjOJOP1mYcPrcvozeSP3VJ-rOuMZiGw4HT2Nq6Kv-oW_Oq94xzPp_m_KpzD4YfCxxcE3nUEL1z04bqrce9BtujmwenP3gU-Hc45eUYKGZI5p5EWc9Qcz_mYaiLmwLXuZzpcDeJ2Ml6NnXjdT4G-EEHYchdaE9UoUgSWIZ5VVstCF1bK0WpdkGkxVGaElCykTGZXFSpo4JbgSxDZMonPorDdrvAAmMCUcExOUsaEk_KIxUgU9pRJN6KuILqHvFmL1WellrOo1uPr78jWcVBl5V9d1A53ddo-3cGS-6CO3d97I3-kYnuU
linkProvider IEEE
linkToHtml http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1NT8JAEJ0gGvWEAsZve_DoyvZz2zNCaEQgBhNuZLs7TTAGDAF_v7PbFmPixdu2abftTjfzMjPvDcC9NAohQaIZhoqzAGmnS55FzM0IyclccRkr22xCjEbxbJZMavCw48Igoi0-w0cztLl8vVJbEyrrhIEhRiZ7sE8jjxdsrV1ExYiDV87tvaiZM3DHpjsjn9GP5lXMLqNAM6sEn8pjUeY8XZ500u5Tryj7Kh_5q_eKdT39xv9e-gTaPxw-Z7LzTqdQw2UTDqs69yY0qn4OTrm9W8DSzpih1ZSgKR3DNbIyzvLDUfZimsgxgVvnNR1P2_DW7027A1a2U2ALwggbhlxKQns5clcTyNNCiyCTmZZBrqXMyTgYi9xHTTYSylciCUWgwpgAixtqL_LPoL5cLfEcHI4xIZmQwIz2AkIwEn2R0V0ikoS_Mv8CWmYh5p-FYsa8XIPLv0_fwdFg-jKcD9PR8xUcF_l5U-V1DfXNeos3cKC-6IPXt9bg32dmoiw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2010+IEEE+26th+International+Conference+on+Data+Engineering+%28ICDE+2010%29&rft.atitle=I%2FO-efficient+statistical+computing+with+RIOT&rft.au=Yi+Zhang&rft.au=Weiping+Zhang&rft.au=Jun+Yang&rft.date=2010-03-01&rft.pub=IEEE&rft.isbn=9781424454457&rft.issn=1063-6382&rft.spage=1157&rft.epage=1160&rft_id=info:doi/10.1109%2FICDE.2010.5447819&rft.externalDocID=5447819
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1063-6382&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1063-6382&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1063-6382&client=summon