I/O-efficient statistical computing with RIOT

Statistical analysis of massive data is becoming indispensable to science, commerce, and society today. Such analysis requires efficient, flexible storage support and special optimization techniques. In this demo, we present RIOT (R with I/O Transparency), a system that extends R, a popular computin...

Full description

Saved in:
Bibliographic Details
Published in:2010 IEEE 26th International Conference on Data Engineering (ICDE 2010) pp. 1157 - 1160
Main Authors: Yi Zhang, Weiping Zhang, Jun Yang
Format: Conference Proceeding
Language:English
Published: IEEE 01.03.2010
Subjects:
Adaptive arrays
Business
Computer science
Data analysis
Database systems
Libraries
MATLAB
Multidimensional systems
Spatial databases
Switches
ISBN:142445445X, 9781424454457
ISSN:1063-6382
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Statistical analysis of massive data is becoming indispensable to science, commerce, and society today. Such analysis requires efficient, flexible storage support and special optimization techniques. In this demo, we present RIOT (R with I/O Transparency), a system that extends R, a popular computing environment for statistical data analysis. RIOT makes R programs I/O-efficient in a way transparent to users. It features a flexible array storage manager and an optimization engine suitable for statistical and numerical operations. RIOT also seamlessly integrates with external database systems, offering additional opportunities for processing data that reside in databases by blurring the boundary between database and host-language processing. This demo will show how statistical computation can be effectively and efficiently handled by RIOT.
ISBN:142445445X
9781424454457
ISSN:1063-6382
DOI:10.1109/ICDE.2010.5447819