Incremental Maintenance of Online Summaries Over Multiple Streams
We propose a novel approach based on predictive quantization (PQ) for online summarization of multiple time-varying data streams. A synopsis over a sliding window of most recent entries is computed in one pass and dynamically updated in constant time. The correlation between consecutive data element...
Gespeichert in:
| Veröffentlicht in: | IEEE transactions on knowledge and data engineering Jg. 20; H. 2; S. 216 - 229 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Journal Article |
| Sprache: | Englisch |
| Veröffentlicht: |
New York, NY
IEEE
01.02.2008
IEEE Computer Society The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Schlagworte: | |
| ISSN: | 1041-4347, 1558-2191 |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Abstract | We propose a novel approach based on predictive quantization (PQ) for online summarization of multiple time-varying data streams. A synopsis over a sliding window of most recent entries is computed in one pass and dynamically updated in constant time. The correlation between consecutive data elements is effectively taken into account without the need for preprocessing. We extend PQ to multiple streams and propose structures for real-time summarization and querying of a massive number of streams. Queries on any subsequence of a sliding window over multiple streams are processed in real time. We examine each component of the proposed approach, prediction, and quantization separately and investigate the space-accuracy trade-off for synopsis generation. Complementing the theoretical optimality of PQ-based approaches, we show that the proposed technique, even for very short prediction windows, significantly outperforms the current techniques for a wide variety of query types on both synthetic and real data sets. |
|---|---|
| AbstractList | We propose a novel approach based on predictive quantization (PQ) for online summarization of multiple time-varying data streams. A synopsis over a sliding window of most recent entries is computed in one pass and dynamically updated in constant time. The correlation between consecutive data elements is effectively taken into account without the need for preprocessing. We extend PQ to multiple streams and propose structures for real-time summarization and querying of a massive number of streams. Queries on any subsequence of a sliding window over multiple streams are processed in real time. We examine each component of the proposed approach, prediction, and quantization separately and investigate the space-accuracy trade-off for synopsis generation. Complementing the theoretical optimality of PQ-based approaches, we show that the proposed technique, even for very short prediction windows, significantly outperforms the current techniques for a wide variety of query types on both synthetic and real data sets. |
| Author | Altiparmak, F. Ferhatosmanoglu, H. Tuncel, E. |
| Author_xml | – sequence: 1 givenname: F. surname: Altiparmak fullname: Altiparmak, F. organization: Ohio State Univ., Columbus – sequence: 2 givenname: E. surname: Tuncel fullname: Tuncel, E. – sequence: 3 givenname: H. surname: Ferhatosmanoglu fullname: Ferhatosmanoglu, H. |
| BackLink | http://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=19981805$$DView record in Pascal Francis |
| BookMark | eNp9kU1LHTEUhoMo-FH3BTeDYLuaaz4nyVKsbaXKXWjXIZM5A5FM5ppkhP775nJFwYWrHMLznMM57zHaj3MEhL4SvCIE68vHPz9uVhRjuSIad5rtoSMihGop0WS_1piTljMuD9Fxzk8YYyUVOUJXt9ElmCAWG5p762OBaKODZh6bdQw-QvOwTJNNHnKzfoHU3C-h-E2o_yWBnfIXdDDakOH09T1Bf3_ePF7_bu_Wv26vr-5axxQrrewFgV5TRbkCoXs90IFIPAx9b4EqNyqreN-NTFGlOR20cHoEJgbOQGIG7AR93_XdpPl5gVzM5LODEGyEeclGSYGrzHElv31KMt4xxuQWPP8APs1LinULowmlUjPZVejiFbLZ2TCmeh6fzSb5epV_hmitiMKicnjHuTTnnGB8R7DZRmS2EZltRGYXUVW6D4rzxRY_x5KsD5-JZzvRA8DbHM6E0nWt_67hnmY |
| CODEN | ITKEEH |
| CitedBy_id | crossref_primary_10_1016_j_ijar_2016_11_002 crossref_primary_10_1109_TKDE_2011_220 crossref_primary_10_1287_opre_1120_1148 crossref_primary_10_1002_int_21732 crossref_primary_10_1007_s10844_021_00690_5 crossref_primary_10_1016_j_datak_2010_05_002 crossref_primary_10_1016_j_fss_2014_08_014 crossref_primary_10_1016_j_ins_2014_12_029 crossref_primary_10_1016_j_ins_2017_06_040 crossref_primary_10_1109_TKDE_2014_2320740 crossref_primary_10_3390_s91209666 crossref_primary_10_1016_j_ins_2013_09_035 |
| Cites_doi | 10.1145/564691.564699 10.1016/B978-155860869-6/50039-1 10.1137/S0097539701398363 10.1109/ICDE.2002.994775 10.1007/978-3-540-45072-6_6 10.1007/3-540-57301-1_5 10.1145/354756.354820 10.1007/s00778-004-0149-x 10.1145/773153.773175 10.1145/564691.564741 10.1016/B978-155860869-6/50077-9 10.1145/564691.564697 10.1109/ICDE.2000.839456 10.1145/223784.223841 10.1109/TIT.1982.1056489 10.1109/ICDE.2003.1260804 10.1145/948205.948236 10.1145/543613.543615 10.1007/978-1-4615-3626-0 10.1145/603867.603884 10.1145/956750.956814 10.1016/B978-012722442-8/50056-2 10.1090/conm/026/737400 10.1109/TKDE.2003.1198390 |
| ContentType | Journal Article |
| Copyright | 2008 INIST-CNRS Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2008 |
| Copyright_xml | – notice: 2008 INIST-CNRS – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2008 |
| DBID | 97E RIA RIE AAYXX CITATION IQODW 7SC 7SP 8FD JQ2 L7M L~C L~D F28 FR3 |
| DOI | 10.1109/TKDE.2007.190693 |
| DatabaseName | IEEE Xplore (IEEE) IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Pascal-Francis Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional ANTE: Abstracts in New Technology & Engineering Engineering Research Database |
| DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional Engineering Research Database ANTE: Abstracts in New Technology & Engineering |
| DatabaseTitleList | Technology Research Database Technology Research Database |
| Database_xml | – sequence: 1 dbid: RIE name: IEEE Electronic Library (IEL) url: https://ieeexplore.ieee.org/ sourceTypes: Publisher |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Engineering Computer Science Applied Sciences |
| EISSN | 1558-2191 |
| EndPage | 229 |
| ExternalDocumentID | 2545074491 19981805 10_1109_TKDE_2007_190693 4358970 |
| Genre | orig-research |
| GroupedDBID | -~X .DC 0R~ 1OL 29I 4.4 5GY 5VS 6IK 97E 9M8 AAJGR AARMG AASAJ AAWTH ABAZT ABFSI ABQJQ ABVLG ACGFO ACIWK AENEX AETIX AGQYO AGSQL AHBIQ AI. AIBXA AKJIK AKQYR ALLEH ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 E.L EBS EJD F5P HZ~ H~9 ICLAB IEDLZ IFIPE IFJZH IPLJI JAVBF LAI M43 MS~ O9- OCL P2P PQQKQ RIA RIE RNI RNS RXW RZB TAE TAF TN5 UHB VH1 AAYXX CITATION IQODW RIG 7SC 7SP 8FD JQ2 L7M L~C L~D F28 FR3 |
| ID | FETCH-LOGICAL-c383t-7b51eb928248e59b9d2d170ddbbae28cf8a84b6f3828942d95c9fe35d43e703e3 |
| IEDL.DBID | RIE |
| ISICitedReferencesCount | 20 |
| ISICitedReferencesURI | http://www.webofscience.com/api/gateway?GWVersion=2&SrcApp=Summon&SrcAuth=ProQuest&DestLinkType=CitingArticles&DestApp=WOS_CPL&KeyUT=000251686000006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| ISSN | 1041-4347 |
| IngestDate | Sun Nov 09 12:12:51 EST 2025 Sun Sep 28 08:22:27 EDT 2025 Sun Jun 29 15:26:33 EDT 2025 Mon Jul 21 09:12:14 EDT 2025 Tue Nov 18 22:25:23 EST 2025 Sat Nov 29 08:08:27 EST 2025 Wed Aug 27 02:52:16 EDT 2025 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 2 |
| Keywords | multiple streams summarization online update Prediction quantization Streaming Correlation Database query data summarization Abstract Updating Maintenance synopsis Real time time-varying data predictive quantization Time varying system Signal quantization Sliding window Linguistics Multiple streams |
| Language | English |
| License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html CC BY 4.0 |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c383t-7b51eb928248e59b9d2d170ddbbae28cf8a84b6f3828942d95c9fe35d43e703e3 |
| Notes | ObjectType-Article-2 SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 14 content type line 23 |
| PQID | 912279376 |
| PQPubID | 23500 |
| PageCount | 14 |
| ParticipantIDs | crossref_primary_10_1109_TKDE_2007_190693 proquest_miscellaneous_34633370 pascalfrancis_primary_19981805 crossref_citationtrail_10_1109_TKDE_2007_190693 ieee_primary_4358970 proquest_miscellaneous_875038240 proquest_journals_912279376 |
| PublicationCentury | 2000 |
| PublicationDate | 2008-02-01 |
| PublicationDateYYYYMMDD | 2008-02-01 |
| PublicationDate_xml | – month: 02 year: 2008 text: 2008-02-01 day: 01 |
| PublicationDecade | 2000 |
| PublicationPlace | New York, NY |
| PublicationPlace_xml | – name: New York, NY – name: New York |
| PublicationTitle | IEEE transactions on knowledge and data engineering |
| PublicationTitleAbbrev | TKDE |
| PublicationYear | 2008 |
| Publisher | IEEE IEEE Computer Society The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| Publisher_xml | – name: IEEE – name: IEEE Computer Society – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
| References | ref15 ref14 ref31 ref11 ref10 ref32 ref2 ref1 ref17 ref19 ref18 Guha (ref13) Bulut (ref6) 2003 Gilbert (ref12) ref24 Weber (ref30) ref23 ref20 ref22 Papadimitriou (ref25) ref21 ref28 ref27 ref29 ref8 ref7 ref9 ref4 Indyk (ref16) ref5 Babcock (ref3) Sakurai (ref26) |
| References_xml | – ident: ref9 doi: 10.1145/564691.564699 – ident: ref31 doi: 10.1016/B978-155860869-6/50039-1 – ident: ref8 doi: 10.1137/S0097539701398363 – volume-title: Technical Report TRCS03-24, Dept. of Computer Science, Univ. of California at Santa Barbara year: 2003 ident: ref6 article-title: Stardust: Fast Stream Indexing Using Incremental Wavelet Approximations – start-page: 409 volume-title: Proc. 31st Int’l Conf. Very Large Data Bases (VLDB ’05) ident: ref13 article-title: Space Efficiency in Synopsis Construction Algorithms – ident: ref15 doi: 10.1109/ICDE.2002.994775 – ident: ref22 doi: 10.1007/978-3-540-45072-6_6 – ident: ref1 doi: 10.1007/3-540-57301-1_5 – ident: ref10 doi: 10.1145/354756.354820 – ident: ref32 doi: 10.1007/s00778-004-0149-x – ident: ref7 doi: 10.1145/773153.773175 – ident: ref27 doi: 10.1145/564691.564741 – volume-title: Proc. 26th Int’l Conf. Very Large Data Bases (VLDB ’00) ident: ref16 article-title: Identifying Representative Trends in Massive Time Series Data Sets Using Sketches – ident: ref20 doi: 10.1016/B978-155860869-6/50077-9 – ident: ref29 doi: 10.1145/564691.564697 – ident: ref5 doi: 10.1109/ICDE.2000.839456 – ident: ref17 doi: 10.1145/223784.223841 – start-page: 697 volume-title: Proc. 31st Int’l Conf. Very Large Data Bases (VLDB ’05) ident: ref25 article-title: Streaming Pattern Discovery in Multiple Time-Series – ident: ref23 doi: 10.1109/TIT.1982.1056489 – start-page: 194 volume-title: Proc. 24th Int’l Conf. Very Large Data Bases (VLDB ’98) ident: ref30 article-title: A Quantitative Analysis and Performance Study for Similarity-Search Methods in High-Dimensional Spaces – ident: ref19 doi: 10.1109/ICDE.2003.1260804 – ident: ref21 doi: 10.1145/948205.948236 – start-page: 516 volume-title: Proc. 26th Int’l Conf. Very Large Data Bases (VLDB ’00) ident: ref26 article-title: The A-Tree: An Index Structure for High-Dimensional Spaces Using Relative Approximation – volume-title: Proc. 27th Int’l Conf. Very Large Data Bases (VLDB ’01) ident: ref12 article-title: Surfing Wavelets on Streams: One Pass Summaries for Approximate Aggregate Queries – ident: ref2 doi: 10.1145/543613.543615 – volume-title: Proc. 13th Ann. ACM-SIAM Symp. Discrete Algorithms (SODA ’02) ident: ref3 article-title: Sampling from a Moving Window over Streaming Data – ident: ref11 doi: 10.1007/978-1-4615-3626-0 – ident: ref4 doi: 10.1145/603867.603884 – ident: ref14 doi: 10.1145/956750.956814 – ident: ref24 doi: 10.1016/B978-012722442-8/50056-2 – ident: ref18 doi: 10.1090/conm/026/737400 – ident: ref28 doi: 10.1109/TKDE.2003.1198390 |
| SSID | ssj0008781 |
| Score | 1.9758172 |
| Snippet | We propose a novel approach based on predictive quantization (PQ) for online summarization of multiple time-varying data streams. A synopsis over a sliding... |
| SourceID | proquest pascalfrancis crossref ieee |
| SourceType | Aggregation Database Index Database Enrichment Source Publisher |
| StartPage | 216 |
| SubjectTerms | Applied sciences Computer science; control theory; systems Computer systems and distributed systems. User interface Data analysis Data mining Data processing. List processing. Character string processing Data security Exact sciences and technology Information systems. Data bases Intrusion detection Memory organisation. Data processing Monitoring multiple streams On-line systems Online online update Prediction Quantization Queries Query processing Real time Sliding Software Stock markets Streams summarization Telecommunication network management Windows (intervals) |
| Title | Incremental Maintenance of Online Summaries Over Multiple Streams |
| URI | https://ieeexplore.ieee.org/document/4358970 https://www.proquest.com/docview/912279376 https://www.proquest.com/docview/34633370 https://www.proquest.com/docview/875038240 |
| Volume | 20 |
| WOSCitedRecordID | wos000251686000006&url=https%3A%2F%2Fcvtisr.summon.serialssolutions.com%2F%23%21%2Fsearch%3Fho%3Df%26include.ft.matches%3Dt%26l%3Dnull%26q%3D |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| journalDatabaseRights | – providerCode: PRVIEE databaseName: IEEE Electronic Library (IEL) customDbUrl: eissn: 1558-2191 dateEnd: 99991231 omitProxy: false ssIdentifier: ssj0008781 issn: 1041-4347 databaseCode: RIE dateStart: 19890101 isFulltext: true titleUrlDefault: https://ieeexplore.ieee.org/ providerName: IEEE |
| link | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV3dS-QwEB9W8UEf9Pziqt6aB18E67abtEkexVMO_AQVfCtpPkDwdsXu-vc7SbpVUQ_upS00bcMkmekvM_MbgD0-LB0rlEmp0iJlBR7Qrus0Z8bpkju0mCFR-JxfXor7e3ndg4MuF8ZaG4LP7KG_DL58M9ZTv1U2QNMuJEeAPsd5GXO1Oq0reChIiugCMRFlfOaSzOTg9uz3SSQrROtXSvrBBIWaKj4iUjUoFBerWXxSzMHanK78Xz9_wHL7V0mO4jRYhZ4drcHKrGIDaRfwGiy9ox9chyNUDnF7EJ-9UJ45wtNvWDJ2JFKQkpuQ24ZomlzhnCcXbfgh8c5s9bfZgLvTk9vjP2lbUiHVCEUnKa-L3NYScRYTtpC1NEOT88yYulZ2KLQTSrC6dNQDMTY0stDSWVoYRi3qBks3YX40HtmfQKhRTqPYc6dCXjoiRaZ0WXAl8GR5AoOZlCvd8o37shePVcAdmaz8uPgymLyK45LAfvfEU-Ta-EfbdS_3rl0r8gT6Hwby7T0IK3ORFQlsz0a2aldrU8nc8yiiqk1gt7uLy8z7TtTIjqdNRVlJKfUfIN-0EN4jjHLNtr7u2jYsxlgTHwqzA_OT56n9BQv6ZfLQPPfDZH4FUcHxww |
| linkProvider | IEEE |
| linkToHtml | http://cvtisr.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwlV1La9wwEB5CGmhyaNI8qJuXDr0U6q69ki3pGNKElOxuC91CbkbWAwLJbol38_s7I3vdhj4gF9tg2RYjacafZuYbgHdyWAZRGJdyY1UqCjygXbdpLlywpQxoMWOi8EhOJurmRn9dgw99Loz3Pgaf-Y90GX35bm6XtFU2QNOutESA_oIqZ3XZWr3eVTKWJEV8gaiIC7lySmZ6ML3-dNHSFaL9KzV_YoRiVRWKiTQNiiW09Sz-UM3R3lxuP6-nO_Cq-69kZ-1EeA1rfrYL26uaDaxbwruw9RsB4R6coXpoNwjx2bEh7ggi4PBsHlhLQsq-xew2xNPsC856Nu4CEBm5s819sw_fLy-m51dpV1QhtQhGF6msi9zXGpGWUL7QtXZDl8vMubo2fqhsUEaJugycoJgYOl1YHTwvnOAetYPnB7A-m8_8G2DcmWBR7HkwMTMdsaIwtiykUXjyMoHBSsqV7RjHqfDFXRWRR6YrGhcqhCmrdlwSeN8_8aNl2_hP2z2Se9-uE3kCJ08G8td7EFjmKisSOFyNbNWt16bSOTEporJN4LS_iwuNvCdm5ufLpuKi5JzTB9g_WijyCaNcs7d_79opvLyajkfV6PPk-hA228gTCow5gvXFw9Ifw4Z9XNw2DydxYv8EDED1DA |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Incremental+Maintenance+of+Online+Summaries+Over+Multiple+Streams&rft.jtitle=IEEE+transactions+on+knowledge+and+data+engineering&rft.au=Altiparmak%2C+F&rft.au=Tuncel%2C+E&rft.au=Ferhatosmanoglu%2C+H&rft.date=2008-02-01&rft.issn=1041-4347&rft.volume=20&rft.issue=2&rft_id=info:doi/10.1109%2FTKDE.2007.190693&rft.externalDBID=NO_FULL_TEXT |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1041-4347&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1041-4347&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1041-4347&client=summon |