Search Results - Data Compression. Algorithms. Data structures

Data structures and compression algorithms for genomic sequence data by Brandon, Marty C., Wallace, Douglas C., Baldi, Pierre

“…, but also for the storage, navigation and privacy of genomic data. Here, we develop data structures and algorithms for the efficient storage of genomic and other sequence data that may also facilitate querying and protecting the data. Results…”
Get full text

Data structures and compression algorithms for high-throughput sequencing technologies by Daily, Kenny, Rigor, Paul, Christley, Scott, Xie, Xiaohui, Baldi, Pierre

“… Results We develop data structures and compression algorithms for HTS data. A processing stage maps short sequences to a reference genome or a large table of sequences…”
Get full text

SpZip: Architectural Support for Effective Data Compression In Irregular Applications by Yang, Yifan, Emer, Joel S., Sanchez, Daniel

“… applications.We present SpZip, an architectural approach that makes data compression practical for irregular algorithms…”
Get full text

Faster and Stronger Lossless Compression with Optimized Autoregressive Framework by Mao, Yu, Li, Jingzong, Cui, Yufei, Xue, Jason Chun

“…Neural AutoRegressive (AR) framework has been applied in general-purpose lossless compression recently to improve compression performance…”
Get full text

NRGC: a novel referential genome compression algorithm by Saha, Subrata, Rajasekaran, Sanguthevar

“… Data compression techniques are one of the most…”
Get full text

SNAPPIX: Efficient-Coding-Inspired In-Sensor Compression for Edge Vision by Lin, Weikai, Ma, Tianrui, Boloor, Adith, Feng, Yu, Xing, Ruofan, Zhang, Xuan, Zhu, Yuhao

“…Energy-efficient image acquisition on the edge is crucial for enabling remote sensing applications where the sensor node has weak compute capabilities and must transmit data to a remote server/cloud for processing…”
Get full text

ClusterKV: Manipulating LLM KV Cache in Semantic Space for Recallable Compression by Liu, Guangda, Li, Chengwei, Zhao, Jieru, Zhang, Chenqi, Guo, Minyi

“…) cache and increased latency due to extensive memory accesses. Recent works have proposed compressing KV cache to approximate computation, but these methods either…”
Get full text

Easz: An Agile Transformer-based Image Compression Framework for Resource-constrained IoTs by Mao, Yu, Li, Jingzong, Wang, Jun, Xu, Hong, Kuo, Tei-Wei, Guan, Nan, Xue, Chun Jason

“…Neural image compression, necessary in various machine-to-machine communication scenarios, suffers from its heavy encode-decode structures and inflexibility in switching between different compression levels…”
Get full text

Efficient and robust search of microbial genomes via phylogenetic compression by Břinda, Karel, Lima, Leandro, Pignotti, Simone, Quinones-Olvera, Natalia, Salikhov, Kamil, Chikhi, Rayan, Kucherov, Gregory, Iqbal, Zamin, Baym, Michael

“… algorithms and data structures. We show that, when applied to modern diverse collections approaching millions of genomes, lossless phylogenetic compression improves the compression ratios of assemblies, de Bruijn graphs and k-mer…”
Get more information

MILLION: MasterIng Long-Context LLM Inference Via Outlier-Immunized KV Product QuaNtization by Wang, Zongwu, Xu, Peng, Liu, Fangxin, Hu, Yiwei, Sun, Qingxiao, Li, Gezi, Li, Cheng, Wang, Xuan, Jiang, Li, Guan, Haibing

“… KV cache mechanism alleviates this issue by storing pre-computed data, but introduces memory requirements that scale linearly with context length, hindering efficient LLM deployment…”
Get full text

KVO-LLM: Boosting Long-Context Generation Throughput for Batched LLM Inference by Li, Zhenyu, Lyu, Dongxu, Wang, Gang, Chen, Yuzhou, Chen, Liyan, Li, Wenjie, Jiang, Jianfei, Sun, Yanan, He, Guanghui

“… cache compression algorithms struggle with hardware inefficiency or significant accuracy degradation…”
Get full text

DuQTTA: Dual Quantized Tensor-Train Adaptation with Decoupling Magnitude-Direction for Efficient Fine-Tuning of LLMs by Dong, Haoyan, Chen, Hai-Bao, Chang, Jingjing, Yang, Yixin, Gao, Ziyang, Ji, Zhigang, Wang, Runsheng, Huang, Ru

“…Recent parameter-efficient fine-tuning (PEFT) techniques have enabled large language models (LLMs) to be efficiently fine-tuned for specific tasks, while…”
Get full text

NDSEARCH: Accelerating Graph-Traversal-Based Approximate Nearest Neighbor Search through Near Data Processing by Wang, Yitu, Li, Shiyu, Zheng, Qilin, Song, Linghao, Li, Zongwang, Chang, Andrew, Li, Hai lHelenr, Chen, Yiran

“…Approximate nearest neighbor search (ANNS) is a key retrieval technique for vector database and many data center applications, such as person re-identification and recommendation systems…”
Get full text

PISA: Efficient Precision-Slice Framework for LLMs with Adaptive Numerical Type by Yang, Ning, Wang, Zongwu, Sun, Qingxiao, Lu, Liqiang, Liu, Fangxin

“… Previous efforts addressed this issue by employing compression-based encoding for mixed-precision quantization…”
Get full text

SHM data compression and reconstruction based on IGWO-OMP algorithm by Zhang, Longguan, Jia, Junfeng, Bai, Yulei, Du, Xiuli, Lin, Ping, Guo, He

“…) algorithm for SHM data compression and reconstruction. The effectiveness of the proposed algorithm was validated using four SHM datasets including ultrasonic guided wave (UGW…”
Get full text

Seprox: Sequence-based Approximations for Compressing Ultra-Low Precision Deep Neural Networks by Parvathy, Aradhana Mohan, Krithivasan, Sarada, Sen, Sanchari, Raghunathan, Anand

“…Compression techniques such as quantization and pruning are indispensable for deploying state-of-the-art Deep Neural Networks (DNNs…”
Get full text

Processing-In-Hierarchical-Memory Architecture for Billion-Scale Approximate Nearest Neighbor Search by Zhu, Zhenhua, Liu, Jun, Dai, Guohao, Zeng, Shulin, Li, Bing, Yang, Huazhong, Wang, Yu

“… Because of the irregular and large-volume data access, existing CPU-based systems suffer from heavy data movements when dealing with graph-based ANNS algorithms…”
Get full text

On The Efficiency of Sparse-Tiled Tensor Graph Processing For Low Memory Usage by Cipolletta, Antonio, Calimera, Andrea

“… Even though many data-driven compression pipelines have proven their efficacy, this work shows there is still room for optimization at the intersection with compute-oriented optimizations…”
Get full text

Behavioral Study of Data Structures on Lempel Ziv Welch (LZW) Data Compression Algorithm and ITS Computational Complexity by Nishad, P. M., Chezian, R. Manika

“… The LZW algorithm uses dictionary while decoding and encoding. The computational and space complexity of LZW data compression algorithm is purely depends on the effective implementation of data structure…”
Get full text

On system behaviour using complex networks of a compression algorithm by Walker, David M, Correa, Debora C, Small, Michael

“…We construct complex networks of scalar time series using a data compression algorithm…”
Get more information