English
Related papers

Related papers: Bilateral Distribution Compression: Reducing Both …

200 papers

Large-scale numerical simulations often produce high-dimensional gridded data that is challenging to process for downstream applications. A prime example is numerical weather prediction, where atmospheric processes are modeled using…

Machine Learning · Computer Science 2025-02-10 Jieyu Chen , Kevin Höhlein , Sebastian Lerch

Lightweight Temporal Compression (LTC) is among the lossy stream compression methods that provide the highest compression rate for the lowest CPU and memory consumption. As such, it is well suited to compress data streams in…

Information Theory · Computer Science 2018-11-27 Bo Li , Omid Sarbishei , Hosein Nourani , Tristan Glatard

Modern scientific simulations generate massive volumes of data, creating significant challenges for I/O and storage systems. Error-bounded lossy compression (EBLC) offers a solution by reducing data set sizes while preserving data quality…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-16 Grant Wilkins , Sheng Di , Jon C. Calhoun , Robert Underwood , Franck Cappello

Seismic datasets contain valuable information that originate from areas of interest in the subsurface; such seismic reflections are however inevitably contaminated by other events created by waves reverberating in the overburden.…

Geophysics · Physics 2022-08-10 Matteo Ravasi , Tamil Selvan , Nick Luiken

We introduce MI-to-Mid Distilled Compression (M2M-DC), a two-scale, shape-safe compression framework that interleaves information-guided block pruning with progressive inner slicing and staged knowledge distillation (KD). First, M2M-DC…

Machine Learning · Computer Science 2025-11-19 Lionel Levine , Haniyeh Ehsani Oskouie , Sajjad Ghiasvand , Majid Sarrafzadeh

We introduce a framework - Artemis - to tackle the problem of learning in a distributed or federated setting with communication constraints and device partial participation. Several workers (randomly sampled) perform the optimization…

Machine Learning · Computer Science 2022-06-22 Constantin Philippenko , Aymeric Dieuleveut

The rise of internet has resulted in an explosion of data consisting of millions of articles, images, songs, and videos. Most of this data is high dimensional and sparse. The need to perform an efficient search for similar objects in such…

Data Structures and Algorithms · Computer Science 2016-12-20 Raghav Kulkarni , Rameshwar Pratap

Dataset distillation aims to synthesize a compact subset of the original data, enabling models trained on it to achieve performance comparable to those trained on the original large dataset. Existing distribution-matching methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Xuhui Li , Zhengquan Luo , Zihui Cui , Zhiqiang Xu

The dynamic mode decomposition (DMD) has become a leading tool for data-driven modeling of dynamical systems, providing a regression framework for fitting linear dynamical models to time-series measurement data. We present a simple…

Numerical Analysis · Mathematics 2017-04-11 Travis Askham , J. Nathan Kutz

A plethora of dimension reduction methods have been developed to visualize high-dimensional data in low dimensions. However, different dimension reduction methods often output different and possibly conflicting visualizations of the same…

Methodology · Statistics 2025-12-19 Bingxue An , Tiffany M. Tang

Machine learning (ML) is a key technique for big-data-driven modelling and analysis of massive Internet of Things (IoT) based intelligent and ubiquitous computing. For fast-increasing applications and data amounts, distributed learning is a…

Machine Learning · Computer Science 2022-02-08 Hao Chen , Yu Ye , Ming Xiao , Mikael Skoglund

Multidimensional Scaling (MDS) is one of the most popular methods for dimensionality reduction and visualization of high dimensional data. Apart from these tasks, it also found applications in the field of geometry processing for the…

Computational Geometry · Computer Science 2017-09-12 Amit Boyarski , Alex M. Bronstein , Michael M. Bronstein

Beyond achieving higher compression efficiency over classical image compression codecs, deep image compression is expected to be improved with additional side information, e.g., another image from a different perspective of the same scene.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yujun Huang , Bin Chen , Shiyu Qin , Jiawei Li , Yaowei Wang , Tao Dai , Shu-Tao Xia

Existing two-sample testing techniques, particularly those based on choosing a kernel for the Maximum Mean Discrepancy (MMD), often assume equal sample sizes from the two distributions. Applying these methods in practice can require…

Machine Learning · Statistics 2025-12-17 Aaron Wei , Milad Jalali , Danica J. Sutherland

We describe a search-free resizing framework that can further improve the rate-distortion tradeoff of recent learned image compression models. Our approach is simple: compose a pair of differentiable downsampling/upsampling layers that…

Image and Video Processing · Electrical Eng. & Systems 2022-04-27 Li-Heng Chen , Christos G. Bampis , Zhi Li , Lukáš Krasula , Alan C. Bovik

Nowadays, massive datasets are typically dispersed across multiple locations, encountering dual challenges of high dimensionality and huge sample size. Therefore, it is necessary to explore sufficient dimension reduction (SDR) methods for…

Methodology · Statistics 2025-09-16 Hongying Li , Minyi Zhu , Yaqi Cao , Xinyi Xu

Reconstruction-based anomaly detection models achieve their purpose by suppressing the generalization ability for anomaly. However, diverse normal patterns are consequently not well reconstructed as well. Although some efforts have been…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Wenrui Liu , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

Unsupervised dimensionality reduction is one of the commonly used techniques in the field of high dimensional data recognition problems. The deep autoencoder network which constrains the weights to be non-negative, can learn a low…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Anyong Qin , Zhaowei Shang , Zhuolin Tan , Taiping Zhang , Yuan Yan Tang

We present a novel lossless universal source coding algorithm that uses parallel computational units to increase the throughput. The length-$N$ input sequence is partitioned into $B$ blocks. Processing each block independently of the other…

Information Theory · Computer Science 2016-03-27 Nikhil Krishnan , Dror Baron , Mehmet Kıvanç Mıhçak

Bimodal truncated count distributions are frequently observed in aggregate survey data and in user ratings when respondents are mixed in their opinion. They also arise in censored count data, where the highest category might create an…

Methodology · Statistics 2014-01-24 Pragya Sur , Galit Shmueli , Smarajit Bose , Paromita Dubey