English
Related papers

Related papers: Robust Compressed Sensing using Generative Models

200 papers

The ability to sense, localize, and estimate the 3D position and orientation of the human body is critical in virtual reality (VR) and extended reality (XR) applications. This becomes more important and challenging with the deployment of…

Human-Computer Interaction · Computer Science 2024-05-14 Nguyen Quang Hieu , Dinh Thai Hoang , Diep N. Nguyen , Mohammad Abu Alsheikh

We propose a residual randomization procedure designed for robust Lasso-based inference in the high-dimensional setting. Compared to earlier work that focuses on sub-Gaussian errors, the proposed procedure is designed to work robustly in…

Methodology · Statistics 2021-08-20 Y. Samuel Wang , Si Kai Lee , Panos Toulis , Mladen Kolar

We study the problem of outlier robust high-dimensional mean estimation under a finite covariance assumption, and more broadly under finite low-degree moment assumptions. We consider a standard stability condition from the recent robust…

Statistics Theory · Mathematics 2021-03-17 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia

The field of compressed sensing has shown that a sparse but otherwise arbitrary vector can be recovered exactly from a small number of randomly constructed linear projections (or samples). The question addressed in this paper is whether an…

Information Theory · Computer Science 2010-01-26 Galen Reeves , Michael Gastpar

We investigate high-dimensional sparse regression when both the noise and the design matrix exhibit heavy-tailed behavior. Standard algorithms typically fail in this regime, as heavy-tailed covariates distort the empirical risk geometry. We…

Methodology · Statistics 2026-01-12 Kaiyuan Zhou , Xiaoyu Zhang , Wenyang Zhang , Di Wang

We study aleatoric and epistemic uncertainty estimation in a learned regressive system dynamics model. Disentangling aleatoric uncertainty (the inherent randomness of the system) from epistemic uncertainty (the lack of data) is crucial for…

Machine Learning · Computer Science 2025-03-21 Zhiyu An , Zhibo Hou , Wan Du

Monte Carlo simulations of neutronic systems are computationally intensive and demand significant memory resources for high-fidelity modeling. Compressed sensing enables accurate reconstruction of signals from significantly fewer samples…

Computational Physics · Physics 2026-02-10 Ethan Lame , Camille Palmer , Todd Palmer , Ilham Variansyah

Learning-based lossless image compression employs pixel-based or subimage-based auto-regression for probability estimation, which achieves desirable performances. However, the existing works only consider context dependencies in one…

Image and Video Processing · Electrical Eng. & Systems 2025-03-17 Tiantian Li , Qunbing Xia , Yue Li , Ruixiao Guo , Gaobo Yang

Region-of-Interest (ROI)-based image compression allocates bits unevenly according to the semantic importance of different regions. Such differentiated coding typically induces a sharp-peaked and heavy-tailed distribution. This distribution…

Image and Video Processing · Electrical Eng. & Systems 2026-02-03 Kai Hu , Junfu Tan , Fang Xu , Ramy Samy , Yu Liu

Model-based algorithms, which learn a dynamics model from logged experience and perform some sort of pessimistic planning under the learned model, have emerged as a promising paradigm for offline reinforcement learning (offline RL).…

Machine Learning · Computer Science 2022-01-28 Tianhe Yu , Aviral Kumar , Rafael Rafailov , Aravind Rajeswaran , Sergey Levine , Chelsea Finn

In this paper, we propose a general framework for designing sensing matrix $\boldsymbol{A} \in \mathbb{R}^{d\times p}$, for estimation of sparse covariance matrix from compressed measurements of the form $\boldsymbol{y} =…

Information Theory · Computer Science 2022-11-16 Muralikrishnna G. Sethuraman , Hang Zhang , Faramarz Fekri

We are motivated by the problem of learning policies for robotic systems with rich sensory inputs (e.g., vision) in a manner that allows us to guarantee generalization to environments unseen during training. We provide a framework for…

Robotics · Computer Science 2022-07-25 Abhinav Agarwal , Sushant Veer , Allen Z. Ren , Anirudha Majumdar

Real-world datasets are often biased with respect to key demographic factors such as race and gender. Due to the latent nature of the underlying factors, detecting and mitigating bias is especially challenging for unsupervised machine…

Machine Learning · Computer Science 2020-07-01 Kristy Choi , Aditya Grover , Trisha Singh , Rui Shu , Stefano Ermon

The Gaussian cluster-weighted model (CWM) is a mixture of regression models with random covariates that allows for flexible clustering of a random vector composed of response variables and covariates. In each mixture component, it adopts a…

Methodology · Statistics 2014-09-23 Antonio Punzo , Paul D. McNicholas

Support points summarize a large dataset through a smaller set of representative points that can be used for data operations, such as Monte Carlo integration, without requiring access to the full dataset. In this sense, support points offer…

Machine Learning · Statistics 2025-09-01 Peiqi Zhao , Carlos E. Rodríguez , Ramsés H. Mena , Stephen G. Walker

Remote-sensing (RS) image compression at extremely low bitrates has always been a challenging task in practical scenarios like edge device storage and narrow bandwidth transmission. Generative models including VAEs and GANs have been…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yixuan Ye , Ce Wang , Wanjie Sun , Zhenzhong Chen

Information theory and machine learning are inextricably linked and have even been referred to as "two sides of the same coin". One particularly elegant connection is the essential equivalence between probabilistic generative modeling and…

Information Theory · Computer Science 2024-06-11 Jincheng Dai , Xiaoqi Qin , Sixian Wang , Lexi Xu , Kai Niu , Ping Zhang

Generalized Linear Models are routinely used in data analysis. The classical procedures for estimation are based on Maximum Likelihood and it is well known that the presence of outliers can have a large impact on this estimator. Robust…

Computation · Statistics 2017-10-02 Marina Valdora , Claudio Agostinelli , Victor J. Yohai

We consider the least-squares regression problem with unknown noise variance, where the observed data points are allowed to be corrupted by outliers. Building on the median-of-means (MOM) method introduced by Lecue and Lerasle…

Statistics Theory · Mathematics 2021-03-19 G. Finocchio , A. Derumigny , K. Proksch

This paper describes recursive algorithms for state estimation of linear dynamical systems when measurements are noisy with unknown bias and/or outliers. For situations with noisy and biased measurements, algorithms are proposed that…

Systems and Control · Electrical Eng. & Systems 2025-03-11 Krishan Mohan Nagpal