English
Related papers

Related papers: Data Compression with Noise Suppression for Infere…

200 papers

Neural network compression has been an increasingly important subject, not only due to its practical relevance, but also due to its theoretical implications, as there is an explicit connection between compressibility and generalization…

Machine Learning · Statistics 2024-02-13 Yijun Wan , Melih Barsbey , Abdellatif Zaidi , Umut Simsekli

In many ultrasonic imaging systems, data acquisition and image formation are performed on separate computing devices. Data transmission is becoming a bottleneck, thus, efficient data compression is essential. Compression rates can be…

Image and Video Processing · Electrical Eng. & Systems 2021-09-02 Georgios Pilikos , Lars Horchens , Kees Joost Batenburg , Tristan van Leeuwen , Felix Lucka

We propose a novel classification framework grounded in symbolic dynamics and data compression using chaotic maps. The core idea is to model each class by generating symbolic sequences from thresholded real-valued training data, which are…

Machine Learning · Computer Science 2026-03-26 Parth Naik , Harikrishnan N B

In this paper, we consider the problem of sensor selection for parameter estimation with correlated measurement noise. We seek optimal sensor activations by formulating an optimization problem, in which the estimation error, given by the…

In distributed, or privacy-preserving learning, we are often given a set of probabilistic models estimated from different local repositories, and asked to combine them into a single model that gives efficient statistical estimation. A…

Machine Learning · Statistics 2017-03-01 Jun Han , Qiang Liu

Estimating the clutter-plus-noise covariance matrix in high-dimensional STAP is challenging in the presence of Internal Clutter Motion (ICM) and a high noise floor. The problem becomes more difficult in low-sample regimes, where the Sample…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Shashwat Jain , Vikram Krishnamurthy , Muralidhar Rangaswamy , Sandeep Gogineni , Bosung Kang , Sean M. O'Rourke

Background: High-throughput proteomics techniques, such as mass spectrometry (MS)-based approaches, produce very high-dimensional data-sets. In a clinical setting one is often interested in how mass spectra differ between patients of…

We consider the problems of compressed sensing and optimal denoising for signals $\mathbf{x_0}\in\mathbb{R}^N$ that are monotone, i.e., $\mathbf{x_0}(i+1) \geq \mathbf{x_0}(i)$, and sparsely varying, i.e., $\mathbf{x_0}(i+1) >…

Statistics Theory · Mathematics 2017-01-03 Eftychios A. Pnevmatikakis

In compressed sensing (CS), sparse signals can be reconstructed from significantly fewer samples than required by the Nyquist-Shannon sampling theorem. While non-sparse signals can be sparsely represented in appropriate transformation…

Information Theory · Computer Science 2026-03-13 Qi Qi , Abdelhamid Tayebi , Daizhan Cheng , Jun-e Feng

We analyze the performance of Dynamic Mode Decomposition (DMD)-based approximations of the stochastic Koopman operator for random dynamical systems where either the dynamics or observables are affected by noise. For many DMD algorithms, the…

Dynamical Systems · Mathematics 2022-02-04 Mathias Wanner , Igor Mezić

This paper addresses the challenge of a particular class of noisy state observations in Markov Decision Processes (MDPs), a common issue in various real-world applications. We focus on modeling this uncertainty through a confusion matrix…

Machine Learning · Computer Science 2023-12-15 Amirhossein Afsharrad , Sanjay Lall

The Fisher information is a fundamental concept for characterizing the sensitivity of parameters in neural networks. However, leveraging the full observed Fisher information is too expensive for large models, so most methods rely on simple…

Machine Learning · Computer Science 2025-05-26 Viktoriia Chekalina , Daniil Moskovskiy , Daria Cherniuk , Maxim Kurkin , Andrey Kuznetsov , Evgeny Frolov

Discrete stochastic optimization considers the problem of minimizing (or maximizing) loss functions defined on discrete sets, where only noisy measurements of the loss functions are available. The discrete stochastic optimization problem is…

Optimization and Control · Mathematics 2013-11-04 Qi Wang

Quantum compressed sensing is the fundamental tool for low-rank density matrix tomographic reconstruction in the informationally incomplete case. We examine situations where the acquired information is not enough to allow one to obtain a…

In the context of high-dimensional linear regression models, we propose an algorithm of exact support recovery in the setting of noisy compressed sensing where all entries of the design matrix are independent and identically distributed…

Statistics Theory · Mathematics 2019-10-23 Mohamed Ndaoud , Alexandre B. Tsybakov

Deep neural networks enable real-time monitoring of in-vehicle drivers, facilitating the timely prediction of distractions, fatigue, and potential hazards. This technology is now integral to intelligent transportation systems. Recent…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Cong Duan , Zixuan Liu , Jiahao Xia , Minghai Zhang , Jiacai Liao , Libo Cao

In various practical situations, we encounter data from stochastic processes which can be efficiently modelled by an appropriate parametric model for subsequent statistical analyses. Unfortunately, the most common estimation and inference…

Methodology · Statistics 2022-04-12 Rohan Hore , Abhik Ghosh

In real-world scenarios, the observation data for reinforcement learning with continuous control is commonly noisy and part of it may be dynamically missing over time, which violates the assumption of many current methods developed for…

Machine Learning · Computer Science 2019-02-18 Yuhui Wang , Hao He , Xiaoyang Tan

Study samples often differ from the target populations of inference and policy decisions in non-random ways. Researchers typically believe that such departures from random sampling -- due to changes in the population over time and space, or…

Methodology · Statistics 2023-07-20 Tamara Broderick , Ryan Giordano , Rachael Meager

This article considers a novel and widely applicable approach to modeling high-dimensional dependent data when a large number of explanatory variables are available and the signal-to-noise ratio is low. We postulate that a $p$-dimensional…

Methodology · Statistics 2024-12-09 Zhaoxing Gao , Ruey S. Tsay