English
Related papers

Related papers: Statistical Physics and Information Theory Perspec…

200 papers

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

Statistics Theory · Mathematics 2024-01-22 Tapio Helin

This work is focussed on the inversion task of inferring the distribution over parameters of interest leading to multiple sets of observations. The potential to solve such distributional inversion problems is driven by increasing…

Machine Learning · Statistics 2026-05-06 Arnaud Vadeboncoeur , Mark Girolami , Andrew M. Stuart

Solving an ill-posed linear inverse problem requires knowledge about the underlying signal model. In many applications, this model is a priori unknown and has to be learned from data. However, it is impossible to learn the model using…

Machine Learning · Statistics 2024-10-22 Julián Tachella , Dongdong Chen , Mike Davies

Using methods of Statistical Physics, we investigate the generalization performance of support vector machines (SVMs), which have been recently introduced as a general alternative to neural networks. For nonlinear classification rules, the…

Disordered Systems and Neural Networks · Physics 2009-10-31 Rainer Dietrich , Manfred Opper , Haim Sompolinsky

We consider a generalization of the multiple measurement vector (MMV) problem, where the measurement matrices are allowed to differ across measurements. This problem arises naturally when multiple measurements are taken over time, e.g., and…

Information Theory · Computer Science 2012-10-09 Reinhard Heckel , Helmut Bölcskei

Consider the regression problem where the response $Y\in\mathbb{R}$ and the covariate $X\in\mathbb{R}^d$ for $d\geq 1$ are \textit{unmatched}. Under this scenario, we do not have access to pairs of observations from the distribution of $(X,…

Statistics Theory · Mathematics 2023-09-19 Mona Azadkia , Fadoua Balabdaoui

We apply MUltiple SIgnal Classification (MUSIC) algorithm for the location reconstruction of a set of {two-dimensional circle-like} small inhomogeneities in the limited-aperture inverse scattering problem. Compared with the full- or…

Numerical Analysis · Mathematics 2024-11-12 Won-Kwang Park

The study of multiplicative noise models has a long history in control theory but is re-emerging in the context of complex networked systems and systems with learning-based control. We consider linear system identification with…

Systems and Control · Electrical Eng. & Systems 2020-07-06 Yu Xing , Ben Gravell , Xingkang He , Karl Henrik Johansson , Tyler Summers

This paper studies the problem of support recovery of sparse signals based on multiple measurement vectors (MMV). The MMV support recovery problem is connected to the problem of decoding messages in a Single-Input Multiple-Output (SIMO)…

Information Theory · Computer Science 2011-09-12 Yuzhe Jin , Bhaskar D. Rao

Misinformation is still a major societal problem and the arrival of Large Language Models (LLMs) only added to it. This paper analyzes synthetic, false, and genuine information in the form of text from spectral analysis, visualization, and…

Artificial Intelligence · Computer Science 2024-07-09 Vishnu S. Pendyala , Madhulika Dutta

This paper is concerned with the interplay between statistical asymmetry and spectral methods. Suppose we are interested in estimating a rank-1 and symmetric matrix $\mathbf{M}^{\star}\in \mathbb{R}^{n\times n}$, yet only a randomly…

Statistics Theory · Mathematics 2023-01-10 Yuxin Chen , Chen Cheng , Jianqing Fan

Data informativity provides a theoretical foundation for determining whether collected data are sufficiently informative to achieve specific control objectives in data-driven control frameworks. In this study, we investigate the data…

Optimization and Control · Mathematics 2026-04-22 Taira Kaminaga , Hampei Sasahara

We study the linear ill-posed inverse problem with noisy data in the statistical learning setting. Approximate reconstructions from random noisy data are sought with general regularization schemes in Hilbert scale. We discuss the rates of…

Statistics Theory · Mathematics 2024-04-09 Abhishake Rastogi , Peter Mathé

Motivated by data-rich experiments in transcriptional regulation and sensory neuroscience, we consider the following general problem in statistical inference. When exposed to a high-dimensional signal S, a system of interest computes a…

Quantitative Methods · Quantitative Biology 2013-12-16 Justin B. Kinney , Gurinder S. Atwal

Many important problems are characterized by the eigenvalues of a large matrix. For example, the difficulty of many optimization problems, such as those arising from the fitting of large models in statistics and machine learning, can be…

Multiscale entropy (MSE) has been widely used to examine nonlinear systems involving multiple time scales, such as biological and economic systems. Conversely, Allan variance has been used to evaluate the stability of oscillators, such as…

Chaotic Dynamics · Physics 2023-05-03 Naoki Asuke , Tomoki Yamagami , Takatomo Mihana , André Röhm , Ryoichi Horisaki , Makoto Naruse

Inverse problems, which are related to Maxwell's equations, in the presence of nonlinear materials is a quite new topic in the literature. The lack of contributions in this area can be ascribed to the significant challenges that such…

Numerical Analysis · Mathematics 2024-10-08 Vincenzo Mottola , Antonio Corbo Esposito , Gianpaolo Piscitelli , Antonello Tamburrino

Various studies that address the compressed sensing problem with Multiple Measurement Vectors (MMVs) have been recently carried. These studies assume the vectors of the different channels to be jointly sparse. In this paper, we relax this…

Machine Learning · Computer Science 2016-11-14 Hamid Palangi , Rabab Ward , Li Deng

We provide an overview of recent progress in statistical inverse problems with random experimental design, covering both linear and nonlinear inverse problems. Different regularization schemes have been studied to produce robust and stable…

Statistics Theory · Mathematics 2023-12-27 Abhishake , Tapio Helin , Nicole Mücke

Kernel random matrices have attracted a lot of interest in recent years, from both practical and theoretical standpoints. Most of the theoretical work so far has focused on the case were the data is sampled from a low-dimensional structure.…

Statistics Theory · Mathematics 2010-11-12 Noureddine El Karoui