English
Related papers

Related papers: Linear models based on noisy data and the Frisch s…

200 papers

A statistical framework is introduced for a broad class of problems involving synchronization or registration of data across a sensor network in the presence of noise. This framework enables an estimation-theoretic approach to the design…

Networking and Internet Architecture · Computer Science 2010-10-15 Stephen D. Howard , Douglas Cochran , William Moran , Frederick R. Cohen

We present a simple algorithm for identifying and correcting real-valued noisy labels from a mixture of clean and corrupted sample points using Gaussian process regression. A heteroscedastic noise model is employed, in which additive…

Machine Learning · Computer Science 2021-03-30 Yu-Hang Tang , Yuanran Zhu , Wibe A. de Jong

Estimating free-energy differences using nonequilibrium work relations, such as the Jarzynski equality, is hindered by poor convergence when work fluctuations are large. For systems governed by overdamped Langevin dynamics, we propose the…

Statistical Mechanics · Physics 2025-08-14 Stephen Whitelam

The detection of a signal variable from multiple variables that contain many noise variables is often approached as a variable selection problem under a given objective variable. This is nothing more than building a supervised model of a…

Data Analysis, Statistics and Probability · Physics 2025-09-29 Yoh-ichi Mototake , Y-h. Taguchi

Data-driven, model-free analytics are natural choices for discovery and forecasting of complex, nonlinear systems. Methods that operate in the system state-space require either an explicit multidimensional state-space, or, one approximated…

Machine Learning · Statistics 2021-03-15 Joseph Park , Gerald M Pao , Erik Stabenau , George Sugihara , Thomas Lorimer

This paper resolves a pivotal open problem on nonparametric inference for nonlinear functionals of volatility matrix. Multiple prominent statistical tasks can be formulated as functionals of volatility matrix, yet a unified statistical…

Methodology · Statistics 2024-04-02 Richard Y. Chen

Analytical understanding of how low-dimensional latent features reveal themselves in large-dimensional data is still lacking. We study this by defining a linear latent feature model with additive noise constructed from probabilistic…

Disordered Systems and Neural Networks · Physics 2022-07-20 Philipp Fleig , Ilya Nemenman

In this brief paper, we present a simple approach to estimate the variance of measurement noise with time-varying 1-D signals. The proposed approach exploits the relationship between the noise variance and the variance of the prediction…

Signal Processing · Electrical Eng. & Systems 2021-04-09 Qin Li , Junchan Zhao

In learning with noisy labels, the sample selection approach is very popular, which regards small-loss data as correctly labeled during training. However, losses are generated on-the-fly based on the model being trained with noisy labels,…

Machine Learning · Computer Science 2021-06-02 Xiaobo Xia , Tongliang Liu , Bo Han , Mingming Gong , Jun Yu , Gang Niu , Masashi Sugiyama

Random label noises (or observational noises) widely exist in practical machine learning settings. While previous studies primarily focus on the affects of label noises to the performance of learning, our work intends to investigate the…

Machine Learning · Computer Science 2023-04-04 Haoyi Xiong , Xuhong Li , Boyang Yu , Zhanxing Zhu , Dongrui Wu , Dejing Dou

Generative models that maximize model likelihood have gained traction in many practical settings. Among them, perturbation based approaches underpin many strong likelihood estimation models, yet they often face slow convergence and limited…

Information Theory · Computer Science 2025-10-27 Yirong Shen , Lu Gan , Cong Ling

The literature on clustering for continuous data is rich and wide; differently, that one developed for categorical data is still limited. In some cases, the problem is made more difficult by the presence of noise variables/dimensions that…

Methodology · Statistics 2015-04-14 Monia Ranalli , Roberto Rocci

We propose a method for learning linear models whose predictive performance is robust to causal interventions on unobserved variables, when noisy proxies of those variables are available. Our approach takes the form of a regularization term…

Machine Learning · Computer Science 2021-06-29 Michael Oberst , Nikolaj Thams , Jonas Peters , David Sontag

Identifying a linear system model from data has wide applications in control theory. The existing work on finite sample analysis for linear system identification typically uses data from a single system trajectory under i.i.d random inputs,…

Systems and Control · Electrical Eng. & Systems 2023-09-19 Lei Xin , George Chiu , Shreyas Sundaram

Modeling real-world systems requires accounting for noise - whether it arises from unpredictable fluctuations in financial markets, irregular rhythms in biological systems, or environmental variability in ecosystems. While the behavior of…

Machine Learning · Computer Science 2026-04-08 Matteo Bosso , Giovanni Franzese , Kushal Swamy , Maarten Theulings , Alejandro M. Aragón , Farbod Alijani

This paper deals with the problem of finding a low-complexity estimate of the impulse response of a linear time-invariant discrete-time dynamic system from noise-corrupted input-output data. To this purpose, we introduce an identification…

Systems and Control · Computer Science 2016-09-23 Giuseppe C. Calafiore , Carlo Novara , Michele Taragna

Causality analysis is a powerful tool for determining cause-and-effect relationships between variables in a system by quantifying the influence of one variable on another. Despite significant advancements in the field, many existing studies…

Numerical Analysis · Mathematics 2024-09-12 Justin Lien

Uncertainty estimation for unlabeled data is crucial to active learning. With a deep neural network employed as the backbone model, the data selection process is highly challenging due to the potential over-confidence of the model…

Machine Learning · Computer Science 2024-02-14 Xingjian Li , Pengkun Yang , Yangcheng Gu , Xueying Zhan , Tianyang Wang , Min Xu , Chengzhong Xu

We address the problem of inferring descriptions of system behavior using Linear Temporal Logic (LTL) from a finite set of positive and negative examples. Most of the existing approaches for solving such a task rely on predefined templates…

Machine Learning · Computer Science 2021-06-28 Jean-Raphaël Gaglione , Daniel Neider , Rajarshi Roy , Ufuk Topcu , Zhe Xu

In this paper we investigate the non-linear and ill-posed inverse problem of simultaneously identifying the conductivity and the reaction in diffuse optical tomography with noisy measurement data available on an accessible part of the…

Numerical Analysis · Mathematics 2020-07-10 Tran Nhan Tam Quyen