English
Related papers

Related papers: Beyond Gaussian Assumptions: A Nonlinear Generaliz…

200 papers

In real-world problems, environmental noise is often idealized as Gaussian white noise, despite potential temporal dependencies. The Linear Inverse Model (LIM) is a class of data-driven methods that extract dynamic and stochastic…

Numerical Analysis · Mathematics 2025-05-01 Justin Lien , Yan-Ning Kuo , Hiroyasu Ando , Shoichiro Kido

A recent paper by Lien et al. (2025) introduces the "colored linear inverse model" (colored LIM), in which stochastic forcing is modeled using Ornstein-Uhlenbeck colored noise rather than idealized white noise. In that work, it is shown…

Atmospheric and Oceanic Physics · Physics 2026-04-06 Cristian Martinez-Villalobos

Cyclostationary linear inverse models (CS-LIMs), generalized versions of the classical (stationary) LIM, are advanced data-driven techniques for extracting the first-order time-dependent dynamics and random forcing relevant information from…

Numerical Analysis · Mathematics 2025-05-01 Justin Lien , Yan-Ning Kuo , Hiroyasu Ando

Causality analysis is a powerful tool for determining cause-and-effect relationships between variables in a system by quantifying the influence of one variable on another. Despite significant advancements in the field, many existing studies…

Numerical Analysis · Mathematics 2024-09-12 Justin Lien

Contrastive learning based on instance discrimination trains model to discriminate different transformations of the anchor sample from other samples, which does not consider the semantic similarity among samples. This paper proposes a new…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Hao Li , Xiaopeng Zhang , Hongkai Xiong

Many physical systems characterized by nonlinear multiscale interactions can be effectively modeled by treating unresolved degrees of freedom as random fluctuations. However, even when the microscopic governing equations and qualitative…

Statistical Mechanics · Physics 2021-06-07 Jared L. Callaham , Jean-Christophe Loiseau , Georgios Rigas , Steven L. Brunton

Biochemical signal transduction, a form of molecular communication, can be modeled using graphical Markov channels with input-modulated transition rates. Such channel models are strongly non-Gaussian. In this paper we use a linear noise…

Quantitative Methods · Quantitative Biology 2019-08-30 Gregory R. Hessler , Andrew W. Eckford , Peter J. Thomas

Data-driven, model-free analytics are natural choices for discovery and forecasting of complex, nonlinear systems. Methods that operate in the system state-space require either an explicit multidimensional state-space, or, one approximated…

Machine Learning · Statistics 2021-03-15 Joseph Park , Gerald M Pao , Erik Stabenau , George Sugihara , Thomas Lorimer

We introduce Linearly Constrained Diffusion Implicit Models (CDIM), a fast and accurate approach to solving noisy linear inverse problems using diffusion models. Traditional diffusion-based inverse methods rely on numerous projection steps…

Machine Learning · Computer Science 2025-12-01 Vivek Jayaram , Ira Kemelmacher-Shlizerman , Steven M. Seitz , John Thickstun

Denoising diffusion models are a class of generative models which have recently achieved state-of-the-art results across many domains. Gradual noise is added to the data using a diffusion process, which transforms the data distribution into…

Machine Learning · Statistics 2024-06-28 Francisco Vargas , Teodora Reu , Anna Kerekes , Michael M Bronstein

Likelihood analysis is typically limited to normally distributed noise due to the difficulty of determining the probability density function of complex, high-dimensional, non-Gaussian, and anisotropic noise. This is a major limitation for…

Instrumentation and Methods for Astrophysics · Physics 2023-06-14 Ronan Legin , Alexandre Adam , Yashar Hezaveh , Laurence Perreault Levasseur

When considering the problem of unmixing hyperspectral images, most of the literature in the geoscience and image processing areas relies on the widely used linear mixing model (LMM). However, the LMM may be not valid and other nonlinear…

Data Analysis, Statistics and Probability · Physics 2015-06-15 Nicolas Dobigeon , Jean-Yves Tourneret , Cédric Richard , José C. M. Bermudez , Stephen McLaughlin , Alfred O. Hero

Recently, a novel linear model predictive control algorithm based on a physics-informed Gaussian Process has been introduced, whose realizations strictly follow a system of underlying linear ordinary differential equations with constant…

Optimization and Control · Mathematics 2025-05-01 Adrian Lepp , Jörn Tebbe , Andreas Besginow

Nonlinear stochastic motion presents significant challenges for Bayesian particle tracking. To address this challenge, this paper proposes a framework to construct an invertible transformation that maps the nonlinear state-space model (SSM)…

Methodology · Statistics 2026-04-13 Yonatan L. Ashenafi

In this work we introduce a novel stochastic algorithm dubbed SNIPS, which draws samples from the posterior distribution of any linear inverse problem, where the observation is assumed to be contaminated by additive white Gaussian noise.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Bahjat Kawar , Gregory Vaksman , Michael Elad

Line intensity mapping (LIM) is a promising observational method to probe large-scale fluctuations of line emission from distant galaxies. Data from wide-field LIM observations allow us to study the large-scale structure of the universe as…

Astrophysics of Galaxies · Physics 2021-01-13 Kana Moriwaki , Masato Shirasaki , Naoki Yoshida

We provide theoretical and empirical evidence for a type of asymmetry between causes and effects that is present when these are related via linear models contaminated with additive non-Gaussian noise. Assuming that the causes and the…

Machine Learning · Statistics 2016-02-23 Daniel Hernández-Lobato , Pablo Morales-Mombiela , David Lopez-Paz , Alberto Suárez

We propose SLIM (Stochastic Learning and Inference in overidentified Models), a scalable stochastic approximation framework for nonlinear GMM. SLIM forms iterative updates from independent mini-batches of moments and their derivatives,…

Econometrics · Economics 2025-11-03 Xiaohong Chen , Min Seong Kim , Sokbae Lee , Myung Hwan Seo , Myunghyun Song

In this paper, we aim to estimate the direction of an underlying signal from its nonlinear observations following the semi-parametric single index model (SIM). Unlike conventional compressed sensing where the signal is assumed to be sparse,…

Machine Learning · Computer Science 2022-06-02 Jiulong Liu , Zhaoqiang Liu

For dynamical systems that can be modelled as asymptotically stable linear systems forced by Gaussian noise, this paper develops methods to infer or estimate their modes from observations in real time. The modes can be real or complex. For…

Machine Learning · Statistics 2019-10-30 Robert S. MacKay
‹ Prev 1 2 3 10 Next ›