English
Related papers

Related papers: Fast and Reliable Parameter Estimation from Nonlin…

200 papers

As one of the most commonly seen data challenges, missing data, in particular, multiple, non-monotone missing patterns, complicates estimation and inference due to the fact that missingness mechanisms are often not missing at random, and…

Methodology · Statistics 2025-04-21 Jianing Dong , Raymond K. W. Wong , Kwun Chuen Gary Chan

In this work we develop an algorithm for signal reconstruction from the magnitude of its Fourier transform in a situation where some (non-zero) parts of the sought signal are known. Although our method does not assume that the known part…

Optics · Physics 2012-03-06 Eliyahu Osherovich , Michael Zibulevsky , Irad Yavneh

We develop a nonparametric approach to identify and estimate consumer preferences and unobserved heterogeneity under nonlinear price schedules. Leveraging variation across multiple price schedules, we show that both the utility function and…

Econometrics · Economics 2026-04-29 Samuele Centorrino , Frédérique Fève , Jean-Pierre Florens

Modern data sets, such as those in healthcare and e-commerce, are often derived from many individuals or systems but have insufficient data from each source alone to separately estimate individual, often high-dimensional, model parameters.…

Machine Learning · Computer Science 2024-11-14 Maryann Rui , Thibaut Horel , Munther Dahleh

Nonlinear dynamical systems are ubiquitous in nature and they are hard to forecast. Not only they may be sensitive to small perturbations in their initial conditions, but they are often composed of processes acting at multiple scales.…

Chaotic Dynamics · Physics 2025-10-06 Chenyu Dong , Davide Faranda , Adriano Gualandi , Valerio Lucarini , Gianmarco Mengaldo

This paper re-examines the problem of parameter estimation in Bayesian networks with missing values and hidden variables from the perspective of recent work in on-line learning [Kivinen & Warmuth, 1994]. We provide a unified framework for…

Machine Learning · Computer Science 2013-02-08 Eric Bauer , Daphne Koller , Yoram Singer

We study parameter estimation in Nonlinear Factor Analysis (NFA) where the generative model is parameterized by a deep neural network. Recent work has focused on learning such models using inference (or recognition) networks; we identify a…

Machine Learning · Statistics 2017-10-18 Rahul G. Krishnan , Dawen Liang , Matthew Hoffman

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

Estimating the parameters of a probabilistic directed graphical model from incomplete data is a long-standing challenge. This is because, in the presence of latent variables, both the likelihood function and posterior distribution are…

Machine Learning · Computer Science 2024-06-04 Vy Vo , Trung Le , Tung-Long Vuong , He Zhao , Edwin Bonilla , Dinh Phung

A new adaptive observer is proposed for a certain class of nonlinear systems with bounded unknown input and parametric uncertainty. Unlike most existing solutions, the proposed approach ensures asymptotic convergence of the unknown…

Systems and Control · Electrical Eng. & Systems 2024-03-21 Anton Glushchenko , Konstantin Lastochkin

Many dynamical processes of complex systems can be understood as the dynamics of a group of nodes interacting on a given network structure. However, finding such interaction structure and node dynamics from time series of node behaviours is…

Physics and Society · Physics 2022-06-28 Yan Zhang , Yu Guo , Zhang Zhang , Mengyuan Chen , Shuo Wang , Jiang Zhang

In this work, we investigate the fundamental trade-off regarding accuracy and parameter efficiency in the parameterization of neural network weights using predictor networks. We present a surprising finding that, when recovering the…

Machine Learning · Computer Science 2024-07-02 Hongjun Choi , Jayaraman J. Thiagarajan , Ruben Glatt , Shusen Liu

We consider the task of learning a dynamical system from high-dimensional time-course data. For instance, we might wish to estimate a gene regulatory network from gene expression data measured at discrete time points. We model the dynamical…

Methodology · Statistics 2016-10-12 Shizhe Chen , Ali Shojaie , Daniela M. Witten

Inverse problems are prevalent in numerous scientific and engineering disciplines, where the objective is to determine unknown parameters within a physical system using indirect measurements or observations. The inherent challenge lies in…

Computational Physics · Physics 2025-02-06 Georgios E. Pavlou , Vasiliki Pavlidou , Vagelis Harmandaris

Iterative optimization algorithms depend on access to information about the objective function. In a differentiable programming framework, this information, such as gradients, can be automatically derived from the computational graph. We…

Optimization and Control · Mathematics 2025-07-08 Vincent Roulet , Siddhartha Srinivasa , Maryam Fazel , Zaid Harchaoui

We consider the problem of learning the parameters of a $N$-dimensional stochastic linear dynamics under both full and partial observations from a single trajectory of time $T$. We introduce and analyze a new estimator that achieves a small…

Machine Learning · Statistics 2025-12-08 Minh Vu , Andrey Y. Lokhov , Marc Vuffray

An important problem of optimization analysis surges when parameters such as $ \{\theta_j\}_{j=1,\, \dots \,,k }$, determining a function $ y=f(x\given\{\theta_j\}) $, must be estimated from a set of observables $ \{ x_i,y_i\}_{i=1,\, \dots…

Methodology · Statistics 2021-06-22 Carlos Sevcik

Nonlinearity parameter tomography leads to the problem of identifying a coefficient in a nonlinear wave equation (such as the Westervelt equation) modeling ultrasound propagation. In this paper we transfer this into frequency domain, where…

Numerical Analysis · Mathematics 2023-03-31 Barbara Kaltenbacher , William Rundell

We consider a network of sensors deployed to sense a spatio-temporal field and estimate a parameter of interest. We are interested in the case where the temporal process sensed by each sensor can be modeled as a state-space process that is…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-04-12 S. Sundhar Ram , V. V. Veeravalli , A. Nedic

The identification of states and parameters from noisy measurements of a dynamical system is of great practical significance and has received a lot of attention. Classically, this problem is expressed as optimization over a class of models.…