English
Related papers

Related papers: Parameter Estimation of Sigmoid Superpositions: Dy…

200 papers

This paper explores learning emulators for parameter estimation with uncertainty estimation of high-dimensional dynamical systems. We assume access to a computationally complex simulator that inputs a candidate parameter and outputs a…

Machine Learning · Computer Science 2022-11-04 Ruoxi Jiang , Rebecca Willett

A successful approach to structured learning is to write the learning objective as a joint function of linear parameters and inference messages, and iterate between updates to each. This paper observes that if the inference problem is…

Machine Learning · Computer Science 2014-07-04 Justin Domke

The $Q$-learning algorithm is a simple and widely-used stochastic approximation scheme for reinforcement learning, but the basic protocol can exhibit instability in conjunction with function approximation. Such instability can be observed…

Machine Learning · Computer Science 2022-06-03 Andrea Zanette , Martin J. Wainwright

We propose a new methodology for parameterized constrained robust optimization, an important class of optimization problems under uncertainty, based on learning with a self-supervised penalty-based loss function. Whereas supervised learning…

Optimization and Control · Mathematics 2025-03-10 Wyame Benslimane , Paul Grigas

How many parameters are required for a model to execute a given task? It has been argued that large language models, pre-trained via self-supervised learning, exhibit emergent capabilities such as multi-step reasoning as their number of…

Machine Learning · Computer Science 2024-09-23 Ingvar Ziemann , Nikolai Matni , George J. Pappas

Probabilistic mixture models have been widely used for different machine learning and pattern recognition tasks such as clustering, dimensionality reduction, and classification. In this paper, we focus on trying to solve the most common…

Machine Learning · Computer Science 2020-04-08 Gustavo A Valencia-Zapata , Daniel Mejia , Gerhard Klimeck , Michael Zentner , Okan Ersoy

We propose a learning-based approach for estimating the spectrum of a multisinusoidal signal from a finite number of samples. A neural-network is trained to approximate the spectra of such signals on simulated data. The proposed methodology…

Machine Learning · Computer Science 2019-06-03 Gautier Izacard , Brett Bernstein , Carlos Fernandez-Granda

This paper presents a novel set-based computing method, called interval superposition arithmetic, for enclosing the image set of multivariate factorable functions on a given domain. In order to construct such enclosures, the proposed…

Numerical Analysis · Mathematics 2018-02-14 Yanlin Zha , Mario E. Villanueva , Boris Houska

Learning governing equations from a family of data sets which share the same physical laws but differ in bifurcation parameters is challenging. This is due, in part, to the wide range of phenomena that could be represented in the data sets…

Numerical Analysis · Mathematics 2017-09-07 Hayden Schaeffer , Giang Tran , Rachel Ward

We investigate a new structure for machine learning classifiers applied to problems in high-energy physics by expanding the inputs to include not only measured features but also physics parameters. The physics parameters represent a…

High Energy Physics - Experiment · Physics 2016-05-25 Pierre Baldi , Kyle Cranmer , Taylor Faucett , Peter Sadowski , Daniel Whiteson

We present a complexity reduction algorithm for a family of parameter-dependent linear systems when the system parameters belong to a compact semi-algebraic set. This algorithm potentially describes the underlying dynamical system with…

Systems and Control · Computer Science 2012-09-25 Farhad Farokhi , Henrik Sandberg , Karl H. Johansson

We consider a dynamic method, based on synchronization and adaptive control, to estimate unknown parameters of a nonlinear dynamical system from a given scalar chaotic time series. We present an important extension of the method when time…

Chaotic Dynamics · Physics 2009-10-31 Anil Maybhate , R. E. Amritkar

Finite-time coherent sets represent minimally mixing objects in general nonlinear dynamics, and are spatially mobile features that are the most predictable in the medium term. When the dynamical system is subjected to small parameter…

Dynamical Systems · Mathematics 2021-04-14 Fadi Antown , Gary Froyland , Oliver Junge

We develop a new approach to learn the parameters of regression models with hidden variables. In a nutshell, we estimate the gradient of the regression function at a set of random points, and cluster the estimated gradients. The centers of…

Machine Learning · Statistics 2018-01-18 Stratis Ioannidis , Andrea Montanari

Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data…

Probability · Mathematics 2021-04-13 Suryadeepto Nag

A singularly perturbed linear system of second order partial differential equations of parabolic reaction-diffusion type with given initial and boundary conditions is considered. The leading term of each equation is multiplied by a small…

Numerical Analysis · Mathematics 2010-08-17 V. Franklin , M. Paramasivam , S. Valarmathi , J. J. H. Miller

Linear time-invariant systems are very popular models in system theory and applications. A fundamental problem in system identification that remains rather unaddressed in extant literature is to leverage commonalities amongst related linear…

Machine Learning · Statistics 2024-01-03 Aditya Modi , Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

We propose and analyze a regularization approach for structured prediction problems. We characterize a large class of loss functions that allows to naturally embed structured outputs in a linear space. We exploit this fact to design…

Machine Learning · Computer Science 2017-07-31 Carlo Ciliberto , Alessandro Rudi , Lorenzo Rosasco

Various versions of the Dynamical Systems Method (DSM) are proposed for solving linear ill-posed problems with bounded and unbounded operators. Convergence of the proposed methods is proved. Some new results concerning discrepancy principle…

Numerical Analysis · Mathematics 2007-05-23 A. G. Ramm

We propose a probabilistic semantic filtering framework in which parameters of a dynamical system are inferred and associated with a closed set of semantic classes in a map. We extend existing methods to a multi-parameter setting using a…

Systems and Control · Electrical Eng. & Systems 2026-01-15 Marcus Greiff , Ray Zhang , Thomas Lew , John Subosits