English
Related papers

Related papers: A Machine Learning Framework for Computing the Mos…

200 papers

For a model nonlinear dynamical system, we show how one may obtain its bifurcation behavior by introducing noise into the dynamics and then studying the resulting Langevin dynamics in the weak-noise limit. A suitable quantity to capture the…

Adaptation and Self-Organizing Systems · Physics 2019-02-06 Debraj Das , Sayan Roy , Shamik Gupta

This paper considers the problem of closed-loop identification of linear scalar systems with Gaussian process noise, where the system input is determined by a deterministic state feedback policy. The regularized least-square estimate (LSE)…

Systems and Control · Electrical Eng. & Systems 2020-03-30 Ali Reza Pedram , Takashi Tanaka

Time-varying linear state-space models are powerful tools for obtaining mathematically interpretable representations of neural signals. For example, switching and decomposed models describe complex systems using latent variables that evolve…

This paper proposes a general switching dynamical system model, and a custom majorization-minimization-based algorithm EM++ for identifying its parameters. For certain families of distributions, such as Gaussian distributions, this…

Optimization and Control · Mathematics 2025-12-30 Renzi Wang , Alexander Bodard , Mathijs Schuurmans , Panagiotis Patrinos

We address the role of noise and the issue of efficient computation in stochastic optimal control problems. We consider a class of non-linear control problems that can be formulated as a path integral and where the noise plays the role of…

Computational Physics · Physics 2009-11-10 H. J. Kappen

This paper presents a machine learning framework for Bayesian systems identification from noisy, sparse and irregular observations of nonlinear dynamical systems. The proposed method takes advantage of recent developments in differentiable…

Machine Learning · Computer Science 2020-04-21 Yibo Yang , Mohamed Aziz Bhouri , Paris Perdikaris

This paper introduces a novel methodology for the identification of switching dynamics for switched autoregressive linear models. Switching behavior is assumed to follow a Markov model. The system's outputs are contaminated by possibly…

Signal Processing · Electrical Eng. & Systems 2019-03-28 Sarah Hojjatinia , Constantino M. Lagoa

Trajectory prediction of aerial vehicles is a key requirement in applications ranging from missile guidance to UAV collision avoidance. While most prediction methods assume deterministic target motion, real-world targets often exhibit…

Robotics · Computer Science 2025-12-19 Marc Schneider , Renato Loureiro , Torbjørn Cunis , Walter Fichter

A linear Gaussian state-space smoothing algorithm is presented for estimation of derivatives from a sequence of noisy measurements. The algorithm uses numerically stable square-root formulas, can handle simultaneous independent measurements…

Methodology · Statistics 2016-10-17 Robert Piche

Noise-assisted transport phenomena highlight the nontrivial interplay between environmental effects and quantum coherence in achieving maximal efficiency. Due to the complexity of biochemical systems and their environments, effective open…

We study inference and reconstruction of couplings in a partially observed kinetic Ising model. With hidden spins, calculating the likelihood of a sequence of observed spin configurations requires performing a trace over the configurations…

Disordered Systems and Neural Networks · Physics 2021-04-13 Benjamin Dunn , Yasser Roudi

A central challenge in physics is to describe non-equilibrium systems driven by randomness, such as a randomly growing interface, or fluids subject to random fluctuations that account e.g. for local stresses and heat fluxes not related to…

Analysis of PDEs · Mathematics 2022-02-16 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams , Shouhong Wang

For sampling multiple pathways in a rugged energy landscape, we propose a novel action-based path sampling method using the Onsager-Machlup action functional. Inspired by the Fourier-path integral simulation of a quantum mechanical system,…

Biological Physics · Physics 2015-05-18 Hiroshi Fujisaki , Motoyuki Shiga , Akinori Kidera

The prevalence of variational methods in near-term quantum computing makes optimizer choice critical, yet selection is frequently intuition-based. We therefore present a systematic benchmark of eight classical optimization algorithms for…

Quantum Physics · Physics 2026-01-23 S. Illésová , V. Novák , T. Bezděk , C. Possel , M. Beseda

In simulations of multiscale dynamical systems, not all relevant processes can be resolved explicitly. Taking the effect of the unresolved processes into account is important, which introduces the need for paramerizations. We present a…

Numerical Analysis · Mathematics 2021-04-14 Daan Crommelin , Wouter Edeling

We propose a novel gradient-based online optimization framework for solving stochastic programming problems that frequently arise in the context of cyber-physical and robotic systems. Our problem formulation accommodates constraints that…

Machine Learning · Computer Science 2026-01-06 Hao Ma , Melanie Zeilinger , Michael Muehlebach

Given a visual history, multiple future outcomes for a video scene are equally probable, in other words, the distribution of future outcomes has multiple modes. Multimodality is notoriously hard to handle by standard regressors or…

Computer Vision and Pattern Recognition · Computer Science 2017-05-08 Katerina Fragkiadaki , Jonathan Huang , Alex Alemi , Sudheendra Vijayanarasimhan , Susanna Ricco , Rahul Sukthankar

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

Many recent generative models make use of neural networks to transform the probability distribution of a simple low-dimensional noise process into the complex distribution of the data. This raises the question of whether biological networks…

Neural and Evolutionary Computing · Computer Science 2018-02-07 Hesham Mostafa , Gert Cauwenberghs

Gradient normalization and soft clipping are two popular techniques for tackling instability issues and improving convergence of stochastic gradient descent (SGD) with momentum. In this article, we study these types of methods through the…

Optimization and Control · Mathematics 2025-07-01 Måns Williamson , Tony Stillfjord