English
Related papers

Related papers: Differentiable Factor Graph Optimization for Learn…

200 papers

State-space models are successfully used in many areas of science, engineering and economics to model time series and dynamical systems. We present a fully Bayesian approach to inference \emph{and learning} (i.e. state estimation and system…

Machine Learning · Statistics 2013-12-18 Roger Frigola , Fredrik Lindsten , Thomas B. Schön , Carl E. Rasmussen

End-to-end optimization, which simultaneously optimizes optics and algorithms, has emerged as a powerful data-driven method for computational imaging system design. This method achieves joint optimization through backpropagation by…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Chi-Jui Ho , Yash Belhe , Steve Rotenberg , Ravi Ramamoorthi , Tzu-Mao Li , Nicholas Antipa

Many graph algorithms can be viewed as sets of rules that are iteratively applied, with the number of iterations dependent on the size and complexity of the input graph. Existing machine learning architectures often struggle to represent…

Artificial Intelligence · Computer Science 2024-08-21 Florian Grötschla , Joël Mathys , Christoffer Raun , Roger Wattenhofer

Real-world optimization problems are generally not just black-box problems, but also involve mixed types of inputs in which discrete and continuous variables coexist. Such mixed-space optimization possesses the primary challenge of modeling…

Machine Learning · Computer Science 2022-02-09 Jaeyeon Ahn , Taehyeon Kim , Seyoung Yun

Smoothing algorithms for state-space models, i.e., fixed-interval smoothing, fixed-lag smoothing, and two-filter formula for smoothing, are examined using real examples. For linear and Gaussian state-space models, it is observed that…

Computation · Statistics 2023-07-10 G. Kitagawa

This paper presents a fast algorithm for estimating hidden states of Bayesian state space models. The algorithm is a variation of amortized simulation-based inference algorithms, where a large number of artificial datasets are generated at…

Econometrics · Economics 2022-10-14 Ramis Khabibullin , Sergei Seleznev

In this work, we propose an end-to-end graph network that learns forward and inverse models of particle-based physics using interpretable inductive biases. Physics-informed neural networks are often engineered to solve specific problems…

Machine Learning · Computer Science 2022-02-01 Sakthi Kumar Arul Prakash , Conrad Tucker

"Particle methods" are sequential Monte Carlo algorithms, typically involving importance sampling, that are used to estimate and sample from joint and marginal densities from a collection of a, presumably increasing, number of random…

Computation · Statistics 2014-07-17 J. N. Corcoran , D. Jennings

In this paper we develop a statistical theory and an implementation of deep learning models. We show that an elegant variable splitting scheme for the alternating direction method of multipliers optimises a deep learning objective. We allow…

Machine Learning · Statistics 2015-09-22 Nicholas G. Polson , Brandon T. Willard , Massoud Heidari

We consider the problem of learning a graph from a finite set of noisy graph signal observations, the goal of which is to find a smooth representation of the graph signal. Such a problem is motivated by the desire to infer relational…

Machine Learning · Computer Science 2023-02-08 Xiaolu Wang , Yuen-Man Pun , Anthony Man-Cho So

The analysis of high-dimensional dynamical systems generally requires the integration of simulation data with experimental measurements. Experimental data often has substantial amounts of measurement noise that compromises the ability to…

Numerical Analysis · Mathematics 2019-10-02 Samuel Rudy , Steven Brunton , J. Nathan Kutz

This work studies networked agents cooperating to track a dynamical state of nature under partial information. The proposed algorithm is a distributed Bayesian filtering algorithm for finite-state hidden Markov models (HMMs). It can be used…

Signal Processing · Electrical Eng. & Systems 2022-12-07 Mert Kayaalp , Virginia Bordignon , Stefan Vlaski , Vincenzo Matta , Ali H. Sayed

Resampling is a key component of sample-based recursive state estimation in particle filters. Recent work explores differentiable particle filters for end-to-end learning. However, resampling remains a challenge in these works, as it is…

Machine Learning · Computer Science 2020-04-28 Michael Zhu , Kevin Murphy , Rico Jonschkowski

Data assimilation (DA) has increasingly emerged as a critical tool for state estimation across a wide range of applications. It is significantly challenging when the governing equations of the underlying dynamics are unknown. To this end,…

Machine Learning · Computer Science 2026-01-13 Ziyi Wang , Lijian Jiang

Bayesian filtering is a well-known problem that aims to estimate plausible states of a dynamical system from observations. Among existing approaches to solve this problem, particle filters are theoretically exact for non-linear dynamics and…

Machine Learning · Computer Science 2026-05-20 Thomas Savary , François Rozet , Gilles Louppe

Probabilistic (or Bayesian) modeling and learning offers interesting possibilities for systematic representation of uncertainty using probability theory. However, probabilistic learning often leads to computationally challenging problems.…

Computation · Statistics 2018-03-14 Andreas Svensson , Thomas B. Schön , Fredrik Lindsten

In this manuscript the fixed-lag smoothing problem for conditionally linear Gaussian state-space models is investigated from a factor graph perspective. More specifically, after formulating Bayesian smoothing for an arbitrary state-space…

Computation · Statistics 2017-05-23 Giorgio M. Vitetta , Emilio Sirignano , Francesco Montorsi

We introduce an approach for imposing physically informed inductive biases in learned simulation models. We combine graph networks with a differentiable ordinary differential equation integrator as a mechanism for predicting future states,…

Machine Learning · Computer Science 2019-09-30 Alvaro Sanchez-Gonzalez , Victor Bapst , Kyle Cranmer , Peter Battaglia

General Probabilistic Theories provide the most general mathematical framework for the theory of probability in an operationally natural manner, and generalize classical and quantum theories. In this article, we study state-discrimination…

Quantum Physics · Physics 2010-09-15 Koji Nuida , Gen Kimura , Takayuki Miyadera

Accurate estimation of the states of a nonlinear dynamical system is crucial for their design, synthesis, and analysis. Particle filters are estimators constructed by simulating trajectories from a sampling distribution and averaging them…

Signal Processing · Electrical Eng. & Systems 2023-02-03 Fernando Gama , Nicolas Zilberstein , Martin Sevilla , Richard Baraniuk , Santiago Segarra