English
Related papers

Related papers: Optimal sampling of dynamical large deviations via…

200 papers

An efficient representation of observed data has many benefits in various domains of engineering and science. Representing static data sets, such as images, is a living branch in machine learning and eases downstream tasks, such as…

Systems and Control · Computer Science 2018-09-28 Friedrich Solowjow , Arash Mehrjou , Bernhard Schölkopf , Sebastian Trimpe

Learning a dynamical system from input/output data is a fundamental task in the control design pipeline. In the partially observed setting there are two components to identification: parameter estimation to learn the Markov parameters, and…

Optimization and Control · Mathematics 2021-09-08 Han Wang , James Anderson

Stochastic Gradient (SG) Markov Chain Monte Carlo algorithms (MCMC) are popular algorithms for Bayesian sampling in the presence of large datasets. However, they come with little theoretical guarantees and assessing their empirical…

Machine Learning · Statistics 2024-05-16 Lorenzo Mauri , Giacomo Zanella

We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set. These encompass a range of well-known models in machine learning, such as determinantal point processes and…

Machine Learning · Computer Science 2018-07-10 Alkis Gotovos , Hamed Hassani , Andreas Krause , Stefanie Jegelka

In this paper, we investigate the limiting empirical spectral distribution (LSD) of sums of independent rank-one $k$-fold tensor products of $n$-dimensional vectors as $k,n \to \infty$. Assuming that the base vectors are complex random…

Probability · Mathematics 2024-01-09 Wangjun Yuan

The efficient calculation of rare-event kinetics in complex dynamical systems, such as the rate and pathways of ligand dissociation from a protein, is a generally unsolved problem. Markov state models can systematically integrate ensembles…

Chemical Physics · Physics 2016-02-03 Benjamin Trendelkamp-Schroer , Frank Noe

Maximum entropy models provide the least constrained probability distributions that reproduce statistical properties of experimental datasets. In this work we characterize the learning dynamics that maximizes the log-likelihood in the case…

Disordered Systems and Neural Networks · Physics 2016-09-21 Ulisse Ferrari

Stochastic gradients have been widely integrated into Langevin-based methods to improve their scalability and efficiency in solving large-scale sampling problems. However, the proximal sampler, which exhibits much faster convergence than…

Machine Learning · Statistics 2024-05-28 Xunpeng Huang , Difan Zou , Yi-An Ma , Hanze Dong , Tong Zhang

We propose discrete Langevin proposal (DLP), a simple and scalable gradient-based proposal for sampling complex high-dimensional discrete distributions. In contrast to Gibbs sampling-based methods, DLP is able to update all coordinates in…

Machine Learning · Computer Science 2022-06-22 Ruqi Zhang , Xingchao Liu , Qiang Liu

An introduction to numerical large-deviation sampling is provided. First, direct biasing with a known distribution is explained. As simple example, the Bernoulli experiment is used throughout the text. Next, Markov chain Monte Carlo (MCMC)…

Computational Physics · Physics 2025-10-01 Alexander K. Hartmann

Determinantal point processes (DPPs) have become a significant tool for recommendation systems, feature selection, or summary extraction, harnessing the intrinsic ability of these probabilistic models to facilitate sample diversity. The…

Machine Learning · Statistics 2020-07-09 Rémi Bardenet , Subhroshekhar Ghosh

We propose a general and scalable approximate sampling strategy for probabilistic models with discrete variables. Our approach uses gradients of the likelihood function with respect to its discrete inputs to propose updates in a…

Machine Learning · Computer Science 2021-06-08 Will Grathwohl , Kevin Swersky , Milad Hashemi , David Duvenaud , Chris J. Maddison

We have shown recently that a Markov process conditioned on rare events involving time-integrated random variables can be described in the long-time limit by an effective Markov process, called the driven process, which is given…

Statistical Mechanics · Physics 2015-12-17 Raphael Chetrite , Hugo Touchette

A framework is proposed to generate a phenomenological model that extracts the essence of a dynamical system (DS) with large degrees of freedom using machine learning. For a given microscopic DS, the optimum transformation to a small number…

Statistical Mechanics · Physics 2023-12-20 Tomoaki Nogawa

Projected entangled pair states (PEPS) on finite two-dimensional lattices are a natural ansatz for representing ground states of local many-body Hamiltonians, as they inherently satisfy the boundary law of entanglement entropy. In this…

Strongly Correlated Electrons · Physics 2025-05-14 Daniel Alcalde Puente , Erik Lennart Weerda , Konrad Schröder , Matteo Rizzi

This paper introduces matrix product state (MPS) decomposition as a computational tool for extracting features of multidimensional data represented by higher-order tensors. Regardless of tensor order, MPS extracts its relevant features to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-22 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

This paper addresses the problem of planning under uncertainty in large Markov Decision Processes (MDPs). Factored MDPs represent a complex state space using state variables and the transition model using a dynamic Bayesian network. This…

Artificial Intelligence · Computer Science 2011-06-10 C. Guestrin , D. Koller , R. Parr , S. Venkataraman

Piecewise-Deterministic Markov Processes (PDMPs) hold significant promise for sampling from complex probability distributions. However, their practical implementation is hindered by the need to compute model-specific bounds. Conversely,…

Computation · Statistics 2025-03-17 Augustin Chevallier , Sam Power , Matthew Sutton

The curse of dimensionality is a widely known issue in reinforcement learning (RL). In the tabular setting where the state space $\mathcal{S}$ and the action space $\mathcal{A}$ are both finite, to obtain a nearly optimal policy with…

Machine Learning · Computer Science 2022-10-28 Bingyan Wang , Yuling Yan , Jianqing Fan

We study the problem of learning mixtures of linear dynamical systems (MLDS) from input-output data. The mixture setting allows us to leverage observations from related dynamical systems to improve the estimation of individual models.…

Systems and Control · Electrical Eng. & Systems 2025-06-03 Maryann Rui , Munther Dahleh