English
Related papers

Related papers: Optimal sampling of dynamical large deviations via…

200 papers

The incidence of rare events in fast-slow systems is investigated via analysis of the large deviation principle (LDP) that characterizes the likelihood and pathway of large fluctuations of the slow variables away from their mean behavior --…

Statistical Mechanics · Physics 2016-02-17 Freddy Bouchet , Tobias Grafke , Tomás Tangarife , Eric Vanden-Eijnden

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

We investigate the problem of best-policy identification in discounted Markov Decision Processes (MDPs) when the learner has access to a generative model. The objective is to devise a learning algorithm returning the best policy as early as…

Machine Learning · Statistics 2021-05-11 Aymen Al Marjani , Alexandre Proutiere

Determinantal Point Processes (DPPs) are elegant probabilistic models of repulsion and diversity over discrete sets of items. But their applicability to large sets is hindered by expensive cubic-complexity matrix operations for basic tasks…

Machine Learning · Computer Science 2016-05-31 Chengtao Li , Stefanie Jegelka , Suvrit Sra

One-dimensional run-and-tumble processes may converge towards some localized non-equilibrium steady state when the two velocities and/or the two switching rates are space-dependent. A long dynamical trajectory can be then analyzed via the…

Statistical Mechanics · Physics 2021-08-23 Cecile Monthus

Recent work has suggested using Monte Carlo methods based on piecewise deterministic Markov processes (PDMPs) to sample from target distributions of interest. PDMPs are non-reversible continuous-time processes endowed with momentum, and…

Machine Learning · Statistics 2024-06-28 Paul Fearnhead , Sebastiano Grazzi , Chris Nemeth , Gareth O. Roberts

This work explores a novel perspective on solving nonconvex and nonsmooth optimization problems by leveraging sampling based methods. Instead of treating the objective function purely through traditional (often deterministic) optimization…

Optimization and Control · Mathematics 2025-05-21 Nahom Seyoum , Haoxiang You

Many complex systems can be reduced to their key components through spectrally decomposing matrices that capture their dynamics. These matrices can in turn be constructed from data, often by least-squares fitting: examples of algorithms to…

Numerical Analysis · Mathematics 2026-05-18 Caroline Wormell

Low-tubal-rank tensor approximation has been proposed to analyze large-scale and multi-dimensional data. However, finding such an accurate approximation is challenging in the streaming setting, due to the limited computational resources. To…

Machine Learning · Computer Science 2021-08-24 Qianxin Yi , Chenhao Wang , Kaidong Wang , Yao Wang

This paper presents a novel probabilistic approach to deep robot learning from demonstrations (LfD). Deep movement primitives (DMPs) are deterministic LfD model that maps visual information directly into a robot trajectory. This paper…

Robotics · Computer Science 2022-08-22 Alessandra Tafuro , Bappaditya Debnath , Andrea M. Zanchettin , Amir Ghalamzan E

In this work, we develop a stochastic matrix product state (stoMPS) approach that combines the MPS technique and Monte Carlo samplings and can be applied to simulate quantum lattice models down to low temperature. In particular, we exploit…

Strongly Correlated Electrons · Physics 2023-12-08 Jianxin Gao , Yuan Gao , Qiaoyi Li , Wei Li

We propose a method for the accurate estimation of rare event or failure probabilities for expensive-to-evaluate numerical models in high dimensions. The proposed approach combines ideas from large deviation theory and adaptive importance…

Computation · Statistics 2023-03-28 Shanyin Tong , Georg Stadler

Low-rank approximation of tensors has been widely used in high-dimensional data analysis. It usually involves singular value decomposition (SVD) of large-scale matrices with high computational complexity. Sketching is an effective data…

Numerical Analysis · Mathematics 2023-01-30 Wandi Dong , Gaohang Yu , Liqun Qi , Xiaohao Cai

The Dynamic Mode Decomposition (DMD) extracted dynamic modes are the non-orthogonal eigenvectors of the matrix that best approximates the one-step temporal evolution of the multivariate samples. In the context of dynamical system analysis,…

Statistics Theory · Mathematics 2020-03-09 Arvind Prasadan , Raj Rao Nadakuditi

We propose to model the records of the maximum Drawdown in capital markets by means a Piecewise Deterministic Markov Process (PDMP). We derive statistical results such as the mean and variance that describes the sequence of maximum Drawdown…

Risk Management · Quantitative Finance 2025-04-01 Rolando Rubilar-Torrealba , Lisandro Fermin , Soledad Torres

Dynamic Mode Decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of non-linear systems from experimental datasets. Recently, several attempts have extended DMD to the context of low-rank approximations. This…

Machine Learning · Statistics 2018-05-18 Patrick Héas , Cédric Herzet

We propose a computational method for large deviation statistics of time-averaged quantities in general Markov processes. In our proposed method, we repeat a response measurement against external forces, where the forces are determined by…

Statistical Mechanics · Physics 2014-03-12 Takahiro Nemoto , Shin-ichi Sasa

Determinantal point processes (DPPs) are random point processes well-suited for modeling repulsion. In machine learning, the focus of DPP-based models has been on diverse subset selection from a discrete and finite base set. This discrete…

Machine Learning · Statistics 2013-11-14 Raja Hafiz Affandi , Emily B. Fox , Ben Taskar

We prove large deviation principles (LDPs) for random matrices in the orthogonal group and Stiefel manifold, determining both the speed and good convex rate functions that are explicitly given in terms of certain log-determinants of…

Probability · Mathematics 2022-11-04 Zakhar Kabluchko , Joscha Prochno

This work studies the linear approximation of high-dimensional dynamical systems using low-rank dynamic mode decomposition (DMD). Searching this approximation in a data-driven approach is formalised as attempting to solve a low-rank…

Machine Learning · Statistics 2021-08-23 Patrick Héas , Cédric Herzet