English
Related papers

Related papers: Weak Convergence Analysis of Online Neural Actor-C…

200 papers

In this work we present a fast, globally convergent, iterative algorithm for computing the asymptotically stable states of nonlinear large--scale systems of quadratic autonomous Ordinary Differential Equations (ODEs) modeling, e.g., the…

Numerical Analysis · Mathematics 2023-01-02 Silvia Berra , Alessandro La Torraca , Federico Benvenuto , Sara Sommariva

We present analytical results for the structural evolution of random networks undergoing contraction processes via generic node deletion scenarios, namely, random deletion, preferential deletion and propagating deletion. Focusing on…

Physics and Society · Physics 2020-09-10 I. Tishby , O. Biham , E. Katzav

We study robust mean estimation in an online and distributed scenario in the presence of adversarial data attacks. At each time step, each agent in a network receives a potentially corrupted data point, where the data points were originally…

Cryptography and Security · Computer Science 2022-09-21 Tong Yao , Shreyas Sundaram

This paper approaches the unsupervised learning problem by gradient descent in the space of probability density functions. A main result shows that along the gradient flow induced by a distribution-dependent ordinary differential equation…

Machine Learning · Computer Science 2024-01-09 Yu-Jui Huang , Yuchong Zhang

We study an edge-weighted online stochastic \emph{Generalized Assignment Problem} with \emph{unknown} Poisson arrivals. In this model, we consider a bipartite graph that contains offline bins and online items, where each offline bin is…

Computer Science and Game Theory · Computer Science 2023-05-25 Zihao Li , Hao Wang , Zhenzhen Yan

We present the first provably convergent two-timescale off-policy actor-critic algorithm (COF-PAC) with function approximation. Key to COF-PAC is the introduction of a new critic, the emphasis critic, which is trained via Gradient Emphasis…

Machine Learning · Computer Science 2020-11-25 Shangtong Zhang , Bo Liu , Hengshuai Yao , Shimon Whiteson

The oscillating performance of off-policy learning and persisting errors in the actor-critic (AC) setting call for algorithms that can conservatively learn to suit the stability-critical applications better. In this paper, we propose a…

Machine Learning · Computer Science 2021-10-06 Lingwei Zhu , Toshinori Kitamura , Takamitsu Matsubara

We establish an optimal sample complexity of $O(\epsilon^{-2})$ for obtaining an $\epsilon$-optimal global policy using a single-timescale actor-critic (AC) algorithm in infinite-horizon discounted Markov decision processes (MDPs) with…

Machine Learning · Computer Science 2026-05-08 Navdeep Kumar , Tehila Dahan , Lior Cohen , Ananyabrata Barua , Giorgia Ramponi , Kfir Yehuda Levy , Shie Mannor

Sequential change-point detection when the distribution parameters are unknown is a fundamental problem in statistics and machine learning. When the post-change parameters are unknown, we consider a set of detection procedures based on…

Statistics Theory · Mathematics 2017-12-06 Yang Cao , Liyan Xie , Yao Xie , Huan Xu

We generalize the technique of smoothed analysis to distributed algorithms in dynamic network models. Whereas standard smoothed analysis studies the impact of small random perturbations of input values on algorithm performance metrics,…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-08-17 Michael Dinitz , Jeremy T. Fineman , Seth Gilbert , Calvin Newport

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in…

Multiagent Systems · Computer Science 2020-04-22 Roula Nassif , Stefan Vlaski , Ali H. Sayed

We consider prediction with expert advice when the loss vectors are assumed to lie in a set described by the sum of atomic norm balls. We derive a regret bound for a general version of the online mirror descent (OMD) algorithm that uses a…

Machine Learning · Computer Science 2017-11-15 Siddharth Barman , Aditya Gopalan , Aadirupa Saha

Optimizing over the stationary distribution of stochastic differential equations (SDEs) is computationally challenging. A new forward propagation algorithm has been recently proposed for the online optimization of SDEs. The algorithm solves…

Probability · Mathematics 2022-07-12 Ziheng Wang , Justin Sirignano

The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution moreover correlates with a model's epistemic uncertainty,…

Machine Learning · Computer Science 2021-02-24 Janis Postels , Hermann Blum , Yannick Strümpler , Cesar Cadena , Roland Siegwart , Luc Van Gool , Federico Tombari

We study the problem of private online learning, specifically, online prediction from experts (OPE) and online convex optimization (OCO). We propose a new transformation that transforms lazy online learning algorithms into private…

Machine Learning · Computer Science 2025-02-25 Hilal Asi , Tomer Koren , Daogao Liu , Kunal Talwar

For those seeking healthcare advice online, AI based dialogue agents capable of interacting with patients to perform automatic disease diagnosis are a viable option. This application necessitates efficient inquiry of relevant disease…

Machine Learning · Computer Science 2022-06-09 Weijie He , Ting Chen

We study the uniform-in-time weak propagation of chaos for the consensus-based optimization (CBO) method on a bounded searching domain. We apply the methodology for studying long-time behaviors of interacting particle systems developed in…

Optimization and Control · Mathematics 2025-02-04 Erhan Bayraktar , Ibrahim Ekren , Hongyi Zhou

In this paper, we present a probability one convergence proof, under suitable conditions, of a certain class of actor-critic algorithms for finding approximate solutions to entropy-regularized MDPs using the machinery of stochastic…

Machine Learning · Computer Science 2019-10-23 Wesley Suttle , Zhuoran Yang , Kaiqing Zhang , Ji Liu

Quantum computing has a superior advantage in tackling specific problems, such as integer factorization and Simon's problem. For more general tasks in machine learning, by applying variational quantum circuits, more and more quantum…

Quantum Physics · Physics 2021-12-23 Qingfeng Lan

Operator learning has emerged as a promising paradigm for developing efficient surrogate models to solve partial differential equations (PDEs). However, existing approaches often overlook the domain knowledge inherent in the underlying PDEs…

Machine Learning · Computer Science 2025-10-20 Ziqian Li , Kang Liu , Yongcun Song , Hangrui Yue , Enrique Zuazua