English
Related papers

Related papers: Gradient-based parameter calibration of an anisotr…

200 papers

Gradient descent is the primary workhorse for optimizing large-scale problems in machine learning. However, its performance is highly sensitive to the choice of the learning rate. A key limitation of gradient descent is its lack of natural…

Optimization and Control · Mathematics 2025-07-15 Oscar Smee , Fred Roosta , Stephen J. Wright

Large collections of coupled, heterogeneous agents can manifest complex dynamical behavior presenting difficulties for simulation and analysis. However, if the collective dynamics lie on a low-dimensional manifold then the original…

Adaptation and Self-Organizing Systems · Physics 2021-08-11 Thomas N. Thiem , Felix P. Kemeth , Tom Bertalan , Carlo R. Laing , Ioannis G. Kevrekidis

This paper studies a policy optimization problem arising from collaborative multi-agent reinforcement learning in a decentralized setting where agents communicate with their neighbors over an undirected graph to maximize the sum of their…

Optimization and Control · Mathematics 2022-09-07 Jinchi Chen , Jie Feng , Weiguo Gao , Ke Wei

Low-rank matrix estimation plays a central role in various applications across science and engineering. Recently, nonconvex formulations based on matrix factorization are provably solved by simple gradient descent algorithms with strong…

Signal Processing · Electrical Eng. & Systems 2021-04-07 Cong Ma , Yuanxin Li , Yuejie Chi

Swarms of autonomous agents are useful in many applications due to their ability to accomplish tasks in a decentralized manner, making them more robust to failures. Due to the difficulty in running experiments with large numbers of hardware…

Robotics · Computer Science 2021-03-04 Chris Taylor , Cameron Nowzari

Uncertainty is prevalent in robotics. Due to measurement noise and complex dynamics, we cannot estimate the exact system and environment state. Since conservative motion planners are not guaranteed to find a safe control strategy in a…

Robotics · Computer Science 2023-09-22 Laura Lützow , Yue Meng , Andres Chavez Armijos , Chuchu Fan

This paper proposes an iterative methodology to integrate large-scale behavioral activity-based models with dynamic traffic assignment models. The main novelty of the proposed approach is the decoupling of the two parts, allowing the…

Computers and Society · Computer Science 2024-04-12 Serio Agriesti , Claudio Roncoli , Bat-hen Nahmias-Biran

We consider the problem of minimizing a convex function over a closed convex set, with Projected Gradient Descent (PGD). We propose a fully parameter-free version of AdaGrad, which is adaptive to the distance between the initialization and…

Machine Learning · Statistics 2023-06-01 Evgenii Chzhen , Christophe Giraud , Gilles Stoltz

A framework is introduced for sequentially solving convex stochastic minimization problems, where the objective functions change slowly, in the sense that the distance between successive minimizers is bounded. The minimization problems are…

Optimization and Control · Mathematics 2018-03-12 Craig Wilson , Venugopal Veeravalli , Angelia Nedich

Gradient descent is arguably one of the most popular online optimization methods with a wide array of applications. However, the standard implementation where agents simultaneously update their strategies yields several undesirable…

Computer Science and Game Theory · Computer Science 2019-07-11 James P. Bailey , Gauthier Gidel , Georgios Piliouras

In decentralized optimization over networks, each node in the network has a portion of the global objective function and the aim is to collectively optimize this function. Gradient tracking methods have emerged as a popular alternative for…

Optimization and Control · Mathematics 2023-12-13 Albert S. Berahas , Raghu Bollapragada , Shagun Gupta

We propose a general strategy for reduced order modeling of systems that display highly nonlinear oscillations. By considering a continuous family of forced periodic orbits defined in relation to a stable fixed point and subsequently…

Dynamical Systems · Mathematics 2023-02-07 Dan Wilson , Kai Sun

The contribution gives a micro-structural insight into the pedestrian decision process during an egress situation. A method how to extract the decisions of pedestrians from the trajectories recorded during the experiments is introduced. The…

Multiagent Systems · Computer Science 2018-01-08 Pavel Hrabák , Ondřej Ticháček , Vladimíra Sečkárová

Human-robot interactions (HRI) can be modeled as dynamic or differential games with incomplete information, where each agent holds private reward parameters. Due to the open challenge in finding perfect Bayesian equilibria of such games,…

Robotics · Computer Science 2020-11-05 Yi Chen , Lei Zhang , Tanner Merry , Sunny Amatya , Wenlong Zhang , Yi Ren

Particle- and agent-based systems are a ubiquitous modeling tool in many disciplines. We consider the fundamental problem of inferring interaction kernels from observations of agent-based dynamical systems given observations of…

Machine Learning · Computer Science 2020-04-01 Mauro Maggioni , Jason Miller , Ming Zhong

Building upon recent works on linesearch-free adaptive proximal gradient methods, this paper proposes adaPG$^{q,r}$, a framework that unifies and extends existing results by providing larger stepsize policies and improved lower bounds.…

Optimization and Control · Mathematics 2024-07-11 Puya Latafat , Andreas Themelis , Panagiotis Patrinos

Learning rules -- prescriptions for updating model parameters to improve performance -- are typically assumed rather than derived. Why do some learning rules work better than others, and under what assumptions can a given rule be considered…

Machine Learning · Computer Science 2025-11-03 John J. Vastola , Samuel J. Gershman , Kanaka Rajan

We study cooperative control dynamics with gradient based forcing terms. As a specific example, we focus on source-seeking dynamics with vehicles embedded in an unknown scalar field with a subset of agents having gradient information. As…

Optimization and Control · Mathematics 2023-05-30 Adwait Datar , Christian Hespe , Herbert Werner

In this paper, we extend a recently established subgradient method for the computation of Riemannian metrics that optimizes certain singular value functions associated with dynamical systems. This extension is threefold. First, we introduce…

Optimization and Control · Mathematics 2022-02-17 Maurício Louzeiro , Christoph Kawan , Sigurdur Hafstein , Peter Giesl , Jinyun Yuan

In a Hilbert setting, for convex differentiable optimization, we develop a general framework for adaptive accelerated gradient methods. They are based on damped inertial dynamics where the coefficients are designed in a closed-loop way.…

Optimization and Control · Mathematics 2025-01-28 Hedy Attouch , Radu Ioan Bot , Dang-Khoa Nguyen