English
Related papers

Related papers: A Mathematical Programming Approach to Computing a…

200 papers

Learning to optimize has emerged as a powerful framework for various optimization and machine learning tasks. Current such "meta-optimizers" often learn in the space of continuous optimization algorithms that are point-based and…

Machine Learning · Computer Science 2019-11-19 Yue Cao , Tianlong Chen , Zhangyang Wang , Yang Shen

Regret minimization has proved to be a versatile tool for tree-form sequential decision making and extensive-form games. In large two-player zero-sum imperfect-information games, modern extensions of counterfactual regret minimization (CFR)…

Computer Science and Game Theory · Computer Science 2021-03-09 Gabriele Farina , Tuomas Sandholm

We consider the minimum-norm-point (MNP) problem over polyhedra, a well-studied problem that encompasses linear programming. We present a general algorithmic framework that combines two fundamental approaches for this problem: active set…

Optimization and Control · Mathematics 2023-08-15 Satoru Fujishige , Tomonari Kitahara , László A. Végh

Model-based reinforcement learning (MBRL) agents typically learn world models by minimizing predictive loss. However, powerful RL optimizers inevitably exploit minor model inaccuracies, leading to simulator exploitation and a reality gap…

Machine Learning · Computer Science 2026-05-29 Christoph Dann , Yishay Mansour , Mehryar Mohri

Mean-field games (MFG) were introduced to efficiently analyze approximate Nash equilibria in large population settings. In this work, we consider entropy-regularized mean-field games with a finite state-action space in a discrete time…

Computer Science and Game Theory · Computer Science 2022-07-26 Yue Guan , Mi Zhou , Ali Pakniyat , Panagiotis Tsiotras

This paper studies optimal consensus tracking problem of heterogeneous linear multi-agent systems. By introducing tracking error dynamics, the optimal tracking problem is reformulated as finding a Nash-equilibrium solution of a multi-player…

Optimization and Control · Mathematics 2019-05-21 Jilie Zhang , Zhanshan Wang , Hongwei Zhang

We study the problem of pure exploration in matching markets under uncertain preferences, where the goal is to identify a stable matching with confidence parameter $\delta$ and minimal sample complexity. Agents learn preferences via…

Computer Science and Game Theory · Computer Science 2025-09-19 Tejas Pagare , Agniv Bandyopadhyay , Sandeep Juneja

Learning by experience in Multi-Agent Systems (MAS) is a difficult and exciting task, due to the lack of stationarity of the environment, whose dynamics evolves as the population learns. In order to design scalable algorithms for systems…

Optimization and Control · Mathematics 2020-02-24 Romuald Elie , Julien Pérolat , Mathieu Laurière , Matthieu Geist , Olivier Pietquin

We investigate the problem of persistently monitoring a finite set of targets with internal states that evolve with linear stochastic dynamics using a finite set of mobile agents. We approach the problem from the infinite-horizon…

Systems and Control · Electrical Eng. & Systems 2019-10-01 Samuel C. Pinto , Sean B. Andersson , Julien M. Hendrickx , Christos G. Cassandras

The Robust Markov Decision Process (RMDP) framework focuses on designing control policies that are robust against the parameter uncertainties due to the mismatches between the simulator model and real-world settings. An RMDP problem is…

Machine Learning · Computer Science 2022-05-17 Kishan Panaganti , Dileep Kalathil

It is common to assume that agents will adopt Nash equilibrium strategies; however, experimental studies have demonstrated that Nash equilibrium is often a poor description of human players' behavior in unrepeated normal-form games. In this…

Computer Science and Game Theory · Computer Science 2017-10-17 James R. Wright , Kevin Leyton-Brown

In this paper we consider a broad class of infinite horizon discrete-time optimal control models that involve a nonnegative cost function and an affine mapping in their dynamic programming equation. They include as special cases classical…

Optimization and Control · Mathematics 2017-11-29 Dimitri Bertsekas

In this work, we develop a reward design framework for installing a desired behavior as a strict equilibrium across standard solution concepts: dominant strategy equilibrium, Nash equilibrium, correlated equilibrium, and coarse correlated…

Computer Science and Game Theory · Computer Science 2025-03-06 Jeremy McMahan , Young Wu , Yudong Chen , Xiaojin Zhu , Qiaomin Xie

Recent research shows that supervised learning can be an effective tool for designing near-optimal feedback controllers for high-dimensional nonlinear dynamic systems. But the behavior of neural network controllers is still not well…

Optimization and Control · Mathematics 2022-10-10 Tenavi Nakamura-Zimmerer , Qi Gong , Wei Kang

Traditional maximum entropy and sparsity-based algorithms for analytic continuation often suffer from the ill-posed kernel matrix or demand tremendous computation time for parameter tuning. Here we propose a neural network method by convex…

Machine Learning · Computer Science 2022-02-07 Dongchen Huang , Yi-feng Yang

Discrete time stochastic optimal control problems and Markov decision processes (MDPs) are fundamental models for sequential decision-making under uncertainty and as such provide the mathematical framework underlying reinforcement learning…

Optimization and Control · Mathematics 2025-07-01 Arnulf Jentzen , Konrad Kleinberg , Thomas Kruse

Meta-learning has been proposed as a promising machine learning topic in recent years, with important applications to image classification, robotics, computer games, and control systems. In this paper, we study the problem of using…

Systems and Control · Electrical Eng. & Systems 2025-03-04 Yunian Pan , Tao Li , Quanyan Zhu

While the idea of robust dynamic programming (DP) is compelling for systems affected by uncertainty, addressing worst-case disturbances generally results in excessive conservatism. This paper introduces a method for constructing control…

Systems and Control · Electrical Eng. & Systems 2025-05-19 Menno van Zutphen , Domagoj Herceg , Duarte J. Antunes

Estimation of nonlinear dynamic models from data poses many challenges, including model instability and non-convexity of long-term simulation fidelity. Recently Lagrangian relaxation has been proposed as a method to approximate simulation…

Systems and Control · Computer Science 2018-10-12 Jack Umenberger , Ian R. Manchester

Informed and robust decision making in the face of uncertainty is critical for robots that perform physical tasks alongside people. We formulate this as Bayesian Reinforcement Learning over latent Markov Decision Processes (MDPs). While…

Robotics · Computer Science 2020-02-11 Gilwoo Lee , Brian Hou , Sanjiban Choudhury , Siddhartha S. Srinivasa