English
Related papers

Related papers: An $\epsilon$-Optimal Sequential Approach for Solv…

200 papers

This paper considers an optimization problem for a dynamical system whose evolution depends on a collection of binary decision variables. We develop scalable approximation algorithms with provable suboptimality bounds to provide…

Optimization and Control · Mathematics 2016-10-31 Insoon Yang , Samuel A. Burden , Ram Rajagopal , S. Shankar Sastry , Claire J. Tomlin

Stochastic gradient descent (SGD) is a widely adopted iterative method for optimizing differentiable objective functions. In this paper, we propose and discuss a novel approach to scale up SGD in applications involving non-convex functions…

Machine Learning · Statistics 2022-10-07 Saad Mohamad , Hamad Alamri , Abdelhamid Bouchachia

We introduce a novel gradient-based approach for solving sequential tasks by dynamically adjusting the underlying myopic potential field in response to feedback and the world's regularities. This adjustment implicitly considers subgoals…

Robotics · Computer Science 2025-11-05 Vito Mengers , Oliver Brock

Health-related data is noisy and stochastic in implying the true physiological states of patients, limiting information contained in single-moment observations for sequential clinical decision making. We model patient-clinician interactions…

Artificial Intelligence · Computer Science 2019-05-21 Luchen Li , Matthieu Komorowski , Aldo A. Faisal

One-counter MDPs (OC-MDPs) and one-counter simple stochastic games (OC-SSGs) are 1-player, and 2-player turn-based zero-sum, stochastic games played on the transition graph of classic one-counter automata (equivalently, pushdown automata…

Computer Science and Game Theory · Computer Science 2011-07-21 Tomáš Brázdil , Václav Brožek , Kousha Etessami , Antonín Kučera

We present new learning dynamics combining (independent) log-linear learning and value iteration for stochastic games within the auxiliary stage game framework. The dynamics presented provably attain the efficient equilibrium (also known as…

Computer Science and Game Theory · Computer Science 2023-09-08 Onur Unlu , Muhammed O. Sayin

We present new learning dynamics combining (independent) log-linear learning and value iteration for stochastic games within the auxiliary stage game framework. The dynamics presented provably attain the efficient equilibrium (also known as…

Computer Science and Game Theory · Computer Science 2023-09-11 Onur Unlu , Muhammed O. Sayin

Stochastic Optimization is a cornerstone of operations research, providing a framework to solve optimization problems under uncertainty. Despite the development of numerous algorithms to tackle these problems, several persistent challenges…

Optimization and Control · Mathematics 2025-03-28 Di Zhang , Suvrajeet Sen

This paper introduces an equilibrium framework based on sequential sampling in which players face strategic uncertainty over their opponents' behavior and acquire informative signals to resolve it. Sequential sampling equilibrium delivers a…

Theoretical Economics · Economics 2023-11-03 Duarte Gonçalves

Mixed packing and covering problems are problems that can be formulated as linear programs using only non-negative coefficients. Examples include multicommodity network flow, the Held-Karp lower bound on TSP, fractional relaxations of set…

Data Structures and Algorithms · Computer Science 2016-01-19 Neal E. Young

We address the generalized Nash equilibrium seeking problem in a partial-decision information scenario, where each agent can only exchange information with some neighbors, although its cost function possibly depends on the strategies of all…

Optimization and Control · Mathematics 2021-12-14 Mattia Bianchi , Giuseppe Belgioioso , Sergio Grammatico

Differential games, in particular two-player sequential zero-sum games (a.k.a. minimax optimization), have been an important modeling tool in applied science and received renewed interest in machine learning due to many recent applications,…

Machine Learning · Computer Science 2023-02-21 Guojun Zhang , Kaiwen Wu , Pascal Poupart , Yaoliang Yu

A major bottleneck in scenario-based Sample Average Approximation (SAA) for stochastic programming (SP) is the cost of solving an exact second-stage problem for every scenario, especially when each scenario contains an NP-hard combinatorial…

Optimization and Control · Mathematics 2026-05-12 Jingyi Zhao , Linxin Yang , Haohua Zhang , Qile He , Tian Ding

We consider the problem of planning under observation and motion uncertainty for nonlinear robotics systems. Determining the optimal solution to this problem, generally formulated as a Partially Observed Markov Decision Process (POMDP), is…

Robotics · Computer Science 2017-07-11 Mohammadhussein Rafieisakhaei , Suman Chakravorty , P. R. Kumar

This paper presents a modeling and optimization framework to compute the minimum-lap-time spatial trajectory and powertrain operation of racing cars in a computationally efficient fashion. Specifically, we first derive a quasi-steady-state…

Optimization and Control · Mathematics 2026-04-15 Erik van den Eshof , Wytze de Vries , Jorn van Kampen , Mauro Salazar

Sample-efficient exploration is crucial not only for discovering rewarding experiences but also for adapting to environment changes in a task-agnostic fashion. A principled treatment of the problem of optimal input synthesis for system…

Machine Learning · Computer Science 2019-10-10 Matthias Schultheis , Boris Belousov , Hany Abdulsamad , Jan Peters

Although neural networks have been applied to several systems in recent years, they still cannot be used in safety-critical systems due to the lack of efficient techniques to certify their robustness. A number of techniques based on convex…

Machine Learning · Computer Science 2021-09-28 Ziye Ma , Somayeh Sojoudi

Linear systems with a tensor product structure arise naturally when considering the discretization of Laplace type differential equations or, more generally, multidimensional operators with separable coefficients. In this work, we focus on…

Numerical Analysis · Mathematics 2023-11-03 Stefano Massei , Leonardo Robol

In this paper we propose a new operator splitting algorithm for distributed Nash equilibrium seeking under stochastic uncertainty, featuring relaxation and inertial effects. Our work is inspired by recent deterministic operator splitting…

Optimization and Control · Mathematics 2021-03-25 Shisheng Cui , Barbara Franci , Sergio Grammatico , Uday V. Shanbhag , Mathias Staudigl

In this paper, we study multistage stochastic mixed-integer nonlinear programs (MS-MINLP). This general class of problems encompasses, as important special cases, multistage stochastic convex optimization with non-Lipschitzian value…

Optimization and Control · Mathematics 2022-05-23 Shixuan Zhang , Xu Andy Sun