English
Related papers

Related papers: Last-iterate convergence of modified predictive me…

200 papers

Iterative methods are widely used for solving partial differential equations (PDEs). However, the difficulty in eliminating global low-frequency errors significantly limits their convergence speed. In recent years, neural networks have…

Computational Physics · Physics 2024-10-10 Daiwei Dong , Wei Suo , Jiaqing Kou , Weiwei Zhang

Disjointly constrained multilinear programming concerns the problem of maximizing a multilinear function on the product of finitely many disjoint polyhedra. While maximizing a linear function on a polytope (linear programming) is known to…

Optimization and Control · Mathematics 2016-03-14 Kai Kellner

In this paper, we study two-player zero-sum turn-based games played on a finite multidimensional weighted graph. In recent papers all dimensions use the same measure, whereas here we allow to combine different measures. Such heterogeneous…

Computer Science and Game Theory · Computer Science 2016-06-22 Véronique Bruyère , Quentin Hautem , Jean-François Raskin

We propose a monotone splitting algorithm for solving a class of second-order non-potential mean-field games. Following [Achdou, Capuzzo-Dolcetta, "Mean Field Games: Numerical Methods," SINUM (2010)], we introduce a finite-difference scheme…

Optimization and Control · Mathematics 2024-04-01 Levon Nurbekyan , Siting Liu , Yat Tin Chow

Deep Learning (DL) methods show very good performance when trained on large, balanced data sets. However, many practical problems involve imbalanced data sets, or/and classes with a small number of training samples. The performance of DL…

Machine Learning · Computer Science 2017-02-07 Dolev Raviv , Margarita Osadchy

The convergence of online learning algorithms in games under self-play is a fundamental question in game theory and machine learning. Among various notions of convergence, last-iterate convergence is particularly desirable, as it reflects…

Computer Science and Game Theory · Computer Science 2025-11-11 Yang Cai , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

We introduce Robust Multi-Objective Decoding (RMOD), a novel inference-time algorithm that robustly aligns Large Language Models (LLMs) to multiple human objectives (e.g., instruction-following, helpfulness, safety) by maximizing the…

Machine Learning · Computer Science 2026-02-17 Seongho Son , William Bankes , Sangwoong Yoon , Shyam Sundhar Ramesh , Xiaohang Tang , Ilija Bogunovic

In this paper, we consider multi-agent learning via online gradient descent in a class of games called $\lambda$-cocoercive games, a fairly broad class of games that admits many Nash equilibria and that properly includes unconstrained…

Optimization and Control · Mathematics 2021-07-20 Tianyi Lin , Zhengyuan Zhou , Panayotis Mertikopoulos , Michael I. Jordan

The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters…

Signal Processing · Electrical Eng. & Systems 2024-04-18 Geethu Joseph

In this paper, we suggest a new heterogeneous multiscale method (HMM) for the time-harmonic Maxwell equations in locally periodic media. The method is constructed by using a divergence-regularization in one of the cell problems. This allows…

Numerical Analysis · Mathematics 2015-09-15 Patrick Henning , Mario Ohlberger , Barbara Verfürth

Recent work on high-resolution ordinary differential equations (HR-ODEs) captures fine nuances among different momentum-based optimization methods, leading to accurate theoretical insights. However, these HR-ODEs often appear disconnected,…

Optimization and Control · Mathematics 2025-03-20 Hoomaan Maskan , Konstantinos C. Zygalakis , Armin Eftekhari , Alp Yurtsever

We consider differentiable games where the goal is to find a Nash equilibrium. The machine learning community has recently started using variants of the gradient method (GD). Prime examples are extragradient (EG), the optimistic gradient…

Machine Learning · Computer Science 2020-07-08 Waïss Azizian , Ioannis Mitliagkas , Simon Lacoste-Julien , Gauthier Gidel

Convergence of the policy iteration method for discrete and continuous optimal control problems holds under general assumptions. Moreover, in some circumstances, it is also possible to show a quadratic rate of convergence for the algorithm.…

Optimization and Control · Mathematics 2022-03-02 Fabio Camilli , Qing Tang

We study the problem of computing an optimal policy of an infinite-horizon discounted constrained Markov decision process (constrained MDP). Despite the popularity of Lagrangian-based policy search methods used in practice, the oscillation…

Optimization and Control · Mathematics 2024-01-18 Dongsheng Ding , Chen-Yu Wei , Kaiqing Zhang , Alejandro Ribeiro

Repeated games are difficult to analyze, especially when agents play mixed strategies. We study one-memory strategies in iterated prisoner's dilemma, then generalize the result to k-memory strategies in repeated games. Our result shows that…

Computer Science and Game Theory · Computer Science 2019-02-26 Shiheng Wang , Fangzhen Lin

We propose machine learning methods for solving fully nonlinear partial differential equations (PDEs) with convex Hamiltonian. Our algorithms are conducted in two steps. First the PDE is rewritten in its dual stochastic control…

Computational Finance · Quantitative Finance 2022-05-23 William Lefebvre , Grégoire Loeper , Huyên Pham

RBM-MPC is a computationally efficient variant of Model Predictive Control (MPC) in which the Random Batch Method (RBM) is used to speed up the finite-horizon optimal control problems at each iteration. In this paper, stability and…

Optimization and Control · Mathematics 2024-03-08 Daniël Veldman , Alexandra Borkowski , Enrique Zuazua

Nash equilibrium} (NE) can be stated as a formal theorem on a multilinear form, free of game theory terminology. On the other hand, inspired by this formalism, we state and prove a {\it multilinear minimax theorem}, a generalization of von…

Computer Science and Game Theory · Computer Science 2024-01-01 Bahman Kalantari

In this paper, the generalized Nash equilibrium (GNE) seeking problem for continuous games with coupled affine inequality constraints is investigated in a partial-decision information scenario, where each player can only access its…

Computer Science and Game Theory · Computer Science 2022-07-29 Min Meng , Xiuxian Li

We consider a linear symmetric and elliptic PDE and a linear goal functional. We design and analyze a goal-oriented adaptive finite element method, which steers the adaptive mesh-refinement as well as the approximate solution of the arising…

Numerical Analysis · Mathematics 2024-01-12 Roland Becker , Gregor Gantner , Michael Innerberger , Dirk Praetorius