English
Related papers

Related papers: Relu and softplus neural nets as zero-sum turn-bas…

200 papers

We consider inverse reinforcement learning problems with concave utilities. Concave Utility Reinforcement Learning (CURL) is a generalisation of the standard RL objective, which employs a concave function of the state occupancy measure,…

Machine Learning · Computer Science 2024-08-05 Mustafa Mert Çelikok , Frans A. Oliehoek , Jan-Willem van de Meent

This paper considers a class of two-player zero-sum games on directed graphs whose vertices are equipped with random payoffs of bounded support known by both players. Starting from a fixed vertex, players take turns to move a token along…

Optimization and Control · Mathematics 2024-01-30 Luc Attia , Lyuben Lichev , Dieter Mitsche , Raimundo Saona , Bruno Ziliotto

Deep neural networks, particularly those employing Rectified Linear Units (ReLU), are often perceived as complex, high-dimensional, non-linear systems. This complexity poses a significant challenge to understanding their internal learning…

Machine Learning · Computer Science 2025-11-11 Longqing Ye

We derive upper bounds on the complexity of ReLU neural networks approximating the solution of a linear system given the matrix and the right-hand side. We focus on matrices which are symmetric positive definite and sparse, as they appear…

Numerical Analysis · Mathematics 2026-03-20 Benjamin Dörich , Roland Maier , Lukas Ullmer

Recent years have witnessed a resurgence in using ReLU neural networks (NNs) to represent model predictive control (MPC) policies. However, determining the required network complexity to ensure closed-loop performance remains a fundamental…

Systems and Control · Electrical Eng. & Systems 2026-01-26 Xingchen Li , Keyou You

Recurrent neural networks (RNN) as used in machine learning are commonly formulated in discrete time, i.e. as recursive maps. This brings a lot of advantages for training models on data, e.g. for the purpose of time series prediction or…

Dynamical Systems · Mathematics 2020-07-02 Zahra Monfared , Daniel Durstewitz

Driven by recent successes in two-player, zero-sum game solving and playing, artificial intelligence work on games has increasingly focused on algorithms that produce equilibrium-based strategies. However, this approach has been less…

Computer Science and Game Theory · Computer Science 2022-06-24 Dustin Morrill , Ryan D'Orazio , Reca Sarfati , Marc Lanctot , James R. Wright , Amy Greenwald , Michael Bowling

We consider neural networks with rational activation functions. The choice of the nonlinear activation function in deep learning architectures is crucial and heavily impacts the performance of a neural network. We establish optimal bounds…

Neural and Evolutionary Computing · Computer Science 2020-10-01 Nicolas Boullé , Yuji Nakatsukasa , Alex Townsend

In this paper, we propose a novel method for learning reward functions directly from offline demonstrations. Unlike traditional inverse reinforcement learning (IRL), our approach decouples the reward function from the learner's policy,…

Machine Learning · Computer Science 2025-06-13 Seyed Mahdi B. Azad , Zahra Padar , Gabriel Kalweit , Joschka Boedecker

A growing line of work reframes preference-based fine-tuning of large language models game-theoretically: Nash Learning from Human Feedback (NLHF) recasts the problem as a zero-sum game over policies. However, optimization is over expected…

Computer Science and Game Theory · Computer Science 2026-05-14 Max Horwitz , Jake Gonzales , Eric Mazumdar , Lillian J. Ratliff

We consider the maximum causal entropy inverse reinforcement learning (IRL) problem for infinite-horizon stationary mean-field games (MFG), in which we model the unknown reward function within a reproducing kernel Hilbert space (RKHS). This…

Machine Learning · Computer Science 2026-03-06 Berkay Anahtarci , Can Deha Kariksiz , Naci Saldi

Implicit deep learning has received increasing attention recently due to the fact that it generalizes the recursive prediction rules of many commonly used neural network architectures. Its prediction rule is provided implicitly based on the…

Machine Learning · Computer Science 2022-02-21 Tianxiang Gao , Hailiang Liu , Jia Liu , Hridesh Rajan , Hongyang Gao

We consider functions from the real numbers to the real numbers, output by a neural network with 1 hidden activation layer, arbitrary width, and ReLU activation function. We assume that the parameters of the neural network are chosen…

Machine Learning · Computer Science 2023-04-20 David Holmes

ReLU (rectified linear units) neural network has received significant attention since its emergence. In this paper, a univariate ReLU (UReLU) neural network is proposed to both modelling the nonlinear dynamic system and revealing insights…

Systems and Control · Electrical Eng. & Systems 2020-03-06 Xinglong Liang , Jun Xu

We consider zero-sum stochastic games with finite state and action spaces, perfect information, mean payoff criteria, without any irreducibility assumption on the Markov chains associated to strategies (multichain games). The value of such…

Optimization and Control · Mathematics 2012-08-03 Marianne Akian , Jean Cochet-Terrasson , Sylvie Detournay , Stéphane Gaubert

In this work, the reachable set estimation and safety verification problems for a class of piecewise linear systems equipped with neural network controllers are addressed. The neural network is considered to consist of Rectified Linear Unit…

Systems and Control · Computer Science 2018-02-21 Weiming Xiang , Hoang-Dung Tran , Joel A. Rosenfeld , Taylor T. Johnson

Games are natural models for multi-agent machine learning settings, such as generative adversarial networks (GANs). The desirable outcomes from algorithmic interactions in these games are encoded as game theoretic equilibrium concepts, e.g.…

Computer Science and Game Theory · Computer Science 2022-02-25 Gabriel P. Andrade , Rafael Frongillo , Georgios Piliouras

Zero-sum mean payoff games can be studied by means of a nonlinear spectral problem. When the state space is finite, the latter consists in finding an eigenpair $(u,\lambda)$ solution of $T(u)=\lambda \mathbf{1} + u$ where $T:\mathbb{R}^n…

Optimization and Control · Mathematics 2016-11-17 Marianne Akian , Stéphane Gaubert , Antoine Hochart

Neural networks have proved an effective means of learning control policies for autonomous systems, but these learned policies are difficult to understand due to the black-box nature of neural networks. This lack of interpretability makes…

Machine Learning · Computer Science 2026-05-12 Hector Woods , Philippa Ryan , Rob Alexander

In this paper we study a zero-sum switching game and its verification theorems expressed in terms of either a system of Reflected Backward Stochastic Differential Equations (RBSDEs in short) with bilateral interconnected obstacles or a…

Probability · Mathematics 2020-06-30 Said Hamadène , Tingshu Mu