中文
相关论文

相关论文: Relu and softplus neural nets as zero-sum turn-bas…

200 篇论文

We consider inverse reinforcement learning problems with concave utilities. Concave Utility Reinforcement Learning (CURL) is a generalisation of the standard RL objective, which employs a concave function of the state occupancy measure,…

机器学习 · 计算机科学 2024-08-05 Mustafa Mert Çelikok , Frans A. Oliehoek , Jan-Willem van de Meent

This paper considers a class of two-player zero-sum games on directed graphs whose vertices are equipped with random payoffs of bounded support known by both players. Starting from a fixed vertex, players take turns to move a token along…

最优化与控制 · 数学 2024-01-30 Luc Attia , Lyuben Lichev , Dieter Mitsche , Raimundo Saona , Bruno Ziliotto

Deep neural networks, particularly those employing Rectified Linear Units (ReLU), are often perceived as complex, high-dimensional, non-linear systems. This complexity poses a significant challenge to understanding their internal learning…

机器学习 · 计算机科学 2025-11-11 Longqing Ye

We derive upper bounds on the complexity of ReLU neural networks approximating the solution of a linear system given the matrix and the right-hand side. We focus on matrices which are symmetric positive definite and sparse, as they appear…

数值分析 · 数学 2026-03-20 Benjamin Dörich , Roland Maier , Lukas Ullmer

Recent years have witnessed a resurgence in using ReLU neural networks (NNs) to represent model predictive control (MPC) policies. However, determining the required network complexity to ensure closed-loop performance remains a fundamental…

系统与控制 · 电气工程与系统科学 2026-01-26 Xingchen Li , Keyou You

Recurrent neural networks (RNN) as used in machine learning are commonly formulated in discrete time, i.e. as recursive maps. This brings a lot of advantages for training models on data, e.g. for the purpose of time series prediction or…

动力系统 · 数学 2020-07-02 Zahra Monfared , Daniel Durstewitz

Driven by recent successes in two-player, zero-sum game solving and playing, artificial intelligence work on games has increasingly focused on algorithms that produce equilibrium-based strategies. However, this approach has been less…

计算机科学与博弈论 · 计算机科学 2022-06-24 Dustin Morrill , Ryan D'Orazio , Reca Sarfati , Marc Lanctot , James R. Wright , Amy Greenwald , Michael Bowling

We consider neural networks with rational activation functions. The choice of the nonlinear activation function in deep learning architectures is crucial and heavily impacts the performance of a neural network. We establish optimal bounds…

神经与进化计算 · 计算机科学 2020-10-01 Nicolas Boullé , Yuji Nakatsukasa , Alex Townsend

In this paper, we propose a novel method for learning reward functions directly from offline demonstrations. Unlike traditional inverse reinforcement learning (IRL), our approach decouples the reward function from the learner's policy,…

机器学习 · 计算机科学 2025-06-13 Seyed Mahdi B. Azad , Zahra Padar , Gabriel Kalweit , Joschka Boedecker

A growing line of work reframes preference-based fine-tuning of large language models game-theoretically: Nash Learning from Human Feedback (NLHF) recasts the problem as a zero-sum game over policies. However, optimization is over expected…

计算机科学与博弈论 · 计算机科学 2026-05-14 Max Horwitz , Jake Gonzales , Eric Mazumdar , Lillian J. Ratliff

We consider the maximum causal entropy inverse reinforcement learning (IRL) problem for infinite-horizon stationary mean-field games (MFG), in which we model the unknown reward function within a reproducing kernel Hilbert space (RKHS). This…

机器学习 · 计算机科学 2026-03-06 Berkay Anahtarci , Can Deha Kariksiz , Naci Saldi

Implicit deep learning has received increasing attention recently due to the fact that it generalizes the recursive prediction rules of many commonly used neural network architectures. Its prediction rule is provided implicitly based on the…

机器学习 · 计算机科学 2022-02-21 Tianxiang Gao , Hailiang Liu , Jia Liu , Hridesh Rajan , Hongyang Gao

We consider functions from the real numbers to the real numbers, output by a neural network with 1 hidden activation layer, arbitrary width, and ReLU activation function. We assume that the parameters of the neural network are chosen…

机器学习 · 计算机科学 2023-04-20 David Holmes

ReLU (rectified linear units) neural network has received significant attention since its emergence. In this paper, a univariate ReLU (UReLU) neural network is proposed to both modelling the nonlinear dynamic system and revealing insights…

系统与控制 · 电气工程与系统科学 2020-03-06 Xinglong Liang , Jun Xu

We consider zero-sum stochastic games with finite state and action spaces, perfect information, mean payoff criteria, without any irreducibility assumption on the Markov chains associated to strategies (multichain games). The value of such…

最优化与控制 · 数学 2012-08-03 Marianne Akian , Jean Cochet-Terrasson , Sylvie Detournay , Stéphane Gaubert

In this work, the reachable set estimation and safety verification problems for a class of piecewise linear systems equipped with neural network controllers are addressed. The neural network is considered to consist of Rectified Linear Unit…

系统与控制 · 计算机科学 2018-02-21 Weiming Xiang , Hoang-Dung Tran , Joel A. Rosenfeld , Taylor T. Johnson

Games are natural models for multi-agent machine learning settings, such as generative adversarial networks (GANs). The desirable outcomes from algorithmic interactions in these games are encoded as game theoretic equilibrium concepts, e.g.…

计算机科学与博弈论 · 计算机科学 2022-02-25 Gabriel P. Andrade , Rafael Frongillo , Georgios Piliouras

Zero-sum mean payoff games can be studied by means of a nonlinear spectral problem. When the state space is finite, the latter consists in finding an eigenpair $(u,\lambda)$ solution of $T(u)=\lambda \mathbf{1} + u$ where $T:\mathbb{R}^n…

最优化与控制 · 数学 2016-11-17 Marianne Akian , Stéphane Gaubert , Antoine Hochart

Neural networks have proved an effective means of learning control policies for autonomous systems, but these learned policies are difficult to understand due to the black-box nature of neural networks. This lack of interpretability makes…

机器学习 · 计算机科学 2026-05-12 Hector Woods , Philippa Ryan , Rob Alexander

In this paper we study a zero-sum switching game and its verification theorems expressed in terms of either a system of Reflected Backward Stochastic Differential Equations (RBSDEs in short) with bilateral interconnected obstacles or a…

概率论 · 数学 2020-06-30 Said Hamadène , Tingshu Mu