English
Related papers

Related papers: The Sample-Complexity of General Reinforcement Lea…

200 papers

The fundamental result of Li, Long, and Srinivasan on approximations of set systems has become a key tool across several communities such as learning theory, algorithms, computational geometry, combinatorics and data analysis. The goal of…

Machine Learning · Computer Science 2022-09-02 Mónika Csikós , Nabil H. Mustafa

We study the notion of a generalization bound being uniformly tight, meaning that the difference between the bound and the population loss is small for all learning algorithms and all population distributions. Numerous generalization bounds…

Machine Learning · Computer Science 2023-11-29 Michael Gastpar , Ido Nachum , Jonathan Shafer , Thomas Weinberger

How sensitive should machine learning models be to input changes? We tackle the question of model smoothness and show that it is a useful inductive bias which aids generalization, adversarial robustness, generative modeling and…

Machine Learning · Statistics 2021-07-08 Mihaela Rosca , Theophane Weber , Arthur Gretton , Shakir Mohamed

There is a growing interest in societal concerns in machine learning systems, especially in fairness. Multicalibration gives a comprehensive methodology to address group fairness. In this work, we address the multicalibration error and…

Machine Learning · Computer Science 2021-06-08 Eliran Shabat , Lee Cohen , Yishay Mansour

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on…

Statistics Theory · Mathematics 2018-12-06 Timothy Carpenter , Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

Strategic classification, i.e. classification under possible strategic manipulations of features, has received a lot of attention from both the machine learning and the game theory community. Most works focus on analysing properties of the…

Machine Learning · Computer Science 2022-03-28 Tosca Lechner , Ruth Urner

In this short note we observe that the sample complexity of PAC machine learning of various concepts, including learning the maximum (EMX), can be exactly determined when the support of the probability measures considered as models…

Machine Learning · Computer Science 2020-02-27 Alberto Gandolfi

One of the key reasons for the high sample complexity in reinforcement learning (RL) is the inability to transfer knowledge from one task to another. In standard multi-task RL settings, low-reward data collected while trying to solve one…

Machine Learning · Computer Science 2020-02-27 Alexander C. Li , Lerrel Pinto , Pieter Abbeel

Safety is critical when applying reinforcement learning (RL) to real-world problems. As a result, safe RL has emerged as a fundamental and powerful paradigm for optimizing an agent's policy while incorporating notions of safety. A prevalent…

Machine Learning · Computer Science 2024-05-09 Akifumi Wachi , Xun Shen , Yanan Sui

In this paper, we confront the problem of applying reinforcement learning to agents that perceive the environment through many sensors and that can perform parallel actions using many actuators as is the case in complex autonomous robots.…

Artificial Intelligence · Computer Science 2011-07-04 E. Celaya , J. M. Porta

Reinforcement learning algorithms can train agents that solve problems in complex, interesting environments. Normally, the complexity of the trained agent is closely related to the complexity of the environment. This suggests that a highly…

Artificial Intelligence · Computer Science 2018-03-16 Trapit Bansal , Jakub Pachocki , Szymon Sidor , Ilya Sutskever , Igor Mordatch

An algorithm is proposed, analyzed, and tested for solving continuous nonlinear-equality-constrained optimization problems where the objective and constraint functions are defined by expectations or averages over large, finite numbers of…

Optimization and Control · Mathematics 2026-05-14 Frank E. Curtis , Lingjun Guo , Daniel P. Robinson

Compressing neural nets is an active research problem, given the large size of state-of-the-art nets for tasks such as object recognition, and the computational limits imposed by mobile devices. We give a general formulation of model…

Machine Learning · Computer Science 2017-07-06 Miguel Á. Carreira-Perpiñán

The reasoning ability of large language models (LLMs) can be unleashed with reinforcement learning (RL) (OpenAI, 2024; DeepSeek-AI et al., 2025a; Zeng et al., 2025). The success of existing RL attempts in LLMs usually rely on high-quality…

Machine Learning · Computer Science 2026-04-03 Yiyuan Li , Zhen Huang , Yanan Wu , Weixun Wang , Xuefeng Li , Yijia Luo , Wenbo Su , Bo Zheng , Pengfei Liu

Monte Carlo Exploring Starts (MCES), which aims to learn the optimal policy using only sample returns, is a simple and natural algorithm in reinforcement learning which has been shown to converge under various conditions. However, the…

Machine Learning · Computer Science 2024-10-07 Suei-Wen Chen , Keith Ross , Pierre Youssef

We study the following question in the context of imitation learning for continuous control: how are the underlying stability properties of an expert policy reflected in the sample-complexity of an imitation learning task? We provide the…

Machine Learning · Computer Science 2023-01-18 Stephen Tu , Alexander Robey , Tingnan Zhang , Nikolai Matni

Q-learning is widely used algorithm in reinforcement learning community. Under the lookup table setting, its convergence is well established. However, its behavior is known to be unstable with the linear function approximation case. This…

Machine Learning · Computer Science 2025-02-11 Han-Dong Lim , Donghwan Lee

Convex composition optimization is an emerging topic that covers a wide range of applications arising from stochastic optimal control, reinforcement learning and multi-stage stochastic programming. Existing algorithms suffer from…

Optimization and Control · Mathematics 2020-09-01 Tianyi Lin , Chenyou Fan , Mengdi Wang , Michael I. Jordan

Polytrees are a subclass of Bayesian networks that seek to capture the conditional dependencies between a set of $n$ variables as a directed forest and are motivated by their more efficient inference and improved interpretability. Since the…

Data Structures and Algorithms · Computer Science 2026-05-06 Juha Harviainen , Frank Sommer , Manuel Sorge

We study the computational complexity of approximating general constrained Markov decision processes. Our primary contribution is the design of a polynomial time $(0,\epsilon)$-additive bicriteria approximation algorithm for finding optimal…

Data Structures and Algorithms · Computer Science 2025-02-12 Jeremy McMahan