English
Related papers

Related papers: Implicit Generative Modeling for Efficient Explora…

200 papers

Reward engineering and designing an incentive reward function are non-trivial tasks to train agents in complex environments. Furthermore, an inaccurate reward function may lead to a biased behaviour which is far from an efficient and…

Robotics · Computer Science 2021-05-04 Saeed Tafazzol , Erfan Fathi , Mahdi Rezaei , Ehsan Asali

There is a strong link between the general concept of intelligence and the ability to collect and use information. The theory of Bayes-adaptive exploration offers an attractive optimality framework for training machines to perform complex…

Machine Learning · Statistics 2021-09-20 Luca Ambrogioni

Traditional imitation learning provides a set of methods and algorithms to learn a reward function or policy from expert demonstrations. Learning from demonstration has been shown to be advantageous for navigation tasks as it allows for…

Robotics · Computer Science 2021-08-03 Christian Ellis , Maggie Wigness , John G. Rogers , Craig Lennon , Lance Fiondella

Active inference is an ambitious theory that treats perception, inference and action selection of autonomous agents under the heading of a single principle. It suggests biologically plausible explanations for many cognitive phenomena,…

Artificial Intelligence · Computer Science 2018-06-22 Martin Biehl , Christian Guckelsberger , Christoph Salge , Simón C. Smith , Daniel Polani

Active recognition enables robots to intelligently explore novel observations, thereby acquiring more information while circumventing undesired viewing conditions. Recent approaches favor learning policies from simulated or collected data,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Lei Fan , Mingfu Liang , Yunxuan Li , Gang Hua , Ying Wu

Optimizing objective functions subject to constraints is fundamental in many real-world applications. However, these constraints are often not readily defined and must be inferred from expert agent behaviors, a problem known as Inverse…

Machine Learning · Computer Science 2025-05-19 Bo Yue , Jian Li , Guiliang Liu

A crucial task in predictive maintenance is estimating the remaining useful life of physical systems. In the last decade, deep learning has improved considerably upon traditional model-based and statistical approaches in terms of predictive…

Machine Learning · Computer Science 2024-02-05 Luca Della Libera , Jacopo Andreoli , Davide Dalle Pezze , Mirco Ravanelli , Gian Antonio Susto

Implicit models, which allow for the generation of samples but not for point-wise evaluation of probabilities, are omnipresent in real-world problems tackled by machine learning and a hot topic of current research. Some examples include…

Machine Learning · Statistics 2018-04-27 Yingzhen Li , Richard E. Turner

In practice, incentive providers (i.e., principals) often cannot observe the reward realizations of incentivized agents, which is in contrast to many principal-agent models that have been previously studied. This information asymmetry…

Machine Learning · Computer Science 2023-08-15 Ilgin Dogan , Zuo-Jun Max Shen , Anil Aswani

Deep reinforcement learning algorithms have been shown to learn complex tasks using highly general policy classes. However, sparse reward problems remain a significant challenge. Exploration methods based on novelty detection have been…

Machine Learning · Computer Science 2017-05-30 Justin Fu , John D. Co-Reyes , Sergey Levine

In Reinforcement Learning (RL), agents aim at maximizing cumulative rewards in a given environment. During the learning process, RL agents face the dilemma of exploitation and exploration: leveraging existing knowledge to acquire rewards or…

Machine Learning · Computer Science 2023-10-24 Chenfan Weng , Zhongguo Li

Incomplete knowledge of the environment leads an agent to make decisions under uncertainty. One of the major dilemmas in Reinforcement Learning (RL) where an autonomous agent has to balance two contrasting needs in making its decisions is:…

Machine Learning · Statistics 2024-02-21 Valentina Zangirolami , Matteo Borrotti

The effectiveness of model training heavily relies on the quality of available training resources. However, budget constraints often impose limitations on data collection efforts. To tackle this challenge, we introduce causal exploration in…

Machine Learning · Computer Science 2024-07-31 Yupei Yang , Biwei Huang , Shikui Tu , Lei Xu

Language models can learn a range of capabilities from unsupervised training on text corpora. However, to solve a particular problem (such as text summarization) it is typically necessary to fine-tune them on a task-specific dataset. It is…

Computation and Language · Computer Science 2022-03-16 Adam Gleave , Geoffrey Irving

Efficient exploration is important for reinforcement learners to achieve high rewards. In multi-agent systems, coordinated exploration and behaviour is critical for agents to jointly achieve optimal outcomes. In this paper, we introduce a…

Decision-making under uncertainty is a fundamental problem encountered frequently and can be formulated as a stochastic multi-armed bandit problem. In the problem, the learner interacts with an environment by choosing an action at each…

Machine Learning · Statistics 2024-05-24 Jonathan Gornet , Bruno Sinopoli

We propose and design recommendation systems that incentivize efficient exploration. Agents arrive sequentially, choose actions and receive rewards, drawn from fixed but unknown action-specific distributions. The recommendation system…

Computer Science and Game Theory · Computer Science 2026-04-02 Nicole Immorlica , Jieming Mao , Aleksandrs Slivkins , Zhiwei Steven Wu

The objective of a reinforcement learning agent is to behave so as to maximise the sum of a suitable scalar function of state: the reward. These rewards are typically given and immutable. In this paper, we instead consider the proposition…

Artificial Intelligence · Computer Science 2020-08-25 Zeyu Zheng , Junhyuk Oh , Matteo Hessel , Zhongwen Xu , Manuel Kroiss , Hado van Hasselt , David Silver , Satinder Singh

Understanding the emergence of cooperation in systems of computational agents is crucial for the development of effective cooperative AI. Interaction among individuals in real-world settings are often sparse and occur within a broad…

Multiagent Systems · Computer Science 2024-01-24 Nicole Orzan , Erman Acar , Davide Grossi , Roxana Rădulescu

Latent learning, classically theorized by Tolman, shows that biological agents (e.g., rats) can acquire internal representations of their environment without rewards, enabling rapid adaptation once rewards are introduced. In contrast, from…

Machine Learning · Computer Science 2026-02-02 Jian Xiong , Jingbo Zhou , Zihan Zhou , Yixiong Xiao , Le Zhang , Jingyong Ye , Rui Qian , Yang Zhou , Dejing Dou