English
Related papers

Related papers: Active hypothesis testing in unknown environments …

200 papers

An active hypothesis testing problem is formulated. In this problem, the agent can perform a fixed number of experiments and then decide on one of the hypotheses. The agent is also allowed to declare its experiments inconclusive if needed.…

Information Theory · Computer Science 2019-01-23 Dhruva Kartik , Ashutosh Nayyar , Urbashi Mitra

Two active hypothesis testing problems are formulated. In these problems, the agent can perform a fixed number of experiments and then decide on one of the hypotheses. The agent is also allowed to declare its experiments inconclusive if…

Systems and Control · Electrical Eng. & Systems 2019-11-19 Dhruva Kartik , Ashutosh Nayyar , Urbashi Mitra

Active learning can reduce the number of samples needed to perform a hypothesis test and to estimate the parameters of a model. In this paper, we revisit the work of Chernoff that described an asymptotically optimal algorithm for performing…

Machine Learning · Statistics 2022-03-14 Subhojyoti Mukherjee , Ardhendu Tripathy , Robert Nowak

Anomaly detection is widely applied in a variety of domains, involving for instance, smart home systems, network traffic monitoring, IoT applications and sensor networks. In this paper, we study deep reinforcement learning based active…

Machine Learning · Computer Science 2019-08-29 Chen Zhong , M. Cenk Gursoy , Senem Velipasalar

Optimal control of complex environments with robotic systems faces two complementary and intertwined challenges: efficient organization of sensory state information and far-sighted action planning. Because the reinforcement learning…

Machine Learning · Computer Science 2026-01-30 Abdullah Akgül , Gulcin Baykal , Manuel Haußmann , Mustafa Mert Çelikok , Melih Kandemir

Uncertainty is ubiquitous in games, both in the agents playing games and often in the games themselves. Working with uncertainty is therefore an important component of successful deep reinforcement learning agents. While there has been…

Machine Learning · Computer Science 2022-08-22 Owen Lockwood , Mei Si

We address the problem of reinforcement learning in which observations may exhibit an arbitrary form of stochastic dependence on past observations and actions, i.e. environments more general than (PO)MDPs. The task for an agent is to attain…

Machine Learning · Computer Science 2009-12-30 Daniil Ryabko , Marcus Hutter

Active recognition enables robots to intelligently explore novel observations, thereby acquiring more information while circumventing undesired viewing conditions. Recent approaches favor learning policies from simulated or collected data,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Lei Fan , Mingfu Liang , Yunxuan Li , Gang Hua , Ying Wu

It is common to implicitly assume access to intelligently captured inputs (e.g., photos from a human photographer), yet autonomously capturing good observations is itself a major challenge. We address the problem of learning to look around:…

Computer Vision and Pattern Recognition · Computer Science 2017-12-22 Dinesh Jayaraman , Kristen Grauman

We investigate active learning in the context of deep neural network models for change detection and map updating. Active learning is a natural choice for a number of remote sensing tasks, including the detection of local surface changes:…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Vít Růžička , Stefano D'Aronco , Jan Dirk Wegner , Konrad Schindler

A major problem in machine learning is that of inductive bias: how to choose a learner's hypothesis space so that it is large enough to contain a solution to the problem being learnt, yet small enough to ensure reliable generalization from…

Artificial Intelligence · Computer Science 2011-06-02 J. Baxter

This paper investigates the automatic exploration problem under the unknown environment, which is the key point of applying the robotic system to some social tasks. The solution to this problem via stacking decision rules is impossible to…

Robotics · Computer Science 2020-07-24 Haoran Li , Qichao Zhang , Dongbin Zhao

In reinforcement learning (RL), agents often operate in partially observed and uncertain environments. Model-based RL suggests that this is best achieved by learning and exploiting a probabilistic model of the world. 'Active inference' is…

Machine Learning · Computer Science 2019-11-26 Alexander Tschantz , Manuel Baltieri , Anil. K. Seth , Christopher L. Buckley

We propose a general framework for constructing powerful, sequential hypothesis tests for a large class of nonparametric testing problems. The null hypothesis for these problems is defined in an abstract form using the action of two known…

Machine Learning · Statistics 2023-10-31 Teodora Pandeva , Patrick Forré , Aaditya Ramdas , Shubhanshu Shekhar

Traditional reinforcement learning agents learn from experience, past or present, gained through interaction with their environment. Our approach synthesizes experience, without requiring an agent to interact with their environment, by…

Machine Learning · Computer Science 2019-03-01 Chris R. Serrano , Michael A. Warren

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

Many active learning methods belong to the retraining-based approaches, which select one unlabeled instance, add it to the training set with its possible labels, retrain the classification model, and evaluate the criteria that we base our…

Machine Learning · Statistics 2017-03-01 Yazhou Yang , Marco Loog

We present and analyze an agnostic active learning algorithm that works without keeping a version space. This is unlike all previous approaches where a restricted set of candidate hypotheses is maintained throughout learning, and only…

Machine Learning · Computer Science 2010-06-15 Alina Beygelzimer , Daniel Hsu , John Langford , Tong Zhang

The utility of learning a dynamics/world model of the environment in reinforcement learning has been shown in a many ways. When using neural networks, however, these models suffer catastrophic forgetting when learned in a lifelong or…

Machine Learning · Computer Science 2019-06-12 Nicholas Ketz , Soheil Kolouri , Praveen Pilly

Many real-world domains require safe decision making in uncertain environments. In this work, we introduce a deep reinforcement learning framework for approaching this important problem. We consider a distribution over transition models,…

Machine Learning · Computer Science 2023-10-27 James Queeney , Mouhacine Benosman
‹ Prev 1 2 3 10 Next ›