English
Related papers

Related papers: Amortized nonmyopic active search via deep imitati…

200 papers

Leveraging the wealth of unlabeled data produced in recent years provides great potential for improving supervised models. When the cost of acquiring labels is high, probabilistic active learning methods can be used to greedily select the…

Machine Learning · Statistics 2021-02-09 Robert Pinsler , Jonathan Gordon , Eric Nalisnick , José Miguel Hernández-Lobato

Deep Policy Gradient (PG) algorithms employ value networks to drive the learning of parameterized policies and reduce the variance of the gradient estimates. However, value function approximation gets stuck in local optima and struggles to…

Machine Learning · Computer Science 2023-02-21 Enrico Marchesini , Christopher Amato

When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Learning Bayesian networks is often cast as an optimization problem, where the computational task is to find a structure that maximizes a statistically motivated score. By and large, existing learning tools address this optimization problem…

Machine Learning · Computer Science 2013-01-30 Nir Friedman , Iftach Nachman , Dana Pe'er

We present Causal Amortized Active Structure Learning (CAASL), an active intervention design policy that can select interventions that are adaptive, real-time and that does not require access to the likelihood. This policy, an amortized…

Machine Learning · Computer Science 2024-05-28 Yashas Annadani , Panagiotis Tigas , Stefan Bauer , Adam Foster

The demands on visual recognition systems do not end with the complexity offered by current large-scale image datasets, such as ImageNet. In consequence, we need curious and continuously learning algorithms that actively acquire knowledge…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Christoph Käding , Erik Rodner , Alexander Freytag , Joachim Denzler

Deep active learning aims to reduce the annotation cost for the training of deep models, which is notoriously data-hungry. Until recently, deep active learning methods were ineffectual in the low-budget regime, where only a small number of…

Machine Learning · Computer Science 2023-12-29 Ofer Yehuda , Avihu Dekel , Guy Hacohen , Daphna Weinshall

Science and Engineering applications are typically associated with expensive optimization problems to identify optimal design solutions and states of the system of interest. Bayesian optimization and active learning compute surrogate models…

Machine Learning · Computer Science 2024-07-09 Francesco Di Fiore , Michela Nardelli , Laura Mainini

We consider a problem of learning the reward and policy from expert examples under unknown dynamics. Our proposed method builds on the framework of generative adversarial networks and introduces the empowerment-regularized maximum-entropy…

Machine Learning · Computer Science 2019-02-26 Ahmed H. Qureshi , Byron Boots , Michael C. Yip

In this paper, we consider active information acquisition when the prediction model is meant to be applied on a targeted subset of the population. The goal is to label a pre-specified fraction of customers in the target or test set by…

Artificial Intelligence · Computer Science 2014-03-17 Sneha Chaudhari , Pankaj Dayama , Vinayaka Pandit , Indrajit Bhattacharya

We consider the problem of imitation learning under misspecification: settings where the learner is fundamentally unable to replicate expert behavior everywhere. This is often true in practice due to differences in observation space and…

Machine Learning · Computer Science 2025-04-03 Nicolas Espinosa-Dice , Sanjiban Choudhury , Wen Sun , Gokul Swamy

Active learning enables efficient model training by leveraging interactions between machine learning agents and human annotators. We study and propose a novel framework that formulates batch active learning from the sparse approximation's…

Machine Learning · Computer Science 2022-11-08 Maohao Shen , Bowen Jiang , Jacky Yibo Zhang , Oluwasanmi Koyejo

We introduce a new class of distributed algorithms for the approximate consensus problem in dynamic rooted networks, which we call amortized averaging algorithms. They are deduced from ordinary averaging algorithms by adding a…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-12-15 Bernadette Charron-Bost , Matthias Függer , Thomas Nowak

Bayesian inference usually requires running potentially costly inference procedures separately for every new observation. In contrast, the idea of amortized Bayesian inference is to initially invest computational cost in training an…

Machine Learning · Computer Science 2023-05-25 Manuel Glöckler , Michael Deistler , Jakob H. Macke

We apply recent advances in deep generative modeling to the task of imitation learning from biological agents. Specifically, we apply variations of the variational recurrent neural network model to a multi-agent setting where we learn…

Machine Learning · Computer Science 2020-07-02 Michael Teng , Tuan Anh Le , Adam Scibior , Frank Wood

The decision and planning system for autonomous driving in urban environments is hard to design. Most current methods manually design the driving policy, which can be expensive to develop and maintain at scale. Instead, with imitation…

Robotics · Computer Science 2019-10-15 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

In this paper, we propose to utilize Automated Machine Learning to adaptively search a neural architecture for deepfake detection. This is the first time to employ automated machine learning for deepfake detection. Based on our explored…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Ping Liu , Yuewei Lin , Yang He , Yunchao Wei , Liangli Zhen , Joey Tianyi Zhou , Rick Siow Mong Goh , Jingen Liu

The remarkable performance of deep neural networks depends on the availability of massive labeled data. To alleviate the load of data annotation, active deep learning aims to select a minimal set of training points to be labelled which…

Machine Learning · Computer Science 2020-03-24 Dan Kushnir , Luca Venturi

Finding an effective medical treatment often requires a search by trial and error. Making this search more efficient by minimizing the number of unnecessary trials could lower both costs and patient suffering. We formalize this problem as…

Machine Learning · Computer Science 2021-02-18 Samuel Håkansson , Viktor Lindblom , Omer Gottesman , Fredrik D. Johansson

We propose a general framework for sequential and dynamic acquisition of useful information in order to solve a particular task. While our goal could in principle be tackled by general reinforcement learning, our particular setting is…

Machine Learning · Statistics 2016-02-09 He He , Paul Mineiro , Nikos Karampatziakis