English
Related papers

Related papers: Active Automata Learning with Advice

200 papers

In this survey we present different approaches that allow an intelligent agent to explore autonomous its environment to gather information and learn multiple tasks. Different communities proposed different solutions, that are in many cases,…

Artificial Intelligence · Computer Science 2014-03-07 Manuel Lopes , Luis Montesano

In machine learning, classification is usually seen as a function approximation problem, where the goal is to learn a function that maps input features to class labels. In this paper, we propose a novel clustering and classification…

Machine Learning · Computer Science 2025-02-25 Hrushikesh Mhaskar , Ryan O'Dowd , Efstratios Tsoukanis

Active learning aims to reduce the high labeling cost involved in training machine learning models on large datasets by efficiently labeling only the most informative samples. Recently, deep active learning has shown success on various…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Sudhanshu Mittal , Maxim Tatarchenko , Özgün Çiçek , Thomas Brox

We analyze the language learned by an agent trained with reinforcement learning as a component of the ActiveQA system [Buck et al., 2017]. In ActiveQA, question answering is framed as a reinforcement learning task in which an agent sits…

Computation and Language · Computer Science 2018-01-24 Christian Buck , Jannis Bulian , Massimiliano Ciaramita , Wojciech Gajewski , Andrea Gesmundo , Neil Houlsby , Wei Wang

We propose a framework for ensuring safe behavior of a reinforcement learning agent when the reward function may be difficult to specify. In order to do this, we rely on the existence of demonstrations from expert policies, and we provide a…

Machine Learning · Computer Science 2018-11-22 Jessie Huang , Fa Wu , Doina Precup , Yang Cai

High accuracy medical image classification can be limited by the costs of acquiring more data as well as the time and expertise needed to label existing images. In this paper, we apply active learning to medical image classification, a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Emma Slade , Kim M. Branson

One of the main questions concerning learning in Multi-Agent Systems is: (How) can agents benefit from mutual interaction during the learning process?. This paper describes the study of an interactive advice-exchange mechanism as a possible…

Machine Learning · Computer Science 2007-05-23 L. Nunes , E. Oliveira

Action advising is a knowledge transfer technique for reinforcement learning based on the teacher-student paradigm. An expert teacher provides advice to a student during training in order to improve the student's sample efficiency and…

Artificial Intelligence · Computer Science 2023-06-19 Yue Guo , Joseph Campbell , Simon Stepputtis , Ruiyu Li , Dana Hughes , Fei Fang , Katia Sycara

Reward learning techniques enable machine learning systems to learn objectives from human feedback. A core limitation of these systems is their assumption that all feedback comes from a single human teacher, despite gathering feedback from…

Artificial Intelligence · Computer Science 2026-05-11 Rachel Freedman , Justin Svegliato , Kyle Wray , Stuart Russell

A multiagent sequential decision problem has been seen in many critical applications including urban transportation, autonomous driving cars, military operations, etc. Its widely known solution, namely multiagent reinforcement learning, has…

Artificial Intelligence · Computer Science 2024-10-29 Yanyu Liu , Yinghui Pan , Yifeng Zeng , Biyang Ma , Doshi Prashant

The recent advances in computer-assisted learning systems and the availability of open educational resources today promise a pathway to providing cost-efficient, high-quality education to large masses of learners. One of the most ambitious…

Artificial Intelligence · Computer Science 2019-11-22 Sahan Bulathwela , Maria Perez-Ortiz , Emine Yilmaz , John Shawe-Taylor

Automata learning is a technique that has successfully been applied in verification, with the automaton type varying depending on the application domain. Adaptations of automata learning algorithms for increasingly complex types of automata…

Formal Languages and Automata Theory · Computer Science 2017-06-27 Gerco van Heerdt , Matteo Sammartino , Alexandra Silva

The ubiquity of implicit feedback makes it indispensable for building recommender systems. However, it does not actually reflect the actual satisfaction of users. For example, in E-commerce, a large portion of clicks do not translate to…

Information Retrieval · Computer Science 2021-12-03 Wenjie Wang , Fuli Feng , Xiangnan He , Liqiang Nie , Tat-Seng Chua

Modern learning systems increasingly rely on amortized learning - the idea of reusing computation or inductive biases shared across tasks to enable rapid generalization to novel problems. This principle spans a range of approaches,…

Machine Learning · Computer Science 2025-10-14 Sarthak Mittal , Divyat Mahajan , Guillaume Lajoie , Mohammad Pezeshki

Teaching an agent to perform new tasks using natural language can easily be hindered by ambiguities in interpretation. When a teacher provides an instruction to a learner about an object by referring to its features, the learner can…

Machine Learning · Computer Science 2023-09-28 Hugo Caselles-Dupré , Olivier Sigaud , Mohamed Chetouani

Reinforcement learning agents can learn to solve sequential decision tasks by interacting with the environment. Human knowledge of how to solve these tasks can be incorporated using imitation learning, where the agent learns to imitate…

Artificial Intelligence · Computer Science 2019-09-24 Ruohan Zhang , Faraz Torabi , Lin Guan , Dana H. Ballard , Peter Stone

Active learning methods aim to improve sample complexity in machine learning. In this work, we investigate an active learning scheme via a novel gradient-free cutting-plane training method for ReLU networks of arbitrary depth and develop a…

Machine Learning · Computer Science 2025-06-26 Erica Zhang , Fangzhao Zhang , Mert Pilanci

We examine inkdots placed on the input string as a way of providing advice to finite automata, and establish the relations between this model and the previously studied models of advised finite automata. The existence of an infinite…

Formal Languages and Automata Theory · Computer Science 2023-06-22 Uğur Küçük , A. C. Cem Say , Abuzer Yakaryılmaz

We present Machine Assistant with Reliable Knowledge (MARK), a retrieval-augmented question-answering system designed to support student learning through accurate and contextually grounded responses. The system is built on a…

Information Retrieval · Computer Science 2025-07-01 Yongsheng Lian

Active learning shows promise to decrease test bench time for model-based drivability calibration. This paper presents a new strategy for active output selection, which suits the needs of calibration tasks. The strategy is actively learning…

Machine Learning · Computer Science 2021-02-24 Adrian Prochaska , Julien Pillas , Bernard Bäker