English
Related papers

Related papers: Learning from partial correction

200 papers

Imitation learning is a proven method for creating a policy in the absence of rewards, by leveraging expert demonstrations. In this work, we apply imitation learning to conversation. In doing so, we recover a policy capable of talking to a…

Computation and Language · Computer Science 2025-08-19 Noah Kasmanoff , Rahul Zalkikar

We consider an online regression setting in which individuals adapt to the regression model: arriving individuals are aware of the current model, and invest strategically in modifying their own features so as to improve the predicted score…

Machine Learning · Computer Science 2021-03-02 Yahav Bechavod , Katrina Ligett , Zhiwei Steven Wu , Juba Ziani

Instruct models, obtained from various instruction tuning or post-training steps, are commonly deemed superior and more usable than their base counterpart. While the model gains instruction following ability, instruction tuning may lead to…

Computation and Language · Computer Science 2025-09-23 Ozan İrsoy , Pengxiang Cheng , Jennifer L. Chen , Daniel Preoţiuc-Pietro , Shiyue Zhang , Duccio Pappadopulo

Imitation learning enables autonomous agents to learn from human examples, without the need for a reward signal. Still, if the provided dataset does not encapsulate the task correctly, or when the task is too complex to be modeled, such…

Artificial Intelligence · Computer Science 2024-06-10 Federico Malato , Ville Hautamaki

Both empirical and mathematical demonstrations of the importance of chance-corrected measures are discussed, and a new model of learning is proposed based on empirical psychological results on association learning. Two forms of this model…

Neural and Evolutionary Computing · Computer Science 2020-10-29 David M W Powers

Partial-label learning is a kind of weakly-supervised learning with inexact labels, where for each training example, we are given a set of candidate labels instead of only one true label. Recently, various approaches on partial-label…

Machine Learning · Computer Science 2022-08-30 Zhenguo Wu , Jiaqi Lv , Masashi Sugiyama

The paper presents a novel model-based method for intelligent tutoring, with particular emphasis on the problem of selecting teaching interventions in interaction with humans. Whereas previous work has focused on either personalization of…

Human-Computer Interaction · Computer Science 2021-02-22 Aurélien Nioche , Pierre-Alexandre Murena , Carlos de la Torre-Ortiz , Antti Oulasvirta

We consider two federated learning algorithms for training partially personalized models, where the shared and personal parameters are updated either simultaneously or alternately on the devices. Both algorithms have been proposed in the…

Machine Learning · Computer Science 2022-08-17 Krishna Pillutla , Kshitiz Malik , Abdelrahman Mohamed , Michael Rabbat , Maziar Sanjabi , Lin Xiao

Incremental learning is the ability of systems to acquire knowledge over time, enabling their adaptation and generalization to novel tasks. It is a critical ability for intelligent, real-world systems, especially when data changes…

Machine Learning · Computer Science 2025-09-03 Mladjan Jovanovic , Peter Voss

In order to model an efficient learning paradigm, iterative learning algorithms access data one by one, updating the current hypothesis without regress to past data. Past research on iterative learning analyzed for example many important…

Machine Learning · Computer Science 2021-04-29 Ardalan Khazraei , Timo Kötzing , Karen Seidel

This paper investigates the role of tutor feedback in language learning using computational models. We compare two dominant paradigms in language learning: interactive learning and cross-situational learning - which differ primarily in the…

Computation and Language · Computer Science 2018-12-05 Jens Nevens , Michael Spranger

While many methods purport to explain predictions by highlighting salient features, what aims these explanations serve and how they ought to be evaluated often go unstated. In this work, we introduce a framework to quantify the value of…

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

Machine Learning · Computer Science 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

We study a framework where agents have to avoid aversive signals. The agents are given only partial information, in the form of features that are projections of task states. Additionally, the agents have to cope with non-determinism,…

Artificial Intelligence · Computer Science 2016-05-17 Tom J. Ameloot

We present a novel interactive learning protocol that enables training request-fulfilling agents by verbally describing their activities. Unlike imitation learning (IL), our protocol allows the teaching agent to provide feedback in a…

Computation and Language · Computer Science 2021-06-16 Khanh Nguyen , Dipendra Misra , Robert Schapire , Miro Dudík , Patrick Shafto

Research demonstrates learners engaging in the process of producing explanations to support their reasoning, can have a positive impact on learning. However, providing learners real-time explanatory feedback often presents challenges…

Computation and Language · Computer Science 2023-06-28 Jionghao Lin , Danielle R. Thomas , Feifei Han , Shivang Gupta , Wei Tan , Ngoc Dang Nguyen , Kenneth R. Koedinger

Online learning with expert advice is widely used in various machine learning tasks. It considers the problem where a learner chooses one from a set of experts to take advice and make a decision. In many learning problems, experts may be…

Machine Learning · Computer Science 2021-06-17 Pouya M Ghari , Yanning Shen

We present a new method for automatically providing feedback for introductory programming problems. In order to use this method, we need a reference implementation of the assignment, and an error model consisting of potential corrections to…

Programming Languages · Computer Science 2012-11-19 Rishabh Singh , Sumit Gulwani , Armando Solar-Lezama

In this paper, we study a variant of the framework of online learning using expert advice with limited/bandit feedback. We consider each expert as a learning entity, seeking to more accurately reflecting certain real-world applications. In…

Machine Learning · Computer Science 2017-02-21 Adish Singla , Hamed Hassani , Andreas Krause

Machine teaching studies the interaction between a teacher and a student/learner where the teacher selects training examples for the learner to learn a specific task. The typical assumption is that the teacher has perfect knowledge of the…

Machine Learning · Computer Science 2020-03-24 Rati Devidze , Farnam Mansouri , Luis Haug , Yuxin Chen , Adish Singla