English
Related papers

Related papers: A General Framework for Robust Interactive Learnin…

200 papers

We investigate Reinforcement Learning from Human Feedback (RLHF) in the context of a general preference oracle. In particular, we do not assume the existence of a reward function and an oracle preference signal drawn from the Bradley-Terry…

Machine Learning · Computer Science 2024-11-13 Chenlu Ye , Wei Xiong , Yuheng Zhang , Hanze Dong , Nan Jiang , Tong Zhang

While neural models show remarkable accuracy on individual predictions, their internal beliefs can be inconsistent across examples. In this paper, we formalize such inconsistency as a generalization of prediction error. We propose a…

Artificial Intelligence · Computer Science 2019-09-16 Tao Li , Vivek Gupta , Maitrey Mehta , Vivek Srikumar

Lifelong learning can be viewed as a continuous transfer learning procedure over consecutive tasks, where learning a given task depends on accumulated knowledge --- the so-called knowledge base. Most published work on lifelong learning…

Machine Learning · Statistics 2018-10-30 Changjian Shui , Ihsen Hedhli , Christian Gagné

Continual learning refers to the capability of a machine learning model to learn and adapt to new information, without compromising its performance on previously learned tasks. Although several studies have investigated continual learning…

Information Retrieval · Computer Science 2024-06-21 Jingrui Hou , Georgina Cosma , Axel Finke

Even the best information retrieval model cannot always identify the most useful answers to a user query. This is in particular the case with web search systems, where it is known that users tend to minimise their effort to access relevant…

Information Retrieval · Computer Science 2009-06-23 B. Piwowarski , M. Lalmas

Interactive reinforcement learning has shown promise in learning complex robotic tasks. However, the process can be human-intensive due to the requirement of a large amount of interactive feedback. This paper presents a new method that uses…

Robotics · Computer Science 2023-08-08 Shukai Liu , Chenming Wu , Ying Li , Liangjun Zhang

Large-scale datasets have been pivotal to the advancements of deep learning models in recent years, but training on such large datasets invariably incurs substantial storage and computational overhead. Meanwhile, real-world datasets often…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Suorong Yang , Peng Ye , Wanli Ouyang , Dongzhan Zhou , Furao Shen

During the past decade, model-based recommendation methods have evolved from latent factor models to neural network-based models. Most of these techniques mainly focus on improving the overall performance, such as the root mean square error…

Information Retrieval · Computer Science 2018-08-17 Feng Yuan , Lina Yao , Boualem Benatallah

We propose an algorithm for incremental learning of classifiers. The proposed method enables an ensemble of classifiers to learn incrementally by accommodating new training data. We use an effective mechanism to overcome the…

Machine Learning · Computer Science 2019-02-11 Shivang Agarwal , C. Ravindranath Chowdary , Shripriya Maheshwari

Each year, deep learning demonstrates new and improved empirical results with deeper and wider neural networks. Meanwhile, with existing theoretical frameworks, it is difficult to analyze networks deeper than two layers without resorting to…

Machine Learning · Computer Science 2023-03-28 Hong Jun Jeon , Yifan Zhu , Benjamin Van Roy

Developing a universal model that can efficiently and effectively respond to a wide range of information access requests -- from retrieval to recommendation to question answering -- has been a long-lasting goal in the information retrieval…

Information Retrieval · Computer Science 2023-04-27 Hansi Zeng , Surya Kallumadi , Zaid Alibadi , Rodrigo Nogueira , Hamed Zamani

Discovering relevant patterns for a particular user remains a challenging tasks in data mining. Several approaches have been proposed to learn user-specific pattern ranking functions. These approaches generalize well, but at the expense of…

Artificial Intelligence · Computer Science 2022-03-08 Nassim Belmecheri , Noureddine Aribi , Nadjib Lazaar , Yahia Lebbah , Samir Loudni

We introduce a new convolutional AutoEncoder architecture for user modelling and recommendation tasks with several improvements over the state of the art. Firstly, our model has the flexibility to learn a set of associations and…

Machine Learning · Computer Science 2025-09-10 Antoine Ledent , Petr Kasalický , Rodrigo Alves , Hady W. Lauw

The exploration of whether agents can align with their environment without relying on human-labeled data presents an intriguing research topic. Drawing inspiration from the alignment process observed in intelligent organisms, where…

Computation and Language · Computer Science 2024-03-06 Bo Wang , Tianxiang Sun , Hang Yan , Siyin Wang , Qingyuan Cheng , Xipeng Qiu

We present a general framework for evolutionary learning to emergent unbiased state representation without any supervision. Evolutionary frameworks such as self-play converge to bad local optima in case of multi-agent reinforcement learning…

Machine Learning · Statistics 2023-02-03 Shohei Ohsawa

In the vision and language navigation task, the agent may encounter ambiguous situations that are hard to interpret by just relying on visual information and natural language instructions. We propose an interactive learning framework to…

Artificial Intelligence · Computer Science 2019-12-03 Ta-Chung Chi , Mihail Eric , Seokhwan Kim , Minmin Shen , Dilek Hakkani-tur

User preferences for items can be inferred from either explicit feedback, such as item ratings, or implicit feedback, such as rental histories. Research in collaborative filtering has concentrated on explicit feedback, resulting in the…

Machine Learning · Computer Science 2015-03-19 Andriy Mnih , Yee Whye Teh

Precise control in modern robotic applications is always an open issue due to unknown time-varying disturbances. Existing meta-learning-based approaches require a shared representation of environmental structures, which lack flexibility for…

Robotics · Computer Science 2026-04-16 Zihan Yang , Jindou Jia , Meng Wang , Yuhang Liu , Kexin Guo , Xiang Yu

The ability of artificial agents to increment their capabilities when confronted with new data is an open challenge in artificial intelligence. The main challenge faced in such cases is catastrophic forgetting, i.e., the tendency of neural…

Machine Learning · Computer Science 2020-12-16 Eden Belouadah , Adrian Popescu , Ioannis Kanellos

An interactive robot framework accomplishes long-horizon task planning and can easily generalize to new goals and distinct tasks, even during execution. However, most traditional methods require predefined module design, making it hard to…

Robotics · Computer Science 2025-02-11 Boyi Li , Philipp Wu , Pieter Abbeel , Jitendra Malik