English
Related papers

Related papers: Explainable Active Learning for Preference Elicita…

200 papers

Learning the preferences of a human improves the quality of the interaction with the human. The number of queries available to learn preferences maybe limited especially when interacting with a human, and so active learning is a must. One…

Machine Learning · Computer Science 2020-02-18 Sriram Gopalakrishnan , Utkarsh Soni

Interactive NLP is a promising paradigm to close the gap between automatic NLP systems and the human upper bound. Preference-based interactive learning has been successfully applied, but the existing methods require several thousand…

Computation and Language · Computer Science 2019-06-10 Yang Gao , Christian M. Meyer , Iryna Gurevych

The abundance of information in web applications make recommendation essential for users as well as applications. Despite the effectiveness of existing recommender systems, we find two major limitations that reduce their overall…

Information Retrieval · Computer Science 2020-09-01 Dilruk Perera , Roger Zimmermann

Convolutional Neural Networks (CNNs) have proven to be state-of-the-art models for supervised computer vision tasks, such as image classification. However, large labeled data sets are generally needed for the training and validation of such…

Machine Learning · Computer Science 2020-10-28 Patrick Hemmer , Niklas Kühl , Jakob Schöffer

This paper studies recommender systems with knowledge graphs, which can effectively address the problems of data sparsity and cold start. Recently, a variety of methods have been developed for this problem, which generally try to learn…

Information Retrieval · Computer Science 2022-01-10 Weiping Song , Zhijian Duan , Ziqing Yang , Hao Zhu , Ming Zhang , Jian Tang

Real-world domain experts (e.g., doctors) rarely annotate only a decision label in their day-to-day workflow without providing explanations. Yet, existing low-resource learning techniques, such as Active Learning (AL), that aim to support…

Computation and Language · Computer Science 2023-10-24 Bingsheng Yao , Ishan Jindal , Lucian Popa , Yannis Katsis , Sayan Ghosh , Lihong He , Yuxuan Lu , Shashank Srivastava , Yunyao Li , James Hendler , Dakuo Wang

As large language models (LLMs) become more capable, fine-tuning techniques for aligning with human intent are increasingly important. A key consideration for aligning these models is how to most effectively use human resources, or model…

Machine Learning · Computer Science 2024-07-01 William Muldrew , Peter Hayes , Mingtian Zhang , David Barber

When a new user just signs up on a website, we usually have no information about him/her, i.e. no interaction with items, no user profile and no social links with other users. Under such circumstances, we still expect our recommender…

Information Retrieval · Computer Science 2020-10-28 Yitong Meng , Jie Liu , Xiao Yan , James Cheng

We propose a general purpose active learning algorithm for structured prediction, gathering labeled data for training a model that outputs a set of related labels for an image or video. Active learning starts with a limited initial training…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Mehran Khodabandeh , Zhiwei Deng , Mostafa S. Ibrahim , Shinichi Satoh , Greg Mori

In modern recommender systems, experimental settings typically include filtering out cold users and items based on a minimum interaction threshold. However, these thresholds are often chosen arbitrarily and vary widely across studies,…

Information Retrieval · Computer Science 2025-08-12 Danil Gusak , Nikita Sukhorukov , Evgeny Frolov

In sequential recommendation, models recommend items based on user's interaction history. To this end, current models usually incorporate information such as item descriptions and user intent or preferences. User preferences are usually not…

Mitigating the new user cold-start problem has been critical in the recommendation system for online service providers to influence user experience in decision making which can ultimately affect the intention of users to use a particular…

Artificial Intelligence · Computer Science 2020-11-26 Po-Lin Lai , Chih-Yun Chen , Liang-Wei Lo , Chien-Chin Chen

As AI systems become increasingly autonomous, aligning their decision-making to human preferences is essential. In domains like autonomous driving or robotics, it is impossible to write down the reward function representing these…

Machine Learning · Computer Science 2025-01-03 Ondrej Bajgar , Sid William Gould , Rohan Narayan Langford Mitta , Jonathon Liu , Oliver Newcombe , Jack Golden

Supervised machine learning has become the cornerstone of today's data-driven society, increasing the need for labeled data. However, the process of acquiring labels is often expensive and tedious. One possible remedy is to use active…

Machine Learning · Computer Science 2023-02-22 Josip Jukić , Fran Jelenić , Miroslav Bićanić , Jan Šnajder

Providing explanations within the recommendation system would boost user satisfaction and foster trust, especially by elaborating on the reasons for selecting recommended items tailored to the user. The predominant approach in this domain…

Information Retrieval · Computer Science 2024-02-07 Yicui Peng , Hao Chen , Chingsheng Lin , Guo Huang , Jinrong Hu , Hui Guo , Bin Kong , Shu Hu , Xi Wu , Xin Wang

Conversational recommender systems (CRS) explicitly solicit users' preferences for improved recommendations on the fly. Most existing CRS solutions count on a single policy trained by reinforcement learning for a population of users.…

Artificial Intelligence · Computer Science 2023-02-17 Zhendong Chu , Hongning Wang , Yun Xiao , Bo Long , Lingfei Wu

Active learning (AL) reduces labeling cost by querying informative samples, but in tabular settings its cold-start gains are often limited because uncertainty estimates are unreliable when models are trained on very few labels. Tabular…

Machine Learning · Computer Science 2026-03-31 Wilailuck Treerath , Fabrizio Pittorino

One of the biggest challenges that complicates applied supervised machine learning is the need for huge amounts of labeled data. Active Learning (AL) is a well-known standard method for efficiently obtaining labeled data by first labeling…

Machine Learning · Computer Science 2021-08-18 Julius Gonsior , Maik Thiele , Wolfgang Lehner

Personalized alignment is crucial for enabling Large Language Models (LLMs) to engage effectively in user-centric interactions. However, current methods face a dual challenge: they fail to infer users' deep implicit preferences (including…

Artificial Intelligence · Computer Science 2026-04-29 Peiming Li , Zhiyuan Hu , Yang Tang , Shiyu Li , Xi Chen

Active learning aims to reduce labeling efforts by selectively asking humans to annotate the most important data points from an unlabeled pool and is an example of human-machine interaction. Though active learning has been extensively…

Machine Learning · Computer Science 2020-01-31 Hongjing Zhang , S. S. Ravi , Ian Davidson