中文
相关论文

相关论文: Evaluating the Robustness of Learning from Implici…

200 篇论文

Sequential recommenders have been widely used in industry due to their strength in modeling user preferences. While these models excel at learning a user's positive interests, less attention has been paid to learning from negative user…

It is often difficult to hand-specify what the correct reward function is for a task, so researchers have instead aimed to learn reward functions from human behavior or feedback. The types of behavior interpreted as evidence of the reward…

机器学习 · 计算机科学 2020-12-14 Hong Jun Jeon , Smitha Milli , Anca D. Dragan

In the implicit feedback recommendation, incorporating short-term preference into recommender systems has attracted increasing attention in recent years. However, unexpected behaviors in historical interactions like clicking some items by…

人工智能 · 计算机科学 2021-12-22 Jie Chen , Lifen Jiang , Chunmei Ma , Huazhi Sun

Modern technologies are producing datasets with complex intrinsic structures, and they can be naturally represented as matrices instead of vectors. To preserve the latent data structures during processing, modern regression approaches…

机器学习 · 计算机科学 2016-11-16 Hang Zhang , Fengyuan Zhu , Shixin Li

Learning from implicit feedback is one of the most common cases in the application of recommender systems. Generally speaking, interacted examples are considered as positive while negative examples are sampled from uninteracted ones.…

信息检索 · 计算机科学 2022-03-15 Yu Wang , Xin Xin , Zaiqiao Meng , Xiangnan He , Joemon Jose , Fuli Feng

Modeling visual search not only offers an opportunity to predict the usability of an interface before actually testing it on real users, but also advances scientific understanding about human behavior. In this work, we first conduct a set…

人机交互 · 计算机科学 2020-05-11 Arianna Yuan , Yang Li

Gradient-based deep-learning algorithms exhibit remarkable performance in practice, but it is not well-understood why they are able to generalize despite having more parameters than training examples. It is believed that implicit bias is a…

机器学习 · 计算机科学 2022-11-08 Gal Vardi

Deep Learning has revolutionized machine learning and artificial intelligence, achieving superhuman performance in several standard benchmarks. It is well-known that deep learning models are inefficient to train; they learn by processing…

机器学习 · 计算机科学 2021-12-03 Fartash Faghri

Widespread deployment of societal-scale machine learning systems necessitates a thorough understanding of the resulting long-term effects these systems have on their environment, including loss of trustworthiness, bias amplification, and…

机器学习 · 计算机科学 2024-05-07 Andrey Veprikov , Alexander Afanasiev , Anton Khritankov

The Relevance Feedback (RF) process relies on accurate and real-time relevance estimation of feedback documents to improve retrieval performance. Since collecting explicit relevance annotations imposes an extra burden on the user, extensive…

人工智能 · 计算机科学 2023-12-12 Ziyi Ye , Xiaohui Xie , Qingyao Ai , Yiqun Liu , Zhihong Wang , Weihang Su , Min Zhang

Showing items that do not match search query intent degrades customer experience in e-commerce. These mismatches result from counterfactual biases of the ranking algorithms toward noisy behavioral signals such as clicks and purchases in the…

计算与语言 · 计算机科学 2020-05-08 Thanh V. Nguyen , Nikhil Rao , Karthik Subbian

Integration of human feedback plays a key role in improving the learning capabilities of intelligent systems. This comparative study delves into the performance, robustness, and limitations of imitation learning compared to traditional…

机器学习 · 计算机科学 2024-10-30 Amr Gomaa , Bilal Mahdy

Instruction tuning has emerged as a paramount method for tailoring the behaviors of LLMs. Recent work has unveiled the potential for LLMs to achieve high performance through fine-tuning with a limited quantity of high-quality instruction…

人工智能 · 计算机科学 2025-04-01 Qiang Wang , Dawei Feng , Xu Zhang , Ao Shen , Yang Xu , Bo Ding , Huaimin Wang

With the continuous development of machine learning technology, major e-commerce platforms have launched recommendation systems based on it to serve a large number of customers with different needs more efficiently. Compared with…

机器学习 · 计算机科学 2020-12-14 Yang Yu , Zhenhao Gu , Rong Tao , Jingtian Ge , Kenglun Chang

A trustworthy reinforcement learning algorithm should be competent in solving challenging real-world problems, including {robustly} handling uncertainties, satisfying {safety} constraints to avoid catastrophic failures, and {generalizing}…

机器学习 · 计算机科学 2022-09-19 Mengdi Xu , Zuxin Liu , Peide Huang , Wenhao Ding , Zhepeng Cen , Bo Li , Ding Zhao

While Machine learning gives rise to astonishing results in automated systems, it is usually at the cost of large data requirements. This makes many successful algorithms from machine learning unsuitable for human-machine interaction, where…

人机交互 · 计算机科学 2021-09-30 Jan Philip Göpfert , Ulrike Kuhl , Lukas Hindemith , Heiko Wersing , Barbara Hammer

In order for agents trained by deep reinforcement learning to work alongside humans in realistic settings, we will need to ensure that the agents are \emph{robust}. Since the real world is very diverse, and human behavior often changes in…

机器学习 · 计算机科学 2021-01-15 Paul Knott , Micah Carroll , Sam Devlin , Kamil Ciosek , Katja Hofmann , A. D. Dragan , Rohin Shah

This paper considers an online reinforcement learning algorithm that leverages pre-collected data (passive memory) from the environment for online interaction. We show that using passive memory improves performance and further provide…

机器学习 · 计算机科学 2024-10-21 Anay Pattanaik , Lav R. Varshney

Beyond effectiveness, the robustness of an information retrieval (IR) system is increasingly attracting attention. When deployed, a critical technology such as IR should not only deliver strong performance on average but also have the…

信息检索 · 计算机科学 2024-06-14 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke

This paper studies the problem of learning interactive recommender systems from logged feedbacks without any exploration in online environments. We address the problem by proposing a general offline reinforcement learning framework for…

机器学习 · 计算机科学 2023-10-03 Teng Xiao , Donglin Wang