English
Related papers

Related papers: Implicit Feedback for Dense Passage Retrieval: A C…

200 papers

Aligning large language models (LLMs) with human preferences is a critical challenge in AI research. While methods like Reinforcement Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO) are widely used, they often…

Computation and Language · Computer Science 2026-05-19 Xuan Qi , Rongwu Xu , Zhijing Jin

Most modern approaches to quadruped locomotion focus on using Deep Reinforcement Learning (DRL) to learn policies from scratch, in an end-to-end manner. Such methods often fail to scale, as every new problem or application requires…

Robotics · Computer Science 2025-09-29 Vassil Atanassov , Wanming Yu , Siddhant Gangapurwala , James Wilson , Ioannis Havoutis

Simulators of animal movements play a valuable role in studying behavior. Advances in imitation learning for robotics have expanded possibilities for reproducing human and animal movements. A key challenge for realistic multi-animal…

Asking clarifying questions in response to search queries has been recognized as a useful technique for revealing the underlying intent of the query. Clarification has applications in retrieval systems with different interfaces, from the…

Information Retrieval · Computer Science 2020-06-02 Hamed Zamani , Bhaskar Mitra , Everest Chen , Gord Lueck , Fernando Diaz , Paul N. Bennett , Nick Craswell , Susan T. Dumais

Dense retrieval (DR) methods conduct text retrieval by first encoding texts in the embedding space and then matching them by nearest neighbor search. This requires strong locality properties from the representation space, i.e, the close…

Information Retrieval · Computer Science 2021-10-15 Ji Xin , Chenyan Xiong , Ashwin Srinivasan , Ankita Sharma , Damien Jose , Paul N. Bennett

General contact-rich manipulation problems are long-standing challenges in robotics due to the difficulty of understanding complicated contact physics. Deep reinforcement learning (RL) has shown great potential in solving robot manipulation…

Dense retrieval (DR) approaches based on powerful pre-trained language models (PLMs) achieved significant advances and have become a key component for modern open-domain question-answering systems. However, they require large amounts of…

Computation and Language · Computer Science 2022-08-08 Xiaoyu Shen , Svitlana Vakulenko , Marco del Tredici , Gianni Barlacchi , Bill Byrne , Adrià de Gispert

Dense retrieval has become a foundational paradigm in modern search systems, especially on short-video platforms. However, most industrial systems adopt a self-reinforcing training pipeline that relies on historically exposed user…

Information Retrieval · Computer Science 2025-11-20 Ao Xie , Jiahui Chen , Quanzhi Zhu , Xiaoze Jiang , Zhiheng Qin , Enyun Yu , Han Li

In this paper, we investigate an opportunistic relaying scheme where the selected relay assists the source-destination (direct) communication. In our study, we consider a regenerative opportunistic relaying scheme in which the direct path…

Performance · Computer Science 2011-01-28 Kamel Tourki , Hong-Chuan Yang , Mohamed-Slim Alouni

Recently, dense passage retrieval has become a mainstream approach to finding relevant information in various natural language processing tasks. A number of studies have been devoted to improving the widely adopted dual-encoder…

Information Retrieval · Computer Science 2023-04-25 Ruiyang Ren , Shangwen Lv , Yingqi Qu , Jing Liu , Wayne Xin Zhao , QiaoQiao She , Hua Wu , Haifeng Wang , Ji-Rong Wen

Text-based interactive recommendation provides richer user feedback and has demonstrated advantages over traditional interactive recommender systems. However, recommendations can easily violate preferences of users from their past…

Computation and Language · Computer Science 2020-05-05 Ruiyi Zhang , Tong Yu , Yilin Shen , Hongxia Jin , Changyou Chen , Lawrence Carin

This paper is an extended version of [Burashnikova et al., 2021, arXiv: 2012.06910], where we proposed a theoretically supported sequential strategy for training a large-scale Recommender System (RS) over implicit feedback, mainly in the…

Information Retrieval · Computer Science 2022-03-01 Aleksandra Burashnikova , Yury Maximov , Marianne Clausel , Charlotte Laclau , Franck Iutzeler , Massih-Reza Amini

Many Information Retrieval (IR) models make use of offline statistical techniques to score documents for ranking over a single period, rather than use an online, dynamic system that is responsive to users over time. In this paper, we…

Information Retrieval · Computer Science 2013-03-22 Marc Sloan , Jun Wang

Reinforcement learning has produced remarkable advances in humanoid locomotion, yet a fundamental dilemma persists for real-world deployment: policies must choose between the robustness of reactive proprioceptive control or the proactivity…

Robotics · Computer Science 2025-09-17 Yidan Lu , Rurui Yang , Qiran Kou , Mengting Chen , Tao Fan , Peter Cui , Yinzhao Dong , Peng Lu

Machine learning models are prone to capturing the spurious correlations between non-causal attributes and classes, with counterfactual data augmentation being a promising direction for breaking these spurious associations. However,…

Machine Learning · Computer Science 2025-07-11 Xiaoling Zhou , Ou Wu , Michael K. Ng

We investigate the exploitation of both lexical and neural relevance signals for ad-hoc passage retrieval. Our exploration involves a large-scale training dataset in which dense neural representations of MS-MARCO queries and passages are…

Information Retrieval · Computer Science 2025-10-21 Franco Maria Nardini , Raffaele Perego , Nicola Tonellotto , Salvatore Trani

Developing a universal model that can efficiently and effectively respond to a wide range of information access requests -- from retrieval to recommendation to question answering -- has been a long-lasting goal in the information retrieval…

Information Retrieval · Computer Science 2023-04-27 Hansi Zeng , Surya Kallumadi , Zaid Alibadi , Rodrigo Nogueira , Hamed Zamani

Selection bias is prevalent in the data for training and evaluating recommendation systems with explicit feedback. For example, users tend to rate items they like. However, when rating an item concerning a specific user, most of the…

Information Retrieval · Computer Science 2021-09-14 Weishen Pan , Sen Cui , Hongyi Wen , Kun Chen , Changshui Zhang , Fei Wang

Sequential Recommender Systems (SRSs) have demonstrated remarkable effectiveness in capturing users' evolving preferences. However, their inherent complexity as "black box" models poses significant challenges for explainability. This work…

Information Retrieval · Computer Science 2025-08-06 Domiziano Scarcelli , Filippo Betello , Giuseppe Perelli , Fabrizio Silvestri , Gabriele Tolomei

Conversational recommender systems (CRSs) aim to provide recommendation services via natural language conversations. Although a number of approaches have been proposed for developing capable CRSs, they typically rely on sufficient training…

Computation and Language · Computer Science 2024-06-21 Xiaolei Wang , Kun Zhou , Xinyu Tang , Wayne Xin Zhao , Fan Pan , Zhao Cao , Ji-Rong Wen