English
Related papers

Related papers: Multimodal Query Suggestion with Multi-Agent Reinf…

200 papers

Multimodal Retrieval Augmented Generation (mRAG) plays an important role in mitigating the "hallucination" issue inherent in multimodal large language models (MLLMs). Although promising, existing heuristic mRAGs typically predefined fixed…

Computation and Language · Computer Science 2025-05-27 Yangning Li , Yinghui Li , Xinyu Wang , Yong Jiang , Zhen Zhang , Xinran Zheng , Hui Wang , Hai-Tao Zheng , Philip S. Yu , Fei Huang , Jingren Zhou

Multimodal Retrieval Augmented Generation (MMRAG) is a powerful approach to question-answering over multimodal documents. A key challenge with evaluating MMRAG is the paucity of high-quality datasets matching the question styles and…

Computation and Language · Computer Science 2024-10-07 Ian Wu , Sravan Jayanthi , Vijay Viswanathan , Simon Rosenberg , Sina Pakazad , Tongshuang Wu , Graham Neubig

Owing to powerful natural language processing and generative capabilities, large language model (LLM) agents have emerged as a promising solution for enhancing recommendation systems via user simulation. However, in the realm of video…

Multimedia · Computer Science 2025-07-04 Siran Chen , Boyu Chen , Chenyun Yu , Yuxiao Luo , Ouyang Yi , Lei Cheng , Chengxiang Zhuo , Zang Li , Yali Wang

Multimodal recommendation is commonly framed as a feature fusion problem, where textual and visual signals are combined to better model user preference. However, the effectiveness of multimodal recommendation may depend not only on how…

Information Retrieval · Computer Science 2026-03-16 Ty Valencia , Burak Barlas , Varun Singhal , Ruchir Bhatia , Wei Yang

Large Language Models (LLMs) often struggle with hallucinations and outdated information. To address this, Information Retrieval (IR) systems can be employed to augment LLMs with up-to-date knowledge. However, existing IR techniques contain…

Computation and Language · Computer Science 2024-11-26 Danupat Khamnuansin , Tawunrat Chalothorn , Ekapol Chuangsuwanich

Multimodal Large Language Models (MLLMs) have shown impressive capabilities in jointly understanding text, images, and videos, often evaluated via Visual Question Answering (VQA). However, even state-of-the-art MLLMs struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Alberto Compagnoni , Marco Morini , Sara Sarto , Federico Cocchi , Davide Caffagni , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

This paper investigates the design of a unified search engine to serve multiple retrieval-augmented generation (RAG) agents, each with a distinct task, backbone large language model (LLM), and RAG strategy. We introduce an iterative…

Computation and Language · Computer Science 2025-06-27 Alireza Salemi , Hamed Zamani

Large Language Models (LLMs) have become a popular interface for human-AI interaction, supporting information seeking and task assistance through natural, multi-turn dialogue. To respond to users within multi-turn dialogues, the…

Computation and Language · Computer Science 2026-04-16 Fengran Mo , Yifan Gao , Sha Li , Hansi Zeng , Xin Liu , Zhaoxuan Tan , Xian Li , Jianshu Chen , Dakuo Wang , Meng Jiang

Recent studies have proposed leveraging Large Language Models (LLMs) as information retrievers through query rewriting. However, for challenging corpora, we argue that enhancing queries alone is insufficient for robust semantic matching;…

Information Retrieval · Computer Science 2025-06-24 Jingming Liu , Yumeng Li , Wei Shi , Yao-Xiang Ding , Hui Su , Kun Zhou

Interactive recommender systems can dynamically adapt to user feedback, but often suffer from content homogeneity and filter bubble effects due to overfitting short-term user preferences. While recent efforts aim to improve content…

Information Retrieval · Computer Science 2026-05-12 Chongjun Xia , Yanchun Peng , Xianzhi Wang

Typically, search engines provide query suggestions to assist users in the search process. Query suggestions are very important for improving users search experience. However, most query suggestions are based on the user's search logs, and…

Information Retrieval · Computer Science 2022-06-29 Seungmin Kim , EunChan Na , Seong Baeg Kim

Information technology has profoundly altered the way humans interact with information. The vast amount of content created, shared, and disseminated online has made it increasingly difficult to access relevant information. Over the past two…

Information Retrieval · Computer Science 2025-04-14 Yu Zhang , Shutong Qiao , Jiaqi Zhang , Tzu-Heng Lin , Chen Gao , Yong Li

Recommender systems play a vital role in alleviating information overload and enriching users' online experience. In the era of large language models (LLMs), LLM-based recommender systems have emerged as a prevalent paradigm for advancing…

Information Retrieval · Computer Science 2025-11-19 Zihuai Zhao , Yujuan Ding , Wenqi Fan , Qing Li

Conversational query clarification enables users to refine their search queries through interactive dialogue, improving search effectiveness. Traditional approaches rely on text-based clarifying questions, which often fail to capture…

Information Retrieval · Computer Science 2025-02-18 Kimia Ramezan , Alireza Amiri Bavandpour , Yifei Yuan , Clemencia Siro , Mohammad Aliannejadi

"High Quality Related Search Query Suggestions" task aims at recommending search queries which are real, accurate, diverse, relevant and engaging. Obtaining large amounts of query-quality human annotations is expensive. Prior work on…

Information Retrieval · Computer Science 2021-08-11 Praveen Kumar Bodigutla

The advent of Large Language Models (LLMs) has paved the way for AI search engines, e.g., SearchGPT, showcasing a new paradigm in human-internet interaction. However, most current AI search engines are limited to text-only settings,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Dongzhi Jiang , Renrui Zhang , Ziyu Guo , Yanmin Wu , Jiayi Lei , Pengshuo Qiu , Pan Lu , Zehui Chen , Chaoyou Fu , Guanglu Song , Peng Gao , Yu Liu , Chunyuan Li , Hongsheng Li

Recent advancements in large language models (LLMs) and multi-modal LLMs have been remarkable. However, these models still rely solely on their parametric knowledge, which limits their ability to generate up-to-date information and…

Artificial Intelligence · Computer Science 2025-04-22 Zihan Ling , Zhiyao Guo , Yixuan Huang , Yi An , Shuai Xiao , Jinsong Lan , Xiaoyong Zhu , Bo Zheng

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

Multimodal Recommender Systems aim to improve recommendation accuracy by integrating heterogeneous content, such as images and textual metadata. While effective, it remains unclear whether their gains stem from true multimodal understanding…

Information Retrieval · Computer Science 2025-08-07 Claudio Pomo , Matteo Attimonelli , Danilo Danese , Fedelucio Narducci , Tommaso Di Noia

Large Language Models (LLMs) have been shown to enhance the effectiveness of enriching item descriptions, thereby improving the accuracy of recommendation systems. However, most existing approaches either rely on text-only prompting or…

Information Retrieval · Computer Science 2025-10-24 Hanjia Lyu , Ryan Rossi , Xiang Chen , Md Mehrab Tanjim , Stefano Petrangeli , Somdeb Sarkhel , Jiebo Luo