English
Related papers

Related papers: Ensemble of MRR and NDCG models for Visual Dialog

200 papers

Large Language Model (LLM)-based recommendation systems have demonstrated remarkable capabilities in understanding user preferences and generating personalized suggestions. However, existing approaches face critical challenges in…

Information Retrieval · Computer Science 2026-04-24 Sushant Mehta

Effectively retrieving, reasoning, and understanding multimodal information remains a critical challenge for agentic systems. Traditional Retrieval-augmented Generation (RAG) methods rely on linear interaction histories, which struggle to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Qiuchen Wang , Shihang Wang , Yu Zeng , Qiang Zhang , Fanrui Zhang , Zhuoning Guo , Bosi Zhang , Wenxuan Huang , Lin Chen , Zehui Chen , Pengjun Xie , Ruixue Ding

For middle-school math students, interactive question-answering (QA) with tutors is an effective way to learn. The flexibility and emergent capabilities of generative large language models (LLMs) has led to a surge of interest in automating…

Computation and Language · Computer Science 2023-11-14 Zachary Levonian , Chenglu Li , Wangda Zhu , Anoushka Gade , Owen Henkel , Millie-Ellen Postle , Wanli Xing

Sustainable monetization of Large Language Models (LLMs) remains a critical open challenge. Traditional search advertising, which relies on static keywords, fails to capture the fleeting, context-dependent user intents--the specific…

Computer Science and Game Theory · Computer Science 2026-01-28 Shengwei Xu , Zhaohua Chen , Xiaotie Deng , Zhiyi Huang , Grant Schoenebeck

Current evaluation metrics to question answering based machine reading comprehension (MRC) systems generally focus on the lexical overlap between the candidate and reference answers, such as ROUGE and BLEU. However, bias may appear when…

Computation and Language · Computer Science 2018-06-12 An Yang , Kai Liu , Jing Liu , Yajuan Lyu , Sujian Li

Specialized visual tools can augment large language models or vision language models with expert knowledge (e.g., grounding, spatial reasoning, medical knowledge, etc.), but knowing which tools to call (and when to call them) can be…

Computation and Language · Computer Science 2025-12-09 Nithin Sivakumaran , Justin Chih-Yao Chen , David Wan , Yue Zhang , Jaehong Yoon , Elias Stengel-Eskin , Mohit Bansal

Retrieval-augmented generation (RAG) is a popular technique for using large language models (LLMs) to build customer-support, question-answering solutions. In this paper, we share our team's practical experience building and maintaining…

Information Retrieval · Computer Science 2024-10-18 Sarah Packowski , Inge Halilovic , Jenifer Schlotfeldt , Trish Smith

Multi-role dialogue summarization requires modeling complex interactions among multiple speakers while preserving role-specific information and factual consistency. However, most existing methods optimize for automatic metrics such as ROUGE…

Computation and Language · Computer Science 2026-04-29 Xiaoyong Mei , Tingting Zuo , Da Chen , Guangyu Hu , Xiangyu Wen , Chao Duan , Mingyan Zhang , Fudan Zheng

Automated code review comment generation (RCG) aims to assist developers by automatically producing natural language feedback for code changes. Existing approaches are primarily either generation-based, using pretrained language models, or…

Software Engineering · Computer Science 2025-06-16 Hyunsun Hong , Jongmoon Baik

For task-oriented dialog systems, training a Reinforcement Learning (RL) based Dialog Management module suffers from low sample efficiency and slow convergence speed due to the sparse rewards in RL.To solve this problem, many strategies…

Computation and Language · Computer Science 2021-04-13 Zhengxu Hou , Bang Liu , Ruihui Zhao , Zijing Ou , Yafei Liu , Xi Chen , Yefeng Zheng

Medical Question Answering systems based on Retrieval Augmented Generation is promising for clinical decision support because they can integrate external knowledge, thus reducing inaccuracies inherent in standalone large language models…

Computation and Language · Computer Science 2025-03-28 Yuelyu Ji , Hang Zhang , Yanshan Wang

Generative language models often struggle with specialized or less-discussed knowledge. A potential solution is found in Retrieval-Augmented Generation (RAG) models which act like retrieving information before generating responses. In this…

Computation and Language · Computer Science 2024-10-08 Mehrdad Farahani , Richard Johansson

Large language models can now directly generate answers to many factual questions without referencing external sources. Unfortunately, relatively little attention has been paid to methods for evaluating the quality and correctness of these…

Information Retrieval · Computer Science 2024-01-11 Negar Arabzadeh , Amin Bigdeli , Charles L. A. Clarke

Retrieval-Augmented Generation (RAG) systems and large language model (LLM)-powered chatbots have significantly advanced conversational AI by combining generative capabilities with external knowledge retrieval. Despite their success,…

Artificial Intelligence · Computer Science 2025-06-26 Priyaranjan Pattnayak , Amit Agarwal , Hansa Meghwani , Hitesh Laxmichand Patel , Srikant Panda

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

Computation and Language · Computer Science 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

Retrieval-augmented generation (RAG) has emerged as a promising approach to enhance the performance of large language models (LLMs) in knowledge-intensive tasks such as those from medical domain. However, the sensitive nature of the medical…

Computation and Language · Computer Science 2024-11-15 Nghia Trung Ngo , Chien Van Nguyen , Franck Dernoncourt , Thien Huu Nguyen

Since large language models (LLMs) have a tendency to generate factually inaccurate output, retrieval-augmented generation (RAG) has gained significant attention as a key means to mitigate this downside of harnessing only LLMs. However,…

Computation and Language · Computer Science 2025-12-18 Youmin Ko , Sungjong Seo , Hyunjoon Kim

This work deals with the challenge of learning and reasoning over language and vision data for the related downstream tasks such as visual question answering (VQA) and natural language for visual reasoning (NLVR). We design a novel…

Computation and Language · Computer Science 2020-05-14 Chen Zheng , Quan Guo , Parisa Kordjamshidi

The visual dialog task requires an AI agent to interact with humans in multi-round dialogs based on a visual environment. As a common linguistic phenomenon, pronouns are often used in dialogs to improve the communication efficiency. As a…

Computation and Language · Computer Science 2022-05-31 Xintong Yu , Hongming Zhang , Ruixin Hong , Yangqiu Song , Changshui Zhang

Large Language Models (LLMs) have been integrated into recommendation systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant…

Information Retrieval · Computer Science 2025-02-12 Jian Xu , Sichun Luo , Xiangyu Chen , Haoming Huang , Hanxu Hou , Linqi Song