English
Related papers

Related papers: EviMem: Evidence-Gap-Driven Iterative Retrieval fo…

200 papers

Object-aware reasoning in vision-language tasks poses significant challenges for current models, particularly in handling unseen objects, reducing hallucinations, and capturing fine-grained relationships in complex visual scenes. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Antonio Carlos Rivera , Anthony Moore , Steven Robinson

Incorporating external knowledge into dialogue generation (KIDG) is crucial for improving the correctness of response, where evidence fragments serve as knowledgeable snippets supporting the factual dialogue replies. However, introducing…

Computation and Language · Computer Science 2023-09-18 Xianjie Wu , Jian Yang , Tongliang Li , Di Liang , Shiwei Zhang , Yiyang Du , Zhoujun Li

Large Vision Language Models (LVLMs) show immense potential for automated ophthalmic diagnosis. However, their clinical deployment is severely hindered by lacking domain-specific knowledge. In this work, we identify two structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Shuai Lu , Meng Wang , Jia Guo , Jiawei Du , Bo Liu , Shengzhu Yang , Weihang Zhang , Huazhu Fu , Huiqi Li

This paper describes a compact and effective model for low-latency passage retrieval in conversational search based on learned dense representations. Prior to our work, the state-of-the-art approach uses a multi-stage pipeline comprising…

Information Retrieval · Computer Science 2021-11-30 Sheng-Chieh Lin , Jheng-Hong Yang , Jimmy Lin

Retrieval-augmented generation (RAG) systems commonly improve robustness via query-time adaptations such as query expansion and iterative retrieval. While effective, these approaches are inherently stateless: adaptations are recomputed for…

Information Retrieval · Computer Science 2026-02-06 Yuntong Hu , Sha Li , Naren Ramakrishnan , Liang Zhao

Large Audio Language Models (LALMs) still struggle in complex acoustic scenes because they often fail to preserve task-relevant acoustic evidence before reasoning begins. We identify this error pattern as the evidence bottleneck:…

Sound · Computer Science 2026-05-29 Xinyuan Xie , Shunian Chen , Zhiheng Liu , Yuhao Zhang , Zhiqiang Lv , Liyin Liang , Benyou Wang

Iterative Retrieval-Augmented Generation (iRAG) has emerged as a powerful paradigm for answering complex multi-hop questions by progressively retrieving and reasoning over external documents. However, current systems predominantly operate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Peiyang Liu , Ziqiang Cui , Xi Wang , Di Liang , Wei Ye

Building dense retrievers requires a series of standard procedures, including training and validating neural models and creating indexes for efficient search. However, these procedures are often misaligned in that training objectives do not…

Computation and Language · Computer Science 2022-10-26 Gyuwan Kim , Jinhyuk Lee , Barlas Oguz , Wenhan Xiong , Yizhe Zhang , Yashar Mehdad , William Yang Wang

Recent advances in large language models (LLMs) have enabled promising progress in diagnosis prediction from electronic health records (EHRs). However, existing LLM-based approaches tend to overfit to historically observed diagnoses, often…

Computation and Language · Computer Science 2026-04-14 Hengyu Zhang , Xuyun Zhang , Pengxiang Zhan , Linhao Luo , Hang Lv , Yanchao Tan , Shirui Pan , Carl Yang

Retrieval plays a central role in multi-hop question answering (QA), where answering complex questions requires gathering multiple pieces of evidence. We introduce an Agentic Retrieval System that leverages large language models (LLMs) in a…

Computation and Language · Computer Science 2025-10-17 Md Mahadi Hasan Nahid , Davood Rafiei

High-precision medical diagnosis relies not only on static imaging features but also on the implicit diagnostic memory experts instantly invoke during image interpretation. We pinpoint a fundamental cognitive misalignment in medical VLMs…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Chunzheng Zhu , Jiaqi Zeng , Junyu Jiang , Jianxin Lin , Yijun Wang

Large Language Models (LLMs) have made significant progress in dialogue, yet redundant memory contexts severely limit their effectiveness in long-term dialogue agents. External memory systems have been proposed to improve memory…

Information Retrieval · Computer Science 2026-05-28 Tan Wang , Yunwei Dong

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui

Video data is highly expressive and has traditionally been very difficult for a machine to interpret. Querying event patterns from video streams is challenging due to its unstructured representation. Middleware systems such as Complex Event…

Computer Vision and Pattern Recognition · Computer Science 2020-07-16 Piyush Yadav , Edward Curry

Transformers have a quadratic scaling of computational complexity with input size, which limits the input context window size of large language models (LLMs) in both training and inference. Meanwhile, retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2024-10-18 Yimin Tang , Yurong Xu , Ning Yan , Masood Mortazavi

Long-term conversational memory in practical LLM applications is inherently collaborative: information is produced by multiple participants, scattered across groups and channels, revised over time, and implicitly grounded in roles and…

Computation and Language · Computer Science 2026-03-12 Chuanrui Hu , Tong Li , Xingze Gao , Hongda Chen , Yi Bai , Dannong Xu , Tianwei Lin , Xiaohong Li , Yunyun Han , Jian Pei , Yafeng Deng

Source attribution aims to enhance the reliability of AI-generated answers by including references for each statement, helping users validate the provided answers. However, existing work has primarily focused on text-only scenario and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Seokwon Song , Minsu Park , Gunhee Kim

Egocentric memory is widely used in embodied intelligence, but it may be insufficient for comprehensive spatial-temporal reasoning. Inspired by human recall from both field and observer perspectives, we introduce EgoExoMem, the first…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Ruiping Liu , Junwei Zheng , Yufan Chen , Di Wen , Shaofang Quan , Chengzhi Wu , Jiaming Zhang , Kailun Yang , Kunyu Peng , Rainer Stiefelhagen

In large language model-based agents, memory serves as a critical capability for achieving personalization by storing and utilizing users' information. Although some previous studies have adopted memory to implement user personalization,…

Artificial Intelligence · Computer Science 2025-08-20 Zeyu Zhang , Yang Zhang , Haoran Tan , Rui Li , Xu Chen

Long-context memory systems often fail under fixed budgets, but end-to-end evaluation does not reveal whether evidence was discarded during compression or preserved but never retrieved. We introduce a four-condition diagnostic protocol that…

Computation and Language · Computer Science 2026-05-26 Jiangnan Yu , Kisson Songqi Lin , Jilong Wu