中文
相关论文

相关论文: HiKEY: Hierarchical Multimodal Retrieval for Open-…

200 篇论文

Open-vocabulary image segmentation aims to partition an image into semantic regions according to arbitrary text descriptions. However, complex visual scenes can be naturally decomposed into simpler parts and abstracted at multiple levels of…

计算机视觉与模式识别 · 计算机科学 2023-12-22 Xudong Wang , Shufan Li , Konstantinos Kallidromitis , Yusuke Kato , Kazuki Kozuka , Trevor Darrell

Current document chunking methods for Retrieval-Augmented Generation (RAG) typically linearize text. This forced linearization strips away intrinsic topological hierarchies, creating ``semantic fragmentation'' that degrades downstream…

计算与语言 · 计算机科学 2026-03-20 Xiaoyu Liu

Large Language Models (LLMs) have demonstrated significant potential across various domains. However, they often struggle with integrating external knowledge and performing complex reasoning, leading to hallucinations and unreliable…

机器学习 · 计算机科学 2025-11-25 Yao Cheng , Yibo Zhao , Jiapeng Zhu , Yao Liu , Xing Sun , Xiang Li

Medication recommendation is a crucial task for assisting physicians in making timely decisions from longitudinal patient medical records. However, real-world EHR data present significant challenges due to the presence of rarely observed…

人工智能 · 计算机科学 2025-08-15 Yan Ting Chok , Soyon Park , Seungheun Baek , Hajung Kim , Junhyun Lee , Jaewoo Kang

Graph Retrieval-Augmented Generation (Graph RAG) effectively builds a knowledge graph (KG) to connect disparate facts across a large document corpus. However, this broad-view approach often lacks the deep structured reasoning needed for…

计算与语言 · 计算机科学 2025-10-27 Jiaoyang Li , Junhao Ruan , Shengwei Tang , Saihan Chen , Kaiyan Chang , Yuan Ge , Tong Xiao , Jingbo Zhu

Retrieval-augmented generation (RAG) systems have predominantly focused on text-based retrieval, limiting their effectiveness in handling visually-rich documents that encompass text, images, tables, and charts. To bridge this gap, we…

信息检索 · 计算机科学 2025-05-07 Mingjun Xu , Zehui Wang , Hengxing Cai , Renxin Zhong

Retrieval-Augmented Generation (RAG) aims to enhance large language models (LLMs) to generate more accurate and reliable answers with the help of the retrieved context from external knowledge sources, thereby reducing the incidence of…

计算与语言 · 计算机科学 2024-10-17 Jintao Liu , Ruixue Ding , Linhao Zhang , Pengjun Xie , Fie Huang

Multi-hop Question Answering (MHQA) aims to answer questions that require multi-step reasoning. It presents two key challenges: generating correct reasoning paths in response to the complex user queries, and accurately retrieving essential…

Recently, large reasoning models have demonstrated strong mathematical and coding abilities, and deep search leverages their reasoning capabilities in challenging information retrieval tasks. Existing deep search works are generally limited…

信息检索 · 计算机科学 2025-08-12 Jiejun Tan , Zhicheng Dou , Yan Yu , Jiehan Cheng , Qiang Ju , Jian Xie , Ji-Rong Wen

Financial disclosures such as 10-K filings present challenging retrieval problems due to their length, regulatory section hierarchy, and domain-specific language, which standard retrieval-augmented generation (RAG) models underuse. We…

计算工程、金融与科学 · 计算机科学 2025-09-16 Ying Li , Mengyu Wang , Miguel de Carvalho , Sotirios Sabanis , Tiejun Ma

Hierarchical text classification (HTC) is a complex subtask under multi-label text classification, characterized by a hierarchical label taxonomy and data imbalance. The best-performing models aim to learn a static representation by…

计算与语言 · 计算机科学 2024-02-23 Vidit Jain , Mukund Rungta , Yuchen Zhuang , Yue Yu , Zeyu Wang , Mu Gao , Jeffrey Skolnick , Chao Zhang

Explainable question answering (XQA) aims to answer a given question and provide an explanation why the answer is selected. Existing XQA methods focus on reasoning on a single knowledge source, e.g., structured knowledge bases, unstructured…

计算与语言 · 计算机科学 2023-05-25 Jiajie Zhang , Shulin Cao , Tingjia Zhang , Xin Lv , Jiaxin Shi , Qi Tian , Juanzi Li , Lei Hou

Engineering rulebooks and technical standards contain multimodal information like dense text, tables, and illustrations that are challenging for retrieval augmented generation (RAG) systems. Building upon the DesignQA framework [1], which…

Retrieval-augmented generation (RAG) empowers large language models to access external and private corpus, enabling factually consistent responses in specific domains. By exploiting the inherent structure of the corpus, graph-based RAG…

人工智能 · 计算机科学 2025-04-17 Tianyang Xu , Haojie Zheng , Chengze Li , Haoxiang Chen , Yixin Liu , Ruoxi Chen , Lichao Sun

Traditional query expansion techniques for addressing vocabulary mismatch problems in information retrieval are context-sensitive and may lead to performance degradation. As an alternative, document expansion research has gained attention,…

信息检索 · 计算机科学 2025-09-22 Jisu Kim , Jinhee Park , Changhyun Jeon , Jungwoo Choi , Keonwoo Kim , Minji Hong , Sehyun Kim

Document-level RE requires reading, inferring and aggregating over multiple sentences. From our point of view, it is necessary for document-level RE to take advantage of multi-granularity inference information: entity level, sentence level…

计算与语言 · 计算机科学 2020-03-31 Hengzhu Tang , Yanan Cao , Zhenyu Zhang , Jiangxia Cao , Fang Fang , Shi Wang , Pengfei Yin

The deep-research framework orchestrates external tools to perform complex, multi-step scientific reasoning that exceeds the native limits of a single large language model. However, it still suffers from context pollution, weak evidentiary…

人工智能 · 计算机科学 2025-10-13 Jinxin Shi , Zongsheng Cao , Runmin Ma , Yusong Hu , Jie Zhou , Xin Li , Lei Bai , Liang He , Bo Zhang

Document Visual Question Answering (DocVQA) is a practical yet challenging task, which is to ask questions based on documents while referring to multiple pages and different modalities of information, e.g, images and tables. To handle…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Chelsi Jain , Yiran Wu , Yifan Zeng , Jiale Liu , S hengyu Dai , Zhenwen Shao , Qingyun Wu , Huazheng Wang

Multimodal Retrieval-Augmented Generation (RAG) has emerged as an effective paradigm for enhancing Large Language Models (LLMs) with external knowledge. However, existing multimodal RAG systems predominantly rely on coarse-grained…

信息检索 · 计算机科学 2026-05-25 Yifan Zhu , Yu Mi , Yue Lu , Yanchu Guan , Zhixuan Chu

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach for grounding Large Language Model (LLM)-based chatbot responses on external knowledge. However, existing RAG studies typically assume well-structured textual sources…

计算与语言 · 计算机科学 2026-02-13 Sungmoon Kim , Hyuna Jeon , Dahye Kim , Mingyu Kim , Dong-Kyu Chae , Jiwoong Kim