English
Related papers

Related papers: HiKEY: Hierarchical Multimodal Retrieval for Open-…

200 papers

Open-vocabulary image segmentation aims to partition an image into semantic regions according to arbitrary text descriptions. However, complex visual scenes can be naturally decomposed into simpler parts and abstracted at multiple levels of…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Xudong Wang , Shufan Li , Konstantinos Kallidromitis , Yusuke Kato , Kazuki Kozuka , Trevor Darrell

Current document chunking methods for Retrieval-Augmented Generation (RAG) typically linearize text. This forced linearization strips away intrinsic topological hierarchies, creating ``semantic fragmentation'' that degrades downstream…

Computation and Language · Computer Science 2026-03-20 Xiaoyu Liu

Large Language Models (LLMs) have demonstrated significant potential across various domains. However, they often struggle with integrating external knowledge and performing complex reasoning, leading to hallucinations and unreliable…

Machine Learning · Computer Science 2025-11-25 Yao Cheng , Yibo Zhao , Jiapeng Zhu , Yao Liu , Xing Sun , Xiang Li

Medication recommendation is a crucial task for assisting physicians in making timely decisions from longitudinal patient medical records. However, real-world EHR data present significant challenges due to the presence of rarely observed…

Artificial Intelligence · Computer Science 2025-08-15 Yan Ting Chok , Soyon Park , Seungheun Baek , Hajung Kim , Junhyun Lee , Jaewoo Kang

Graph Retrieval-Augmented Generation (Graph RAG) effectively builds a knowledge graph (KG) to connect disparate facts across a large document corpus. However, this broad-view approach often lacks the deep structured reasoning needed for…

Computation and Language · Computer Science 2025-10-27 Jiaoyang Li , Junhao Ruan , Shengwei Tang , Saihan Chen , Kaiyan Chang , Yuan Ge , Tong Xiao , Jingbo Zhu

Retrieval-augmented generation (RAG) systems have predominantly focused on text-based retrieval, limiting their effectiveness in handling visually-rich documents that encompass text, images, tables, and charts. To bridge this gap, we…

Information Retrieval · Computer Science 2025-05-07 Mingjun Xu , Zehui Wang , Hengxing Cai , Renxin Zhong

Retrieval-Augmented Generation (RAG) aims to enhance large language models (LLMs) to generate more accurate and reliable answers with the help of the retrieved context from external knowledge sources, thereby reducing the incidence of…

Computation and Language · Computer Science 2024-10-17 Jintao Liu , Ruixue Ding , Linhao Zhang , Pengjun Xie , Fie Huang

Multi-hop Question Answering (MHQA) aims to answer questions that require multi-step reasoning. It presents two key challenges: generating correct reasoning paths in response to the complex user queries, and accurately retrieving essential…

Computation and Language · Computer Science 2026-04-28 Yuqing Fu , Yimin Deng , Wanyu Wang , Yuhao Wang , Yejing Wang , Hongshi Liu , Yiqi Wang , Xiao Han , Maolin Wang , Guoshuai Zhao , Yi Chang , Xiangyu Zhao

Recently, large reasoning models have demonstrated strong mathematical and coding abilities, and deep search leverages their reasoning capabilities in challenging information retrieval tasks. Existing deep search works are generally limited…

Information Retrieval · Computer Science 2025-08-12 Jiejun Tan , Zhicheng Dou , Yan Yu , Jiehan Cheng , Qiang Ju , Jian Xie , Ji-Rong Wen

Financial disclosures such as 10-K filings present challenging retrieval problems due to their length, regulatory section hierarchy, and domain-specific language, which standard retrieval-augmented generation (RAG) models underuse. We…

Computational Engineering, Finance, and Science · Computer Science 2025-09-16 Ying Li , Mengyu Wang , Miguel de Carvalho , Sotirios Sabanis , Tiejun Ma

Hierarchical text classification (HTC) is a complex subtask under multi-label text classification, characterized by a hierarchical label taxonomy and data imbalance. The best-performing models aim to learn a static representation by…

Computation and Language · Computer Science 2024-02-23 Vidit Jain , Mukund Rungta , Yuchen Zhuang , Yue Yu , Zeyu Wang , Mu Gao , Jeffrey Skolnick , Chao Zhang

Explainable question answering (XQA) aims to answer a given question and provide an explanation why the answer is selected. Existing XQA methods focus on reasoning on a single knowledge source, e.g., structured knowledge bases, unstructured…

Computation and Language · Computer Science 2023-05-25 Jiajie Zhang , Shulin Cao , Tingjia Zhang , Xin Lv , Jiaxin Shi , Qi Tian , Juanzi Li , Lei Hou

Engineering rulebooks and technical standards contain multimodal information like dense text, tables, and illustrations that are challenging for retrieval augmented generation (RAG) systems. Building upon the DesignQA framework [1], which…

Information Retrieval · Computer Science 2026-05-28 Kiarash Naghavi Khanghah , Hoang Anh Nguyen , Anna C. Doris , Amir Mohammad Vahedi , Daniele Grandi , Faez Ahmed , Hongyi Xu

Retrieval-augmented generation (RAG) empowers large language models to access external and private corpus, enabling factually consistent responses in specific domains. By exploiting the inherent structure of the corpus, graph-based RAG…

Artificial Intelligence · Computer Science 2025-04-17 Tianyang Xu , Haojie Zheng , Chengze Li , Haoxiang Chen , Yixin Liu , Ruoxi Chen , Lichao Sun

Traditional query expansion techniques for addressing vocabulary mismatch problems in information retrieval are context-sensitive and may lead to performance degradation. As an alternative, document expansion research has gained attention,…

Information Retrieval · Computer Science 2025-09-22 Jisu Kim , Jinhee Park , Changhyun Jeon , Jungwoo Choi , Keonwoo Kim , Minji Hong , Sehyun Kim

Document-level RE requires reading, inferring and aggregating over multiple sentences. From our point of view, it is necessary for document-level RE to take advantage of multi-granularity inference information: entity level, sentence level…

Computation and Language · Computer Science 2020-03-31 Hengzhu Tang , Yanan Cao , Zhenyu Zhang , Jiangxia Cao , Fang Fang , Shi Wang , Pengfei Yin

The deep-research framework orchestrates external tools to perform complex, multi-step scientific reasoning that exceeds the native limits of a single large language model. However, it still suffers from context pollution, weak evidentiary…

Artificial Intelligence · Computer Science 2025-10-13 Jinxin Shi , Zongsheng Cao , Runmin Ma , Yusong Hu , Jie Zhou , Xin Li , Lei Bai , Liang He , Bo Zhang

Document Visual Question Answering (DocVQA) is a practical yet challenging task, which is to ask questions based on documents while referring to multiple pages and different modalities of information, e.g, images and tables. To handle…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Chelsi Jain , Yiran Wu , Yifan Zeng , Jiale Liu , S hengyu Dai , Zhenwen Shao , Qingyun Wu , Huazheng Wang

Multimodal Retrieval-Augmented Generation (RAG) has emerged as an effective paradigm for enhancing Large Language Models (LLMs) with external knowledge. However, existing multimodal RAG systems predominantly rely on coarse-grained…

Information Retrieval · Computer Science 2026-05-25 Yifan Zhu , Yu Mi , Yue Lu , Yanchu Guan , Zhixuan Chu

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach for grounding Large Language Model (LLM)-based chatbot responses on external knowledge. However, existing RAG studies typically assume well-structured textual sources…

Computation and Language · Computer Science 2026-02-13 Sungmoon Kim , Hyuna Jeon , Dahye Kim , Mingyu Kim , Dong-Kyu Chae , Jiwoong Kim