English
Related papers

Related papers: A Unified Mutual Supervision Framework for Referri…

200 papers

Retrieval-Augmented Generation (RAG) systems traditionally treat retrieval and generation as separate processes, requiring explicit textual queries to connect them. This separation can limit the ability of models to generalize across…

Computation and Language · Computer Science 2025-09-19 Wenzheng Zhang , Xi Victoria Lin , Karl Stratos , Wen-tau Yih , Mingda Chen

Existing methods for vision-and-language learning typically require designing task-specific architectures and objectives for each task. For example, a multi-label answer classifier for visual question answering, a region scorer for…

Computation and Language · Computer Science 2021-05-25 Jaemin Cho , Jie Lei , Hao Tan , Mohit Bansal

Referring Expression Comprehension (REC) aims to localize an image region of a given object described by a natural-language expression. While promising performance has been demonstrated, existing REC algorithms make a strong assumption that…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Heng Tao Shen , Cheng Chen , Peng Wang , Lianli Gao , Meng Wang , Jingkuan Song

Decoding the human brain from electroencephalography (EEG) signals holds promise for understanding neurological activities. However, EEG data exhibit heterogeneity across subjects and sessions, limiting the generalization of existing…

Computational Engineering, Finance, and Science · Computer Science 2026-02-03 Zhi Zhang , Yan Liu , Zhejing Hu , Gong Chen , Jiannong Cao , Shenghua Zhong , Sean Fontaine , Changhong Jing , Shuqiang Wang

Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, particularly in specialized domains. While many RAG approaches…

Referring expression comprehension (REC) aims to localize a text-related region in a given image by a referring expression in natural language. Existing methods focus on how to build convincing visual and language representations…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Shuai Wang , Fan Lyu , Wei Feng , Song Wang

Retrieval-augmented generation (RAG) has emerged as a pivotal method for expanding the knowledge of large language models. To handle complex queries more effectively, researchers developed Adaptive-RAG (A-RAG) to enhance the generated…

Artificial Intelligence · Computer Science 2025-05-27 Jie Ou , Jinyu Guo , Shuaihong Jiang , Zhaokun Wang , Libo Qin , Shunyu Yao , Wenhong Tian

In this paper, we introduce Reward-RAG, a novel approach designed to enhance the Retrieval-Augmented Generation (RAG) model through Reward-Driven Supervision. Unlike previous RAG methodologies, which focus on training language models (LMs)…

Computation and Language · Computer Science 2024-10-08 Thang Nguyen , Peter Chin , Yu-Wing Tai

A Comparison of Independent and Joint Fine-tuning Strategies for Retrieval-Augmented Generation Download PDF Neal Gregory Lawton, Alfy Samuel, Anoop Kumar, Daben Liu Published: 20 Aug 2025, Retrieval augmented generation (RAG) is a popular…

Computation and Language · Computer Science 2025-10-21 Neal Gregory Lawton , Alfy Samuel , Anoop Kumar , Daben Liu

In modular dialogue systems, natural language understanding (NLU) and natural language generation (NLG) are two critical components, where NLU extracts the semantics from the given texts and NLG is to construct corresponding natural…

Computation and Language · Computer Science 2020-05-01 Shang-Yu Su , Chao-Wei Huang , Yun-Nung Chen

This paper focuses on a referring expression generation (REG) task in which the aim is to pick out an object in a complex visual scene. One common theoretical approach to this problem is to model the task as a two-agent cooperative scheme…

Computation and Language · Computer Science 2022-05-17 Hieu Le , Taufiq Daryanto , Fabian Zhafransyah , Derry Wijaya , Elizabeth Coppock , Sang Chin

Referring Expression Comprehension (REC) and Referring Expression Generation (REG) are fundamental tasks in multimodal understanding, supporting precise object localization through natural language. However, existing REC and REG datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Shilan Zhang , Jirui Huang , Ruilin Yao , Cong Wang , Yaxiong Chen , Peng Xu , Shengwu Xiong

Referring Expression Comprehension (REC) is one of the most important tasks in visual reasoning that requires a model to detect the target object referred by a natural language expression. Among the proposed pipelines, the one-stage…

Computer Vision and Pattern Recognition · Computer Science 2022-10-28 Zhipeng Zhang , Zhimin Wei , Zhongzhen Huang , Rui Niu , Peng Wang

Molecular generation and molecular property prediction are both crucial for drug discovery, but they are often developed independently. Inspired by recent studies, which demonstrate that diffusion model, a prominent generative approach, can…

Machine Learning · Computer Science 2025-04-07 Shikun Feng , Yuyan Ni , Yan Lu , Zhi-Ming Ma , Wei-Ying Ma , Yanyan Lan

Guidance techniques are simple yet effective for improving conditional generation in diffusion models. Albeit their empirical success, the practical implementation of guidance diverges significantly from its theoretical motivation. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zhengqi Gao , Kaiwen Zha , Tianyuan Zhang , Zihui Xue , Duane S. Boning

Existing studies have optimized retrieval-augmented generation (RAG) across various sub-tasks, such as query understanding and retrieval refinement, but integrating these optimizations into a unified framework remains challenging. To tackle…

Computation and Language · Computer Science 2025-05-22 Yutao Zhu , Jiajie Jin , Hongjin Qian , Zheng Liu , Zhicheng Dou , Ji-Rong Wen

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

This paper proposes reverberation as supervision (RAS), a novel unsupervised loss function for single-channel reverberant speech separation. Prior methods for unsupervised separation required the synthesis of mixtures of mixtures or assumed…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-16 Rohith Aralikatti , Christoph Boeddeker , Gordon Wichern , Aswin Shanmugam Subramanian , Jonathan Le Roux

Generative information retrieval, encompassing two major tasks of Generative Document Retrieval (GDR) and Grounded Answer Generation (GAR), has gained significant attention in the area of information retrieval and natural language…

Information Retrieval · Computer Science 2023-12-19 Xiaoxi Li , Yujia Zhou , Zhicheng Dou

Retrieval-augmented generation (RAG) has become a cornerstone of contemporary NLP, enhancing large language models (LLMs) by allowing them to access richer factual contexts through in-context retrieval. While effective in monolingual…

Computation and Language · Computer Science 2026-03-31 Leonardo Ranaldi , Barry Haddow , Alexandra Birch