English
Related papers

Related papers: REGen: A Reliable Evaluation Framework for Generat…

200 papers

Retrieval-augmented generation (RAG) is key to enhancing large language models (LLMs) to systematically access richer factual knowledge. Yet, using RAG brings intrinsic challenges, as LLMs must deal with potentially conflicting knowledge,…

Computation and Language · Computer Science 2025-04-08 Leonardo Ranaldi , Federico Ranaldi , Fabio Massimo Zanzotto , Barry Haddow , Alexandra Birch

The efficient processing of long context poses a serious challenge for large language models (LLMs). Recently, retrieval-augmented generation (RAG) has emerged as a promising strategy for this problem, as it enables LLMs to make selective…

Computation and Language · Computer Science 2025-02-18 Kun Luo , Zheng Liu , Peitian Zhang , Hongjin Qian , Jun Zhao , Kang Liu

Large Language Models (LLMs) enhanced with retrieval -- commonly referred to as Retrieval-Augmented Generation (RAG) -- have demonstrated strong performance in knowledge-intensive tasks. However, RAG pipelines often fail when retrieved…

Computation and Language · Computer Science 2025-11-07 Shiyin Lin

Financial event entity extraction is a crucial task for analyzing market dynamics and building financial knowledge graphs, yet it presents significant challenges due to the specialized language and complex structures in financial texts.…

Computation and Language · Computer Science 2025-04-22 Soo-joon Choi , Ji-jun Park

Structural extraction of events within discourse is critical since it avails a deeper understanding of communication patterns and behavior trends. Event argument extraction (EAE), at the core of event-centric understanding, is the task of…

Computation and Language · Computer Science 2025-03-21 Xinliang Frederick Zhang , Carter Blum , Temma Choji , Shalin Shah , Alakananda Vempala

While Retrieval Augmented Generation (RAG) is now widely adopted to enhance LLMs, evaluating its true performance benefits in a reproducible and interpretable way remains a major hurdle. Existing methods often fall short: they lack domain…

Information Retrieval · Computer Science 2025-08-11 Jiaxuan Liang , Shide Zhou , Kailong Wang

Joint video-language learning has received increasing attention in recent years. However, existing works mainly focus on single or multiple trimmed video clips (events), which makes human-annotated event boundaries necessary during…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Teng Wang , Jinrui Zhang , Feng Zheng , Wenhao Jiang , Ran Cheng , Ping Luo

The inherent ambiguity of cause and effect boundaries poses a challenge in evaluating causal event extraction tasks. Traditional metrics like Exact Match and BertScore poorly reflect model performance, so we trained evaluation models to…

Computation and Language · Computer Science 2024-06-28 Italo Luis da Silva , Hanqi Yan , Lin Gui , Yulan He

Recent works have introduced Abstract Meaning Representation (AMR) for Document-level Event Argument Extraction (Doc-level EAE), since AMR provides a useful interpretation of complex semantic structures and helps to capture long-distance…

Computation and Language · Computer Science 2023-05-31 Yuqing Yang , Qipeng Guo , Xiangkun Hu , Yue Zhang , Xipeng Qiu , Zheng Zhang

With the development of legal intelligence, Criminal Court View Generation has attracted much attention as a crucial task of legal intelligence, which aims to generate concise and coherent texts that summarize case facts and provide…

Computation and Language · Computer Science 2024-04-17 Linan Yue , Qi Liu , Lili Zhao , Li Wang , Weibo Gao , Yanqing An

Event temporal relation (TempRel) is a primary subject of the event relation extraction task. However, the inherent ambiguity of TempRel increases the difficulty of the task. With the rise of prompt engineering, it is important to design…

Computation and Language · Computer Science 2024-03-25 Xiaobin Zhang , Liangjun Zang , Qianwen Liu , Shuchong Wei , Songlin Hu

Retrieval-augmented generation (RAG) has emerged as an approach to augment large language models (LLMs) by reducing their reliance on static knowledge and improving answer factuality. RAG retrieves relevant context snippets and generates an…

Computation and Language · Computer Science 2025-02-21 Juraj Vladika , Florian Matthes

Large Language Models (LLMs) excel in data synthesis but can be inaccurate in domain-specific tasks, which retrieval-augmented generation (RAG) systems address by leveraging user-provided data. However, RAGs require optimization in both…

Computation and Language · Computer Science 2024-11-05 Kazi Ahmed Asif Fuad , Lizhong Chen

Referring Expression Generation (REG) is the task of generating contextually appropriate references to entities. A limitation of existing REG systems is that they rely on entity-specific supervised training, which means that they cannot…

Computation and Language · Computer Science 2019-09-05 Meng Cao , Jackie Chi Kit Cheung

This paper introduces a novel dataset REGEN (Reviews Enhanced with GEnerative Narratives), designed to benchmark the conversational capabilities of recommender Large Language Models (LLMs), addressing the limitations of existing datasets…

LLMs have demonstrated impressive proficiency in generating coherent and high-quality text, making them valuable across a range of text-generation tasks. However, rigorous evaluation of this generated content is crucial, as ensuring its…

Retrieval Augmented Generation (RAG) has emerged as a crucial technique for enhancing the accuracy of Large Language Models (LLMs) by incorporating external information. With the advent of LLMs that support increasingly longer context…

Machine Learning · Computer Science 2024-11-07 Quinn Leng , Jacob Portes , Sam Havens , Matei Zaharia , Michael Carbin

Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning power of large language models (LLMs) with external retrieval to enable domain-grounded responses. Effectively adapting RAG systems to domain-specific…

Computation and Language · Computer Science 2026-04-14 Chris Xing Tian , Weihao Xie , Zhen Chen , Zhengyuan Yi , Hui Liu , Haoliang Li , Shiqi Wang , Siwei Ma

Document-level event extraction is a long-standing challenging information retrieval problem involving a sequence of sub-tasks: entity extraction, event type judgment, and event type-specific multi-event extraction. However, addressing the…

Computation and Language · Computer Science 2023-07-03 Qizhi Wan , Changxuan Wan , Keli Xiao , Hui Xiong , Dexi Liu , Xiping Liu

Event argument extraction has long been studied as a sequential prediction problem with extractive-based methods, tackling each argument in isolation. Although recent work proposes generation-based methods to capture cross-argument…

Computation and Language · Computer Science 2022-11-15 Xinya Du , Heng Ji