English
Related papers

Related papers: Peeking inside the Black-Box: Reinforcement Learni…

200 papers

Automatic relation extraction (RE) for types of interest is of great importance for interpreting massive text corpora in an efficient manner. Traditional RE models have heavily relied on human-annotated corpus for training, which can be…

Computation and Language · Computer Science 2017-11-27 Zeqiu Wu , Xiang Ren , Frank F. Xu , Ji Li , Jiawei Han

This technical report details a novel approach to combining reasoning and retrieval augmented generation (RAG) within a single, lean language model architecture. While existing RAG systems typically rely on large-scale models and external…

Reinforcement learning from verifiable rewards (RLVR) has improved the reasoning abilities of LLMs, yet a fundamental limitation remains: models cannot learn from problems that are too difficult to solve under their current policy, as these…

Machine Learning · Computer Science 2026-04-07 Justin Chih-Yao Chen , Archiki Prasad , Zaid Khan , Joykirat Singh , Runchu Tian , Elias Stengel-Eskin , Mohit Bansal

Conversational search systems require effective handling of context-dependent queries that often contain ambiguity, omission, and coreference. Conversational Query Reformulation (CQR) addresses this challenge by transforming these queries…

Computation and Language · Computer Science 2025-09-16 Changtai Zhu , Siyin Wang , Ruijun Feng , Kai Song , Xipeng Qiu

Speech Relation Extraction (SpeechRE) aims to extract relation triplets directly from speech. However, existing benchmark datasets rely heavily on synthetic data, lacking sufficient quantity and diversity of real human speech. Moreover,…

Computation and Language · Computer Science 2025-11-25 Jinzhong Ning , Paerhati Tulajiang , Yingying Le , Yijia Zhang , Yuanyuan Sun , Hongfei Lin , Haifeng Liu

Reinforcement learning post-training has improved the reasoning ability of large language models, but often produces unnecessarily long, repetitive, or semantically opaque reasoning traces. Existing efficient reasoning methods mainly…

Artificial Intelligence · Computer Science 2026-05-22 Yuyang Wu , Qiyao Xue , Guanxing Lu , Weichen Liu , Zihan Wang , Manling Li , Olexandr Isayev

Relation extraction (RE) aims at extracting the relation between two entities from the text corpora. It is a crucial task for Knowledge Graph (KG) construction. Most existing methods predict the relation between an entity pair by learning…

Computation and Language · Computer Science 2020-11-30 Jun Kuang , Yixin Cao , Jianbing Zheng , Xiangnan He , Ming Gao , Aoying Zhou

Inferring new facts from existing knowledge graphs (KG) with explainable reasoning processes is a significant problem and has received much attention recently. However, few studies have focused on relation types unseen in the original KG,…

Machine Learning · Computer Science 2019-06-14 Zhengxiao Du , Chang Zhou , Ming Ding , Hongxia Yang , Jie Tang

Learning to rank (LTR) plays a crucial role in various Information Retrieval (IR) tasks. Although supervised LTR methods based on fine-grained relevance labels (e.g., document-level annotations) have achieved significant success, their…

Information Retrieval · Computer Science 2025-08-21 Yiteng Tu , Zhichao Xu , Tao Yang , Weihang Su , Yujia Zhou , Yiqun Liu , Fen Lin , Qin Liu , Qingyao Ai

Large language models (LLMs) often solve challenging math exercises yet fail to apply the concept right when the problem requires genuine understanding. Popular Reinforcement Learning with Verifiable Rewards (RLVR) pipelines reinforce final…

Artificial Intelligence · Computer Science 2026-05-08 Zijun Gao , Zhikun Xu , Xiao Ye , Ben Zhou

Document-level relation extraction (RE) aims to extract the relations between entities from the input document that usually containing many difficultly-predicted entity pairs whose relations can only be predicted through relational…

Computation and Language · Computer Science 2022-11-29 Liang Zhang , Jinsong Su , Yidong Chen , Zhongjian Miao , Zijun Min , Qingguo Hu , Xiaodong Shi

Retrieval-Augmented Generation (RAG) is essential for integrating external knowledge into Large Language Model (LLM) outputs. While the literature on RAG is growing, it primarily focuses on systematic reviews and comparisons of new…

Computation and Language · Computer Science 2024-04-02 Matouš Eibich , Shivay Nagpal , Alexander Fred-Ojala

Document-level relation extraction (DocRE) predicts relations for entity pairs that rely on long-range context-dependent reasoning in a document. As a typical multi-label classification problem, DocRE faces the challenge of effectively…

Computation and Language · Computer Science 2023-04-04 Jia Guo , Stanley Kok , Lidong Bing

Relation Extraction (RE) has attracted increasing attention, but current RE evaluation is limited to in-domain evaluation setups. Little is known on how well a RE system fares in challenging, but realistic out-of-distribution evaluation…

Computation and Language · Computer Science 2022-10-19 Elisa Bassignana , Barbara Plank

Relation extraction (RE) aims to predict a relation between a subject and an object in a sentence, while knowledge graph link prediction (KGLP) aims to predict a set of objects, O, given a subject and a relation from a knowledge graph.…

Computation and Language · Computer Science 2020-12-10 George Stoica , Emmanouil Antonios Platanios , Barnabás Póczos

Retrieval-Augmented Generation (RAG) aims to generate more reliable and accurate responses, by augmenting large language models (LLMs) with the external vast and dynamic knowledge. Most previous work focuses on using RAG for single-round…

Artificial Intelligence · Computer Science 2024-03-28 Linhao Ye , Zhikai Lei , Jianghao Yin , Qin Chen , Jie Zhou , Liang He

Document-level relation extraction (DocRE) is the process of identifying and extracting relations between entities that span multiple sentences within a document. Due to its realistic settings, DocRE has garnered increasing research…

Computation and Language · Computer Science 2025-03-19 Zhichao Duan , Tengyu Pan , Zhenyu Li , Xiuxing Li , Jianyong Wang

Retrieval-Augmented Generation (RAG) improves Large Language Model (LLM) performance on knowledge-intensive tasks but depends heavily on initial search query quality. Current methods, often using Reinforcement Learning (RL), typically focus…

Computation and Language · Computer Science 2025-04-16 Alan Dao , Thinh Le

Most successful information extraction systems operate with access to a large collection of documents. In this work, we explore the task of acquiring and incorporating external evidence to improve extraction accuracy in domains where the…

Computation and Language · Computer Science 2016-09-29 Karthik Narasimhan , Adam Yala , Regina Barzilay

Real-world data, such as news articles, social media posts, and chatbot conversations, is inherently dynamic and non-stationary, presenting significant challenges for constructing real-time structured representations through knowledge…

Computation and Language · Computer Science 2025-08-26 Sefika Efeoglu , Adrian Paschke , Sonja Schimmler