English
Related papers

Related papers: Probing Linguistic Features of Sentence-Level Repr…

200 papers

Although much effort has recently been devoted to training high-quality sentence embeddings, we still have a poor understanding of what they are capturing. "Downstream" tasks, often based on sentence classification, are commonly used to…

Computation and Language · Computer Science 2018-07-10 Alexis Conneau , German Kruszewski , Guillaume Lample , Loïc Barrault , Marco Baroni

Information Extraction (IE) is crucial for converting unstructured data into structured formats like Knowledge Graphs (KGs). A key task within IE is Relation Extraction (RE), which identifies relationships between entities in text. Various…

Computation and Language · Computer Science 2024-06-25 Sefika Efeoglu , Adrian Paschke

Knowledge-enhanced pre-trained models for language representation have been shown to be more effective in knowledge base construction tasks (i.e.,~relation extraction) than language models such as BERT. These knowledge-enhanced language…

Computation and Language · Computer Science 2022-10-25 Jiacheng Li , Yannis Katsis , Tyler Baldwin , Ho-Cheol Kim , Andrew Bartko , Julian McAuley , Chun-Nan Hsu

Relation extraction (RE) aims to identify relations between entities mentioned in texts. Although large language models (LLMs) have demonstrated impressive in-context learning (ICL) abilities in various tasks, they still suffer from poor…

Computation and Language · Computer Science 2024-04-30 Guozheng Li , Peng Wang , Wenjun Ke , Yikai Guo , Ke Ji , Ziyu Shang , Jiajun Liu , Zijie Xu

Probing is widely used to study which features can be decoded from language model representations. However, the common decoding probe approach has two limitations that we aim to solve with our new encoding probe approach: contributions of…

Computation and Language · Computer Science 2026-05-04 Gaofei Shen , Martijn Bentum , Tom Lentz , Afra Alishahi , Grzegorz Chrupała

Document-level relation extraction (RE) aims to extract the relations between entities from the input document that usually containing many difficultly-predicted entity pairs whose relations can only be predicted through relational…

Computation and Language · Computer Science 2022-11-29 Liang Zhang , Jinsong Su , Yidong Chen , Zhongjian Miao , Zijun Min , Qingguo Hu , Xiaodong Shi

Relation Extraction (RE) is a pivotal task in automatically extracting structured information from unstructured text. In this paper, we present a multi-faceted approach that integrates representative examples and through co-set expansion.…

Computation and Language · Computer Science 2023-08-24 Yerong Li , Roxana Girju

Relation classification is an important NLP task to extract relations between entities. The state-of-the-art methods for relation classification are primarily based on Convolutional or Recurrent Neural Networks. Recently, the pre-trained…

Computation and Language · Computer Science 2019-05-22 Shanchan Wu , Yifan He

In this work, we aim at equipping pre-trained language models with structured knowledge. We present two self-supervised tasks learning over raw text with the guidance from knowledge graphs. Building upon entity-level masked language models,…

Computation and Language · Computer Science 2020-04-30 Tao Shen , Yi Mao , Pengcheng He , Guodong Long , Adam Trischler , Weizhu Chen

Named entity recognition (NER) is highly sensitive to sentential syntactic and semantic properties where entities may be extracted according to how they are used and placed in the running text. To model such properties, one could rely on…

Computation and Language · Computer Science 2020-10-30 Yuyang Nie , Yuanhe Tian , Yan Song , Xiang Ao , Xiang Wan

Existing in-context learning (ICL) methods for relation extraction (RE) often prioritize language similarity over structural similarity, which can lead to overlooking entity relationships. To address this, we propose an AMR-enhanced…

Computation and Language · Computer Science 2025-04-28 Peitao Han , Lis Kanashiro Pereira , Fei Cheng , Wan Jou She , Eiji Aramaki

Relation Extraction (RE) is a fundamental task of information extraction, which has attracted a large amount of research attention. Previous studies focus on extracting the relations within a sentence or document, while currently…

Computation and Language · Computer Science 2022-11-01 Fengqi Wang , Fei Li , Hao Fei , Jingye Li , Shengqiong Wu , Fangfang Su , Wenxuan Shi , Donghong Ji , Bo Cai

Entity types and textual context are essential properties for sentence-level relation extraction (RE). Existing work only encodes these properties within individual instances, which limits the performance of RE given the insufficient…

Computation and Language · Computer Science 2022-05-10 Yiwei Wang , Muhao Chen , Wenxuan Zhou , Yujun Cai , Yuxuan Liang , Bryan Hooi

Relation extraction (RE) aims at extracting the relation between two entities from the text corpora. It is a crucial task for Knowledge Graph (KG) construction. Most existing methods predict the relation between an entity pair by learning…

Computation and Language · Computer Science 2020-11-30 Jun Kuang , Yixin Cao , Jianbing Zheng , Xiangnan He , Ming Gao , Aoying Zhou

Contextual word representations derived from large-scale neural language models are successful across a diverse set of NLP tasks, suggesting that they encode useful and transferable features of language. To shed light on the linguistic…

Computation and Language · Computer Science 2019-04-29 Nelson F. Liu , Matt Gardner , Yonatan Belinkov , Matthew E. Peters , Noah A. Smith

Multi-modal named entity recognition (NER) and relation extraction (RE) aim to leverage relevant image information to improve the performance of NER and RE. Most existing efforts largely focused on directly extracting potentially useful…

Computation and Language · Computer Science 2022-12-06 Xinyu Wang , Jiong Cai , Yong Jiang , Pengjun Xie , Kewei Tu , Wei Lu

Language models have been shown to be rich enough to encode fMRI activations of certain Regions of Interest in our Brains. Previous works have explored transfer learning from representations learned for popular natural language processing…

Computation and Language · Computer Science 2023-11-10 Arvindh Arun , Jerrin John , Sanjai Kumaran

Named Entity Recognition (NER) and Relation Extraction (RE) are essential tools in distilling knowledge from biomedical literature. This paper presents our findings from participating in BioNLP Shared Tasks 2019. We addressed Named Entity…

Computation and Language · Computer Science 2019-10-09 Usama Yaseen , Pankaj Gupta , Hinrich Schütze

End-to-end relation extraction aims to identify named entities and extract relations between them. Most recent work models these two subtasks jointly, either by casting them in one structured prediction framework, or performing multi-task…

Computation and Language · Computer Science 2021-03-24 Zexuan Zhong , Danqi Chen

Sentence-level relation extraction (RE) aims to identify the relationship between 2 entities given a contextual sentence. While there have been many attempts to solve this problem, the current solutions have a lot of room to improve. In…

Computation and Language · Computer Science 2023-07-04 N Harsha Vardhan , Manav Chaudhary