中文
相关论文

相关论文: Named Entity and Relation Extraction with Multi-Mo…

200 篇论文

Entity and Relation Extraction (ERE) is an important task in information extraction. Recent marker-based pipeline models achieve state-of-the-art performance, but still suffer from the error propagation issue. Also, most of current ERE…

计算与语言 · 计算机科学 2023-10-27 Zhaohui Yan , Songlin Yang , Wei Liu , Kewei Tu

Grounded Multimodal Named Entity Recognition (GMNER) is a nascent multimodal task that aims to identify named entities, entity types and their corresponding visual regions. GMNER task exhibits two challenging properties: 1) The weak…

计算机视觉与模式识别 · 计算机科学 2024-05-30 Jinyuan Li , Han Li , Di Sun , Jiahao Wang , Wenkun Zhang , Zan Wang , Gang Pan

Document-level relation extraction (DocRE) is the process of identifying and extracting relations between entities that span multiple sentences within a document. Due to its realistic settings, DocRE has garnered increasing research…

计算与语言 · 计算机科学 2025-03-19 Zhichao Duan , Tengyu Pan , Zhenyu Li , Xiuxing Li , Jianyong Wang

Scaling up the number of parameters of language models has proven to be an effective approach to improve performance. For dense models, increasing model size proportionally increases the model's computation footprint. In this work, we seek…

计算与语言 · 计算机科学 2023-11-21 Cicero Nogueira dos Santos , James Lee-Thorp , Isaac Noble , Chung-Ching Chang , David Uthus

Multimodal relation extraction is an essential task for knowledge graph construction. In this paper, we take an in-depth empirical analysis that indicates the inaccurate information in the visual scene graph leads to poor modal alignment…

计算与语言 · 计算机科学 2022-11-15 Lei Li , Xiang Chen , Shuofei Qiao , Feiyu Xiong , Huajun Chen , Ningyu Zhang

Unsupervised relation extraction (URE) extracts relations between named entities from raw text without manually-labelled data and existing knowledge bases (KBs). URE methods can be categorised into generative and discriminative approaches,…

计算与语言 · 计算机科学 2020-05-04 Thy Thy Tran , Phong Le , Sophia Ananiadou

Entity relation extraction consists of two sub-tasks: entity recognition and relation extraction. Existing methods either tackle these two tasks separately or unify them with word-by-word interactions. In this paper, we propose HIORE, a new…

计算与语言 · 计算机科学 2023-05-09 Yijun Wang , Changzhi Sun , Yuanbin Wu , Lei Li , Junchi Yan , Hao Zhou

While Dense Retrieval Models (DRMs) have advanced Information Retrieval (IR), one limitation of these neural models is their narrow generalizability and robustness. To cope with this issue, one can leverage the Mixture-of-Experts (MoE)…

信息检索 · 计算机科学 2024-12-17 Effrosyni Sokli , Pranav Kasela , Georgios Peikos , Gabriella Pasi

Transformer-based text embedding models have improved their performance on benchmarks like MIRACL and BEIR by increasing their parameter counts. However, this scaling approach introduces significant deployment challenges, including…

计算与语言 · 计算机科学 2025-03-11 Zach Nussbaum , Brandon Duderstadt

Composed Image Retrieval (CIR) uses a reference image and a modification text as a query to retrieve a target image satisfying the requirement of ``modifying the reference image according to the text instructions''. However, existing CIR…

计算机视觉与模式识别 · 计算机科学 2026-04-01 Guozhi Qiu , Zhiwei Chen , Zixu Li , Qinlei Huang , Zhiheng Fu , Xuemeng Song , Yupeng Hu

Joint entity and relation extraction (JERE) is one of the most important tasks in information extraction. However, most existing works focus on sentence-level coarse-grained JERE, which have limitations in real-world scenarios. In this…

计算与语言 · 计算机科学 2023-03-22 Hongbo Wang , Weimin Xiong , Yifan Song , Dawei Zhu , Yu Xia , Sujian Li

Events describe the state changes of entities. In a document, multiple events are connected by various relations (e.g., Coreference, Temporal, Causal, and Subevent). Therefore, obtaining the connections between events through Event-Event…

计算与语言 · 计算机科学 2024-03-20 Haochen Li , Di Geng

The Entity Set Expansion (ESE) task aims to expand a handful of seed entities with new entities belonging to the same semantic class. Conventional ESE methods are based on mono-modality (i.e., literal modality), which struggle to deal with…

计算与语言 · 计算机科学 2023-07-28 Yangning Li , Tingwei Lu , Yinghui Li , Tianyu Yu , Shulin Huang , Hai-Tao Zheng , Rui Zhang , Jun Yuan

Knowledge is a formal way of understanding the world, providing a human-level cognition and intelligence for the next-generation artificial intelligence (AI). One of the representations of knowledge is semantic relations between entities.…

计算与语言 · 计算机科学 2021-02-09 Hailin Wang , Ke Qin , Rufai Yusuf Zakari , Guoming Lu , Jin Yin

Multimodal information extraction on social media is a series of fundamental tasks to construct the multimodal knowledge graph. The tasks aim to extract the structural information in free texts with the incorporate images, including:…

多媒体 · 计算机科学 2025-02-24 Baohang Zhou , Ying Zhang , Yu Zhao , Xuhui Sui , Xiaojie Yuan

The advancement of transformer neural networks has significantly elevated the capabilities of sentence similarity models, but they still struggle with highly discriminative tasks and may produce sub-optimal representations of important…

机器学习 · 计算机科学 2024-12-19 Logan Hallee , Rohan Kapur , Arjun Patel , Jason P. Gleghorn , Bohdan Khomtchouk

Large Language Models (LLMs) have shown proficiency in question-answering tasks but often struggle to integrate real-time knowledge, leading to potentially outdated or inaccurate responses. This problem becomes even more challenging when…

计算与语言 · 计算机科学 2024-08-15 Yucheng Shi , Qiaoyu Tan , Xuansheng Wu , Shaochen Zhong , Kaixiong Zhou , Ninghao Liu

Grounded Multimodal Named Entity Recognition (GMNER) task aims to identify named entities, entity types and their corresponding visual regions. GMNER task exhibits two challenging attributes: 1) The tenuous correlation between images and…

多媒体 · 计算机科学 2025-09-03 Jinyuan Li , Ziyan Li , Han Li , Jianfei Yu , Rui Xia , Di Sun , Gang Pan

Recently, model-based retrieval has emerged as a new paradigm in text retrieval that discards the index in the traditional retrieval model and instead memorizes the candidate corpora using model parameters. This design employs a…

信息检索 · 计算机科学 2023-05-19 Ruiyang Ren , Wayne Xin Zhao , Jing Liu , Hua Wu , Ji-Rong Wen , Haifeng Wang

Neural models have achieved remarkable success on relation extraction (RE) benchmarks. However, there is no clear understanding which type of information affects existing RE models to make decisions and how to further improve the…

计算与语言 · 计算机科学 2020-12-02 Hao Peng , Tianyu Gao , Xu Han , Yankai Lin , Peng Li , Zhiyuan Liu , Maosong Sun , Jie Zhou