English
Related papers

Related papers: Code-MIE: A Code-style Model for Multimodal Inform…

200 papers

Event extraction (EE) is a fundamental task in natural language processing (NLP) that involves identifying and extracting event information from unstructured text. Effective EE in real-world scenarios requires two key steps: selecting…

Computation and Language · Computer Science 2025-05-14 Sheng Liang , Hang Lv , Zhihao Wen , Yaxiong Wu , Yongyue Zhang , Hao Wang , Yong Liu

(Renyi Qu's Master's Thesis) Recent advancements in interpretable models for vision-language tasks have achieved competitive performance; however, their interpretability often suffers due to the reliance on unstructured text outputs from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Renyi Qu , Mark Yatskar

Large Language Models (LLMs) demonstrate remarkable potential across various domains; however, they exhibit a significant performance gap in Information Extraction (IE). Note that high-quality instruction data is the vital key for enhancing…

Computation and Language · Computer Science 2024-05-28 Honghao Gui , Lin Yuan , Hongbin Ye , Ningyu Zhang , Mengshu Sun , Lei Liang , Huajun Chen

Knowledge understanding is a foundational part of envisioned 6G networks to advance network intelligence and AI-native network architectures. In this paradigm, information extraction plays a pivotal role in transforming fragmented telecom…

Computation and Language · Computer Science 2025-05-22 Ye Yuan , Haolun Wu , Hao Zhou , Xue Liu , Hao Chen , Yan Xin , Jianzhong , Zhang

This paper proposes a structure-aware decoding method based on large language models to address the difficulty of traditional approaches in maintaining both semantic integrity and structural consistency in nested and overlapping entity…

Computation and Language · Computer Science 2026-01-29 Zhimin Qiu , Di Wu , Feng Liu , Yuxiao Wang

Multimodal information extraction (MIE) is crucial for scientific literature, where valuable data is often spread across text, figures, and tables. In materials science, extracting structured information from research articles can…

Computation and Language · Computer Science 2024-10-29 Ghazal Khalighinejad , Sharon Scott , Ollie Liu , Kelly L. Anderson , Rickard Stureborg , Aman Tyagi , Bhuwan Dhingra

Recently, Visual Information Extraction (VIE) has been becoming increasingly important in both the academia and industry, due to the wide range of real-world applications. Previously, numerous works have been proposed to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Zhibo Yang , Rujiao Long , Pengfei Wang , Sibo Song , Humen Zhong , Wenqing Cheng , Xiang Bai , Cong Yao

Existing research on multimodal relation extraction (MRE) faces two co-existing challenges, internal-information over-utilization and external-information under-exploitation. To combat that, we propose a novel framework that simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Shengqiong Wu , Hao Fei , Yixin Cao , Lidong Bing , Tat-Seng Chua

Universal Information Extraction~(Universal IE) aims to solve different extraction tasks in a uniform text-to-structure generation manner. Such a generation procedure tends to struggle when there exist complex information structures to be…

Computation and Language · Computer Science 2023-06-21 Xin Cong. Bowen Yu , Mengcheng Fang , Tingwen Liu , Haiyang Yu , Zhongkai Hu , Fei Huang , Yongbin Li , Bin Wang

The multi-format information extraction task in the 2021 Language and Intelligence Challenge is designed to comprehensively evaluate information extraction from different dimensions. It consists of an multiple slots relation extraction…

Computation and Language · Computer Science 2021-08-17 Yaduo Liu , Longhui Zhang , Shujuan Yin , Xiaofeng Zhao , Feiliang Ren

Empirical evidence indicates that LLMs exhibit spontaneous cross-lingual alignment. However, although LLMs show promising cross-lingual alignment in Information Extraction (IE), a significant imbalance across languages persists,…

Computation and Language · Computer Science 2025-06-03 Yuxin Zuo , Wenxuan Jiang , Wenxuan Liu , Zixuan Li , Long Bai , Hanbin Wang , Yutao Zeng , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Human-like large language models (LLMs), especially the most powerful and popular ones in OpenAI's GPT family, have proven to be very helpful for many natural language processing (NLP) related tasks. Therefore, various attempts have been…

Computation and Language · Computer Science 2024-09-11 Ridong Han , Chaohao Yang , Tao Peng , Prayag Tiwari , Xiang Wan , Lu Liu , Benyou Wang

Human-like large language models (LLMs), especially the most powerful and popular ones in OpenAI's GPT family, have proven to be very helpful for many natural language processing (NLP) related tasks. Therefore, various attempts have been…

Computation and Language · Computer Science 2024-09-12 Ridong Han , Chaohao Yang , Tao Peng , Prayag Tiwari , Xiang Wan , Lu Liu , Benyou Wang

We consider the problem of Open-world Information Extraction (Open-world IE), which extracts comprehensive entity profiles from unstructured texts. Different from the conventional closed-world setting of Information Extraction (IE),…

Computation and Language · Computer Science 2023-05-25 Keming Lu , Xiaoman Pan , Kaiqiang Song , Hongming Zhang , Dong Yu , Jianshu Chen

Multi-modal named entity recognition (NER) and relation extraction (RE) aim to leverage relevant image information to improve the performance of NER and RE. Most existing efforts largely focused on directly extracting potentially useful…

Computation and Language · Computer Science 2022-12-06 Xinyu Wang , Jiong Cai , Yong Jiang , Pengjun Xie , Kewei Tu , Wei Lu

Data is published on the web over time in great volumes, but majority of the data is unstructured, making it hard to understand and difficult to interpret. Information Extraction (IE) methods obtain structured information from unstructured…

Computation and Language · Computer Science 2021-11-11 Ali Balali , Masoud Asadpour , Seyed Hossein Jafari

Information extraction (IE) plays very important role in natural language processing (NLP) and is fundamental to many NLP applications that used to extract structured information from unstructured text data. Heuristic-based searching and…

Computation and Language · Computer Science 2023-07-04 Shiyu Yuan , Carlo Lipizzi

In the field of Natural Language Processing (NLP), Large Language Models (LLMs) have shown great potential in document-level event extraction tasks, but existing methods face challenges in the design of prompts. To address this issue, we…

Computation and Language · Computer Science 2024-08-13 Zhuoyuan Liu , Yilin Luo

Constructing large-scaled medical knowledge graphs can significantly boost healthcare applications for medical surveillance, bring much attention from recent research. An essential step in constructing large-scale MKG is extracting…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jialun Wu , Yang Liu , Zeyu Gao , Tieliang Gong , Chunbao Wang , Chen Li

Masked image modeling (MIM) has been recognized as a strong self-supervised pre-training approach in the vision domain. However, the mechanism and properties of the learned representations by such a scheme, as well as how to further enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Kevin Zhang , Zhiqiang Shen