English
Related papers

Related papers: Instruct and Extract: Instruction Tuning for On-De…

200 papers

Large language models (LLMs), such as GPT-3 and ChatGPT, have demonstrated remarkable results in various natural language processing (NLP) tasks with in-context learning, which involves inference based on a few demonstration examples.…

Computation and Language · Computer Science 2023-08-22 Jiabang He , Lei Wang , Yi Hu , Ning Liu , Hui Liu , Xing Xu , Heng Tao Shen

A constantly growing amount of information is available through the web. Unfortunately, extracting useful content from this massive amount of data still remains an open issue. The lack of standard data models and structures forces…

Databases · Computer Science 2016-03-25 Juan M. Tirado , Ovidiu Serban , Qiang Guo , Eiko Yoneki

Event extraction (EE) is a crucial research task for promptly apprehending event information from massive textual data. With the rapid development of deep learning, EE based on deep learning technology has become a research hotspot.…

Computation and Language · Computer Science 2022-11-16 Qian Li , Jianxin Li , Jiawei Sheng , Shiyao Cui , Jia Wu , Yiming Hei , Hao Peng , Shu Guo , Lihong Wang , Amin Beheshti , Philip S. Yu

Extracting structured information from unstructured text is critical for many downstream NLP applications and is traditionally achieved by closed information extraction (cIE). However, existing approaches for cIE suffer from two…

Computation and Language · Computer Science 2024-04-22 Nacime Bouziani , Shubhi Tyagi , Joseph Fisher , Jens Lehmann , Andrea Pierleoni

In recent years, Open Educational Resources (OERs) were earmarked as critical when mitigating the increasing need for education globally. Obviously, OERs have high-potential to satisfy learners in many different circumstances, as they are…

Computers and Society · Computer Science 2020-06-22 Mohammadreza Molavi , Mohammadreza Tavakoli , Gábor Kismihók

This study presents OpenExtract, an open-source pipeline for automated data extraction in large-scale systematic literature reviews. The pipeline queries large language models (LLMs) to predict data entries based on relevant sections of…

Extracting information from full documents is an important problem in many domains, but most previous work focus on identifying relationships within a sentence or a paragraph. It is challenging to create a large-scale information extraction…

Computation and Language · Computer Science 2020-05-04 Sarthak Jain , Madeleine van Zuylen , Hannaneh Hajishirzi , Iz Beltagy

Definition bias is a negative phenomenon that can mislead models. Definition bias in information extraction appears not only across datasets from different domains but also within datasets sharing the same domain. We identify two types of…

Computation and Language · Computer Science 2024-03-26 Wenhao Huang , Qianyu He , Zhixu Li , Jiaqing Liang , Yanghua Xiao

We present a new formulation for structured information extraction (SIE) from visually rich documents. It aims to address the limitations of existing IOB tagging or graph-based formulations, which are either overly reliant on the correct…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Haofu Liao , Aruni RoyChowdhury , Weijian Li , Ankan Bansal , Yuting Zhang , Zhuowen Tu , Ravi Kumar Satzoda , R. Manmatha , Vijay Mahadevan

Open Information Extraction (Open IE) is the task of extracting structured information from textual documents, independent of domain. While traditional Open IE methods were based on unsupervised approaches, recently, with the emergence of…

Computation and Language · Computer Science 2025-01-22 Marlo Souza , Bruno Cabral , Daniela Claro , Lais Salvador

Information Extraction (IE) from scientific texts can be used to guide readers to the central information in scientific documents. But narrow IE systems extract only a fraction of the information captured, and Open IE systems do not perform…

Computation and Language · Computer Science 2020-05-27 Ruben Kruiper , Julian F. V. Vincent , Jessica Chen-Burger , Marc P. Y. Desmulliez , Ioannis Konstas

Open relation extraction is the task of extracting open-domain relation facts from natural language sentences. Existing works either utilize heuristics or distant-supervised annotations to train a supervised classifier over pre-defined…

Computation and Language · Computer Science 2020-10-07 Xuming Hu , Chenwei Zhang , Yusong Xu , Lijie Wen , Philip S. Yu

The task of Information Extraction (IE) involves automatically converting unstructured textual content into structured data. Most research in this field concentrates on extracting all facts or a specific set of relationships from documents.…

Computation and Language · Computer Science 2024-01-19 Nicolas Gutehrlé , Iana Atanassova

Information Extraction (IE) plays a crucial role in Natural Language Processing (NLP) by extracting structured information from unstructured text, thereby facilitating seamless integration with various real-world applications that rely on…

Computation and Language · Computer Science 2024-06-05 Yida Cai , Hao Sun , Hsiu-Yuan Huang , Yunfang Wu

In recent years, instruction tuning has gained increasing attention and emerged as a crucial technique to enhance the capabilities of Large Language Models (LLMs). To construct high-quality instruction datasets, many instruction processing…

Computation and Language · Computer Science 2024-06-25 Yixin Ou , Ningyu Zhang , Honghao Gui , Ziwen Xu , Shuofei Qiao , Yida Xue , Runnan Fang , Kangwei Liu , Lei Li , Zhen Bi , Guozhou Zheng , Huajun Chen

In this work, we study the effect of annotation guidelines -- textual descriptions of event types and arguments, when instruction-tuning large language models for event extraction. We conducted a series of experiments with both…

Computation and Language · Computer Science 2025-05-30 Saurabh Srivastava , Sweta Pati , Ziyu Yao

Table extraction from PDF and image documents is a ubiquitous task in the real-world. Perfect extraction quality is difficult to achieve with one single out-of-box model due to (1) the wide variety of table styles, (2) the lack of training…

Human-Computer Interaction · Computer Science 2021-02-18 Nancy Xin Ru Wang , Douglas Burdick , Yunyao Li

The in-context learning (ICL) for relational triple extraction (RTE) has achieved promising performance, but still encounters two key challenges: (1) how to design effective prompts and (2) how to select proper demonstrations. Existing…

Computation and Language · Computer Science 2024-02-22 Guozheng Li , Wenjun Ke , Peng Wang , Zijie Xu , Ke Ji , Jiajun Liu , Ziyu Shang , Qiqing Luo

In this paper, we propose Multi$^2$OIE, which performs open information extraction (open IE) by combining BERT with multi-head attention. Our model is a sequence-labeling system with an efficient and effective argument extraction method. We…

Computation and Language · Computer Science 2020-12-08 Youngbin Ro , Yukyung Lee , Pilsung Kang

Diverse instruction data is vital for effective instruction tuning of large language models, as it enables the model to generalize across different types of inputs . Building such diversified instruction dataset is an essential step in this…

Artificial Intelligence · Computer Science 2025-08-29 Simin Ma , Shujian Liu , Jun Tan , Yebowen Hu , Song Wang , Sathish Reddy Indurthi , Sanqiang Zhao , Liwei Wu , Jianbing Han , Kaiqiang Song