English
Related papers

Related papers: ChatIE: Zero-Shot Information Extraction via Chatt…

200 papers

Large Language Models (LLMs) demonstrate remarkable potential across various domains; however, they exhibit a significant performance gap in Information Extraction (IE). Note that high-quality instruction data is the vital key for enhancing…

Computation and Language · Computer Science 2024-05-28 Honghao Gui , Lin Yuan , Hongbin Ye , Ningyu Zhang , Mengshu Sun , Lei Liang , Huajun Chen

Recent research in zero-shot Relation Extraction (RE) has focused on using Large Language Models (LLMs) due to their impressive zero-shot capabilities. However, current methods often perform suboptimally, mainly due to a lack of detailed,…

Information Retrieval · Computer Science 2024-12-24 Siyi Liu , Yang Li , Jiang Li , Shan Yang , Yunshi Lan

Learning template based information extraction from documents is a crucial yet difficult task. Prior template-based IE approaches assume foreknowledge of the domain templates; however, real-world IE do not have pre-defined schemas and it is…

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-specific input text…

Computation and Language · Computer Science 2021-09-24 Chenguang Wang , Xiao Liu , Zui Chen , Haoyun Hong , Jie Tang , Dawn Song

Large Language Models (LLMs) have emerged as influential instruments within the realm of natural language processing; nevertheless, their capacity to handle multi-party conversations (MPCs) -- a scenario marked by the presence of multiple…

Computation and Language · Computer Science 2023-10-26 Chao-Hong Tan , Jia-Chen Gu , Zhen-Hua Ling

Large language models (LLMs), such as GPT-3 and ChatGPT, have demonstrated remarkable results in various natural language processing (NLP) tasks with in-context learning, which involves inference based on a few demonstration examples.…

Computation and Language · Computer Science 2023-08-22 Jiabang He , Lei Wang , Yi Hu , Ning Liu , Hui Liu , Xing Xu , Heng Tao Shen

Pre-trained large language models, such as ChatGPT, archive outstanding performance in various reasoning tasks without supervised training and were found to have outperformed crowdsourcing workers. Nonetheless, ChatGPT's performance in the…

Computation and Language · Computer Science 2024-02-08 Frances Yung , Mansoor Ahmad , Merel Scholman , Vera Demberg

Large Language Models (LLMs) have made remarkable strides in various tasks. Whether LLMs are competitive few-shot solvers for information extraction (IE) tasks, however, remains an open problem. In this work, we aim to provide a thorough…

Computation and Language · Computer Science 2024-04-15 Yubo Ma , Yixin Cao , YongChing Hong , Aixin Sun

Information extraction (IE) systems aim to automatically extract structured information, such as named entities, relations between entities, and events, from unstructured texts. While most existing work addresses a particular IE task,…

Computation and Language · Computer Science 2023-05-22 Chang Gao , Wenxuan Zhang , Wai Lam , Lidong Bing

Following the hype around OpenAI's ChatGPT conversational agent, the last straw in the recent development of Large Language Models (LLMs) that demonstrate emergent unprecedented zero-shot capabilities, we audit the latest OpenAI's GPT-3.5…

Computation and Language · Computer Science 2023-04-25 Ilias Chalkidis

Large, high-quality annotated corpora remain scarce in document-level entity and relation extraction in zero-shot or few-shot settings. In this paper, we present a fully automatic, LLM-based pipeline for synthetic data generation and…

Computation and Language · Computer Science 2025-07-09 Nicholas Popovič , Ashish Kangen , Tim Schopf , Michael Färber

This paper aims to quantitatively evaluate the performance of ChatGPT, an interactive large language model, on inter-sentential relations such as temporal relations, causal relations, and discourse relations. Given ChatGPT's promising…

Computation and Language · Computer Science 2024-01-29 Chunkit Chan , Jiayang Cheng , Weiqi Wang , Yuxin Jiang , Tianqing Fang , Xin Liu , Yangqiu Song

We introduce a large language model (LLM) based approach to answer complex questions requiring multi-hop numerical reasoning over financial reports. While LLMs have exhibited remarkable performance on various natural language and reasoning…

Computation and Language · Computer Science 2023-11-28 Karmvir Singh Phogat , Chetan Harsha , Sridhar Dasaratha , Shashishekar Ramakrishna , Sai Akhil Puranam

Retrained large language models (LLMs) have become extensively used across various sub-disciplines of natural language processing (NLP). In NLP, text classification problems have garnered considerable focus, but still faced with some…

Computation and Language · Computer Science 2023-12-05 Zhiqiang Wang , Yiran Pang , Yanbin Lin

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger…

Although large language models(LLMs) show amazing capabilities, among various exciting applications discovered for LLMs fall short in other low-resource languages. Besides, most existing methods depend on large-scale dialogue corpora and…

Computation and Language · Computer Science 2024-08-19 Yongkang Liu , Feng Shi , Daling Wang , Yifei Zhang , Hinrich Schütze

We introduce ZeroSCROLLS, a zero-shot benchmark for natural language understanding over long texts, which contains only test and small validation sets, without training data. We adapt six tasks from the SCROLLS benchmark, and add four new…

Computation and Language · Computer Science 2023-12-19 Uri Shaham , Maor Ivgi , Avia Efrat , Jonathan Berant , Omer Levy

This paper takes an exploratory approach to examine the use of ChatGPT for pattern mining. It proposes an eight-step collaborative process that combines human insight with AI capabilities to extract patterns from known uses. The paper…

Artificial Intelligence · Computer Science 2024-12-24 Michael Weiss

Prompts are how humans communicate with LLMs. Informative prompts are essential for guiding LLMs to produce the desired output. However, prompt engineering is often tedious and time-consuming, requiring significant expertise, limiting its…

Computation and Language · Computer Science 2024-08-09 Liat Ein-Dor , Orith Toledo-Ronen , Artem Spector , Shai Gretz , Lena Dankin , Alon Halfon , Yoav Katz , Noam Slonim

In any system that uses structured knowledge graph (KG) data as its underlying knowledge representation, KG-to-text generation is a useful tool for turning parts of the graph data into text that can be understood by humans. Recent work has…

Computation and Language · Computer Science 2023-08-23 Agnes Axelsson , Gabriel Skantze