English
Related papers

Related papers: Leveraging Codebook Knowledge with NLI and ChatGPT…

200 papers

Zero-shot dialogue understanding aims to enable dialogue to track the user's needs without any training data, which has gained increasing attention. In this work, we investigate the understanding ability of ChatGPT for zero-shot dialogue…

Computation and Language · Computer Science 2023-04-11 Wenbo Pan , Qiguang Chen , Xiao Xu , Wanxiang Che , Libo Qin

Recent studies have demonstrated promising potential of ChatGPT for various text annotation and classification tasks. However, ChatGPT is non-deterministic which means that, as with human coders, identical input can lead to different…

Computation and Language · Computer Science 2023-04-24 Michael V. Reiss

Zero-shot keyphrase extraction aims to build a keyphrase extractor without training by human-annotated data, which is challenging due to the limited human intervention involved. Challenging but worthwhile, zero-shot setting efficiently…

Computation and Language · Computer Science 2024-01-11 Mingyang Song , Xuelian Geng , Songfang Yao , Shilong Lu , Yi Feng , Liping Jing

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger…

Zero-shot learning aims to recognize instances of unseen classes, for which no visual instance is available during training, by learning multimodal relations between samples from seen classes and corresponding class semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Yannick Le Cacheux , Hervé Le Borgne , Michel Crucianu

Recently large language models (LLMs) like ChatGPT have shown impressive performance on many natural language processing tasks with zero-shot. In this paper, we investigate the effectiveness of zero-shot LLMs in the financial domain. We…

Computation and Language · Computer Science 2023-05-29 Agam Shah , Sudheer Chava

We introduce ZeroSCROLLS, a zero-shot benchmark for natural language understanding over long texts, which contains only test and small validation sets, without training data. We adapt six tasks from the SCROLLS benchmark, and add four new…

Computation and Language · Computer Science 2023-12-19 Uri Shaham , Maor Ivgi , Avia Efrat , Jonathan Berant , Omer Levy

This study investigates the capabilities of large language models (LLMs), specifically ChatGPT, in annotating MT outputs based on an error typology. In contrast to previous work focusing mainly on general language, we explore ChatGPT's…

Computation and Language · Computer Science 2025-04-22 Joachim Minder , Guillaume Wisniewski , Natalie Kübler

Pre-trained language models have been widely used in dependency parsing task and have achieved significant improvements in parser performance. However, it remains an understudied question whether pre-trained language models can…

Computation and Language · Computer Science 2023-10-26 Boda Lin , Xinyi Zhou , Binghao Tang , Xiaocheng Gong , Si Li

With the development of foundation models such as large language models, zero-shot transfer learning has become increasingly significant. This is highlighted by the generative capabilities of NLP models like GPT-4, and the retrieval-based…

Machine Learning · Computer Science 2024-06-25 Yuhan Li , Peisong Wang , Zhixun Li , Jeffrey Xu Yu , Jia Li

Zero-shot link prediction (ZSLP) on knowledge graphs aims at automatically identifying relations between given entities. Existing methods primarily employ auxiliary information to predict tail entity given head entity and its relation, yet…

Computation and Language · Computer Science 2024-11-27 Mingchen Li , Chen Ling , Rui Zhang , Liang Zhao

Relation extraction (RE) consistently involves a certain degree of labeled or unlabeled data even if under zero-shot setting. Recent studies have shown that large language models (LLMs) transfer well to new tasks out-of-the-box simply given…

Artificial Intelligence · Computer Science 2023-11-27 Guozheng Li , Peng Wang , Wenjun Ke

Recently, various illustrative examples have shown the impressive ability of generative large language models (LLMs) to perform NLP related tasks. ChatGPT undoubtedly is the most representative model. We empirically evaluate ChatGPT's…

Software Engineering · Computer Science 2023-07-20 Jianzhang Zhang , Yiyang Chen , Nan Niu , Yinglin Wang , Chuang Liu

Recently, Large Language Models like ChatGPT have demonstrated remarkable proficiency in various Natural Language Processing tasks. Their application in Requirements Engineering, especially in requirements classification, has gained…

Artificial Intelligence · Computer Science 2024-04-17 Abdelkarim El-Hajjami , Nicolas Fafin , Camille Salinesi

We propose a zero-shot learning relation classification (ZSLRC) framework that improves on state-of-the-art by its ability to recognize novel relations that were not present in training data. The zero-shot learning approach mimics the way…

Computation and Language · Computer Science 2021-11-22 Jiaying Gong , Hoda Eldardiry

The Zero-Shot Learning (ZSL) task pertains to the identification of entities or relations in texts that were not seen during training. ZSL has emerged as a critical research area due to the scarcity of labeled data in specific domains, and…

Computation and Language · Computer Science 2023-07-26 Gabriele Picco , Marcos Martínez Galindo , Alberto Purpura , Leopold Fuchs , Vanessa López , Hoang Thanh Lam

Filtering and annotating textual data are routine tasks in many areas, like social media or news analytics. Automating these tasks allows to scale the analyses wrt. speed and breadth of content covered and decreases the manual effort…

Computation and Language · Computer Science 2024-06-27 Simon Münker , Kai Kugler , Achim Rettinger

Annotation of political discourse is resource-intensive, but recent developments in NLP promise to automate complex annotation tasks. Fine-tuned transformer-based models outperform human annotators in some annotation tasks, but they require…

Computation and Language · Computer Science 2024-08-27 Sebastian Haunss , André Blessing

A backbone of knowledge graphs are their class membership relations, which assign entities to a given class. As part of the knowledge engineering process, we propose a new method for evaluating the quality of these relations by processing…

Computation and Language · Computer Science 2024-04-29 Bradley P. Allen , Paul T. Groth

Political scientists often grapple with data scarcity in text classification. Recently, fine-tuned BERT models and their variants have gained traction as effective solutions to address this issue. In this study, we investigate the potential…

Computation and Language · Computer Science 2024-11-11 Yu Wang , Wen Qu , Xin Ye