English
Related papers

Related papers: Few-shot Natural Language Generation for Task-Orie…

200 papers

Most of the current task-oriented dialogue systems (ToD), despite having interesting results, are designed for a handful of languages like Chinese and English. Therefore, their performance in low-resource languages is still a significant…

Computation and Language · Computer Science 2022-03-16 Phi Nguyen Van , Tung Cao Hoang , Dung Nguyen Manh , Quan Nguyen Minh , Long Tran Quoc

Although Graph Neural Networks (GNNs) have been successful in node classification tasks, their performance heavily relies on the availability of a sufficient number of labeled nodes per class. In real-world situations, not all classes have…

Machine Learning · Computer Science 2023-06-27 Sungwon Kim , Junseok Lee , Namkyeong Lee , Wonjoong Kim , Seungyoon Choi , Chanyoung Park

We present a novel approach for structured data-to-text generation that addresses the limitations of existing methods that primarily focus on specific types of structured data. Our proposed method aims to improve performance in multi-task…

There is a growing interest in dataset generation recently due to the superior generative capacity of large pre-trained language models (PLMs). In this paper, we study a flexible and efficient zero-short learning method, \textsc{ZeroGen}.…

Computation and Language · Computer Science 2022-10-25 Jiacheng Ye , Jiahui Gao , Qintong Li , Hang Xu , Jiangtao Feng , Zhiyong Wu , Tao Yu , Lingpeng Kong

A standard way to address different NLP problems is by first constructing a problem-specific dataset, then building a model to fit this dataset. To build the ultimate artificial intelligence, we desire a single machine that can handle…

Computation and Language · Computer Science 2020-10-07 Wenpeng Yin , Nazneen Fatema Rajani , Dragomir Radev , Richard Socher , Caiming Xiong

Self-rationalization models that predict task labels and generate free-text elaborations for their predictions could enable more intuitive interaction with NLP systems. These models are, however, currently trained with a large amount of…

Computation and Language · Computer Science 2022-04-27 Ana Marasović , Iz Beltagy , Doug Downey , Matthew E. Peters

This position paper proposes a conceptual framework for the design of Natural Language Generation (NLG) systems that follow efficient and effective production strategies in order to achieve complex communicative goals. In this general…

Computation and Language · Computer Science 2022-10-25 Mario Giulianelli

We propose a shared task on training instance selection for few-shot neural text generation. Large-scale pretrained language models have led to dramatic improvements in few-shot text generation. Nonetheless, almost all previous work simply…

Computation and Language · Computer Science 2021-08-21 Ernie Chang , Xiaoyu Shen , Alex Marin , Vera Demberg

Large pre-trained vision language models (VLMs) have shown impressive zero-shot ability on downstream tasks with manually designed prompt. To further adapt VLMs to downstream tasks, soft prompt is proposed to replace manually designed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Shuanghao Bai , Yuedi Zhang , Wanqi Zhou , Zhirong Luan , Badong Chen

We study the problem of few-shot Fine-grained Entity Typing (FET), where only a few annotated entity mentions with contexts are given for each entity type. Recently, prompt-based tuning has demonstrated superior performance to standard…

Computation and Language · Computer Science 2022-06-29 Jiaxin Huang , Yu Meng , Jiawei Han

Clinical Natural Language Processing (NLP) has become an emerging technology in healthcare that leverages a large amount of free-text data in electronic health records (EHRs) to improve patient care, support clinical decisions, and…

Computation and Language · Computer Science 2022-10-28 David Oniani , Sonish Sivarajkumar , Yanshan Wang

Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be able to jointly represent many different languages, their training data is dominated by English, potentially limiting…

Prompt-based pre-trained language models (PLMs) paradigm have succeeded substantially in few-shot natural language processing (NLP) tasks. However, prior discrete prompt optimization methods require expert knowledge to design the base…

Machine Learning · Computer Science 2024-01-17 Chengzhengxu Li , Xiaoming Liu , Yichen Wang , Duyi Li , Yu Lan , Chao Shen

Task-oriented dialogue systems have been a promising area in the NLP field. Previous work showed the effectiveness of using a single GPT-2 based model to predict belief states and responses via causal language modeling. In this paper, we…

Computation and Language · Computer Science 2021-10-12 Po-Nien Kung , Chung-Cheng Chang , Tse-Hsuan Yang , Hsin-Kai Hsu , Yu-Jia Liou , Yun-Nung Chen

Neural table-to-text generation approaches are data-hungry, limiting their adaptation for low-resource real-world applications. Previous works mostly resort to Pre-trained Language Models (PLMs) to generate fluent summaries of a table.…

Computation and Language · Computer Science 2022-08-24 Yutao Luo , Menghua Lu , Gongshen Liu , Shilin Wang

Task oriented dialogue (TOD) requires the complex interleaving of a number of individually controllable components with strong guarantees for explainability and verifiability. This has made it difficult to adopt the multi-turn multi-domain…

Computation and Language · Computer Science 2020-10-07 Oluwatobi O. Olabiyi , Prarthana Bhattarai , C. Bayan Bruss , Zachary Kulis

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger…

The field of Natural Language Generation (NLG) suffers from a severe shortage of labeled data due to the extremely expensive and time-consuming process involved in manual annotation. A natural approach for coping with this problem is active…

Computation and Language · Computer Science 2023-10-18 Yotam Perlitz , Ariel Gera , Michal Shmueli-Scheuer , Dafna Sheinwald , Noam Slonim , Liat Ein-Dor

Few-shot learning (FSL) enables machine learning models to generalize effectively with minimal labeled data, making it crucial for data-scarce domains such as healthcare, robotics, and natural language processing. Despite its potential, FSL…

Machine Learning · Computer Science 2025-01-24 Rishabh Agrawal

Task-oriented dialogue systems -- handling transactions, reservations, and service requests -- require predictable behavior, yet the moderately-sized LLMs needed for practical latency are prone to hallucination and format errors that…