中文
相关论文

相关论文: Few-shot Natural Language Generation for Task-Orie…

200 篇论文

Most of the current task-oriented dialogue systems (ToD), despite having interesting results, are designed for a handful of languages like Chinese and English. Therefore, their performance in low-resource languages is still a significant…

计算与语言 · 计算机科学 2022-03-16 Phi Nguyen Van , Tung Cao Hoang , Dung Nguyen Manh , Quan Nguyen Minh , Long Tran Quoc

Although Graph Neural Networks (GNNs) have been successful in node classification tasks, their performance heavily relies on the availability of a sufficient number of labeled nodes per class. In real-world situations, not all classes have…

机器学习 · 计算机科学 2023-06-27 Sungwon Kim , Junseok Lee , Namkyeong Lee , Wonjoong Kim , Seungyoon Choi , Chanyoung Park

We present a novel approach for structured data-to-text generation that addresses the limitations of existing methods that primarily focus on specific types of structured data. Our proposed method aims to improve performance in multi-task…

There is a growing interest in dataset generation recently due to the superior generative capacity of large pre-trained language models (PLMs). In this paper, we study a flexible and efficient zero-short learning method, \textsc{ZeroGen}.…

计算与语言 · 计算机科学 2022-10-25 Jiacheng Ye , Jiahui Gao , Qintong Li , Hang Xu , Jiangtao Feng , Zhiyong Wu , Tao Yu , Lingpeng Kong

A standard way to address different NLP problems is by first constructing a problem-specific dataset, then building a model to fit this dataset. To build the ultimate artificial intelligence, we desire a single machine that can handle…

计算与语言 · 计算机科学 2020-10-07 Wenpeng Yin , Nazneen Fatema Rajani , Dragomir Radev , Richard Socher , Caiming Xiong

Self-rationalization models that predict task labels and generate free-text elaborations for their predictions could enable more intuitive interaction with NLP systems. These models are, however, currently trained with a large amount of…

计算与语言 · 计算机科学 2022-04-27 Ana Marasović , Iz Beltagy , Doug Downey , Matthew E. Peters

This position paper proposes a conceptual framework for the design of Natural Language Generation (NLG) systems that follow efficient and effective production strategies in order to achieve complex communicative goals. In this general…

计算与语言 · 计算机科学 2022-10-25 Mario Giulianelli

We propose a shared task on training instance selection for few-shot neural text generation. Large-scale pretrained language models have led to dramatic improvements in few-shot text generation. Nonetheless, almost all previous work simply…

计算与语言 · 计算机科学 2021-08-21 Ernie Chang , Xiaoyu Shen , Alex Marin , Vera Demberg

Large pre-trained vision language models (VLMs) have shown impressive zero-shot ability on downstream tasks with manually designed prompt. To further adapt VLMs to downstream tasks, soft prompt is proposed to replace manually designed…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Shuanghao Bai , Yuedi Zhang , Wanqi Zhou , Zhirong Luan , Badong Chen

We study the problem of few-shot Fine-grained Entity Typing (FET), where only a few annotated entity mentions with contexts are given for each entity type. Recently, prompt-based tuning has demonstrated superior performance to standard…

计算与语言 · 计算机科学 2022-06-29 Jiaxin Huang , Yu Meng , Jiawei Han

Clinical Natural Language Processing (NLP) has become an emerging technology in healthcare that leverages a large amount of free-text data in electronic health records (EHRs) to improve patient care, support clinical decisions, and…

计算与语言 · 计算机科学 2022-10-28 David Oniani , Sonish Sivarajkumar , Yanshan Wang

Large-scale generative language models such as GPT-3 are competitive few-shot learners. While these models are known to be able to jointly represent many different languages, their training data is dominated by English, potentially limiting…

Prompt-based pre-trained language models (PLMs) paradigm have succeeded substantially in few-shot natural language processing (NLP) tasks. However, prior discrete prompt optimization methods require expert knowledge to design the base…

机器学习 · 计算机科学 2024-01-17 Chengzhengxu Li , Xiaoming Liu , Yichen Wang , Duyi Li , Yu Lan , Chao Shen

Task-oriented dialogue systems have been a promising area in the NLP field. Previous work showed the effectiveness of using a single GPT-2 based model to predict belief states and responses via causal language modeling. In this paper, we…

计算与语言 · 计算机科学 2021-10-12 Po-Nien Kung , Chung-Cheng Chang , Tse-Hsuan Yang , Hsin-Kai Hsu , Yu-Jia Liou , Yun-Nung Chen

Neural table-to-text generation approaches are data-hungry, limiting their adaptation for low-resource real-world applications. Previous works mostly resort to Pre-trained Language Models (PLMs) to generate fluent summaries of a table.…

计算与语言 · 计算机科学 2022-08-24 Yutao Luo , Menghua Lu , Gongshen Liu , Shilin Wang

Task oriented dialogue (TOD) requires the complex interleaving of a number of individually controllable components with strong guarantees for explainability and verifiability. This has made it difficult to adopt the multi-turn multi-domain…

计算与语言 · 计算机科学 2020-10-07 Oluwatobi O. Olabiyi , Prarthana Bhattarai , C. Bayan Bruss , Zachary Kulis

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger…

The field of Natural Language Generation (NLG) suffers from a severe shortage of labeled data due to the extremely expensive and time-consuming process involved in manual annotation. A natural approach for coping with this problem is active…

计算与语言 · 计算机科学 2023-10-18 Yotam Perlitz , Ariel Gera , Michal Shmueli-Scheuer , Dafna Sheinwald , Noam Slonim , Liat Ein-Dor

Few-shot learning (FSL) enables machine learning models to generalize effectively with minimal labeled data, making it crucial for data-scarce domains such as healthcare, robotics, and natural language processing. Despite its potential, FSL…

机器学习 · 计算机科学 2025-01-24 Rishabh Agrawal

Task-oriented dialogue systems -- handling transactions, reservations, and service requests -- require predictable behavior, yet the moderately-sized LLMs needed for practical latency are prone to hallucination and format errors that…