English
Related papers

Related papers: ZeroShotDataAug: Generating and Augmenting Trainin…

200 papers

In any system that uses structured knowledge graph (KG) data as its underlying knowledge representation, KG-to-text generation is a useful tool for turning parts of the graph data into text that can be understood by humans. Recent work has…

Computation and Language · Computer Science 2023-08-23 Agnes Axelsson , Gabriel Skantze

This paper presents a new challenge that calls for zero-shot text-to-speech (TTS) systems to augment speech data for the downstream task, personalized speech enhancement (PSE), as part of the Generative Data Augmentation workshop at ICASSP…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-24 Jae-Sung Bae , Anastasia Kuznetsova , Dinesh Manocha , John Hershey , Trausti Kristjansson , Minje Kim

We investigate the usefulness of generative Large Language Models (LLMs) in generating training data for cross-encoder re-rankers in a novel direction: generating synthetic documents instead of synthetic queries. We introduce a new dataset,…

Information Retrieval · Computer Science 2023-05-04 Arian Askari , Mohammad Aliannejadi , Evangelos Kanoulas , Suzan Verberne

Data augmentation is a widely employed technique to alleviate the problem of data scarcity. In this work, we propose a prompting-based approach to generate labelled training data for intent classification with off-the-shelf language models…

Computation and Language · Computer Science 2022-04-06 Gaurav Sahu , Pau Rodriguez , Issam H. Laradji , Parmida Atighehchian , David Vazquez , Dzmitry Bahdanau

Electronic health records contain an enormous amount of valuable information, but many are recorded in free text. Information extraction is the strategy to transform the sequence of characters into structured data, which can be employed for…

Computation and Language · Computer Science 2024-01-03 Danqing Hu , Bing Liu , Xiaofeng Zhu , Xudong Lu , Nan Wu

The success of ChatGPT has recently attracted numerous efforts to replicate it, with instruction-tuning strategies being a key factor in achieving remarkable results. Instruction-tuning not only significantly enhances the model's…

Computation and Language · Computer Science 2023-03-28 Yunjie Ji , Yong Deng , Yan Gong , Yiping Peng , Qiang Niu , Lei Zhang , Baochang Ma , Xiangang Li

The emergence of ChatGPT has recently garnered significant attention from the computational linguistics community. To demonstrate its capabilities as a keyphrase generator, we conduct a preliminary evaluation of ChatGPT for the keyphrase…

Computation and Language · Computer Science 2023-12-25 Mingyang Song , Haiyun Jiang , Shuming Shi , Songfang Yao , Shilong Lu , Yi Feng , Huafeng Liu , Liping Jing

The rampant spread of fake news has adversely affected society, resulting in extensive research on curbing its spread. As a notable milestone in large language models (LLMs), ChatGPT has gained significant attention due to its exceptional…

Computation and Language · Computer Science 2024-04-09 Yue Huang , Lichao Sun

The ability of generative language models (GLMs) to generate text has improved considerably in the last few years, enabling their use for generative data augmentation. In this work, we propose CONDA, an approach to further improve GLMs'…

Computation and Language · Computer Science 2022-10-26 Dheeraj Mekala , Tu Vu , Timo Schick , Jingbo Shang

Recent research on dialogue state tracking (DST) focuses on methods that allow few- and zero-shot transfer to new domains or schemas. However, performance gains heavily depend on aggressive data augmentation and fine-tuning of ever larger…

In this paper, we investigate data augmentation for text generation, which we call GenAug. Text generation and language modeling are important tasks within natural language processing, and are especially challenging for low-data regimes. We…

Computation and Language · Computer Science 2020-10-13 Steven Y. Feng , Varun Gangal , Dongyeop Kang , Teruko Mitamura , Eduard Hovy

Recently, various illustrative examples have shown the impressive ability of generative large language models (LLMs) to perform NLP related tasks. ChatGPT undoubtedly is the most representative model. We empirically evaluate ChatGPT's…

Software Engineering · Computer Science 2023-07-20 Jianzhang Zhang , Yiyang Chen , Nan Niu , Yinglin Wang , Chuang Liu

Collecting data for training dialog systems can be extremely expensive due to the involvement of human participants and need for extensive annotation. Especially in document-grounded dialog systems, human experts need to carefully read the…

Computation and Language · Computer Science 2021-12-16 Qingyang Wu , Song Feng , Derek Chen , Sachindra Joshi , Luis A. Lastras , Zhou Yu

Developed by OpenAI, ChatGPT (Conditional Generative Pre-trained Transformer) is an artificial intelligence technology that is fine-tuned using supervised machine learning and reinforcement learning techniques, allowing a computer to…

Data-to-text generation has recently attracted substantial interests due to its wide applications. Existing methods have shown impressive performance on an array of tasks. However, they rely on a significant amount of labeled data for each…

Computation and Language · Computer Science 2020-10-13 Wenhu Chen , Yu Su , Xifeng Yan , William Yang Wang

The recently released ChatGPT has demonstrated surprising abilities in natural language understanding and natural language generation. Machine translation relies heavily on the abilities of language understanding and generation. Thus, in…

Computation and Language · Computer Science 2023-04-24 Yuan Gao , Ruili Wang , Feng Hou

In computer science, students are encouraged to learn various programming languages such as Python, C++, and Java, equipping them with a broad range of technical skills and problem-solving capabilities. Nevertheless, the design of objective…

Programming Languages · Computer Science 2026-03-17 Jongwook Si , Sungyoung Kim

Generative AI technologies such as large language models show novel potentials to enhance educational research. For example, generative large language models were shown to be capable to solve quantitative reasoning tasks in physics and…

Physics Education · Physics 2023-10-03 Fabian Kieser , Peter Wulff , Jochen Kuhn , Stefan Küchemann

Generative AI technologies such as ChatGPT, Gemini, and MidJourney have made remarkable progress in recent years. Recent literature has documented ChatGPT's positive impact on productivity in areas where it has strong expertise,…

General Economics · Economics 2024-03-05 Voraprapa Nakavachara , Tanapong Potipiti , Thanee Chaiwat

Collection of annotated dialogs for training task-oriented dialog systems have been one of the key bottlenecks in improving current models. While dialog response generation has been widely studied on the agent side, it is not evident if…

Computation and Language · Computer Science 2023-10-17 Dustin Axman , Avik Ray , Shubham Garg , Jing Huang