English
Related papers

Related papers: Controllable and Diverse Data Augmentation with La…

200 papers

Machine Learning (ML) in low-data settings remains an underappreciated yet crucial problem. Hence, data augmentation methods to increase the sample size of datasets needed for ML are key to unlocking the transformative potential of ML in…

Machine Learning · Computer Science 2024-07-02 Nabeel Seedat , Nicolas Huynh , Boris van Breugel , Mihaela van der Schaar

In recent years, language models (LMs) have made remarkable progress in advancing the field of natural language processing (NLP). However, the impact of data augmentation (DA) techniques on the fine-tuning (FT) performance of these LMs has…

Computation and Language · Computer Science 2023-06-14 Zhengxiang Shi , Aldo Lipani

Dementia is a growing problem as our society ages, and detection methods are often invasive and expensive. Recent deep-learning techniques can offer a faster diagnosis and have shown promising results. However, they require large amounts of…

Computation and Language · Computer Science 2022-07-19 Anna Hlédiková , Dominika Woszczyk , Alican Akman , Soteris Demetriou , Björn Schuller

Data is a crucial element in large language model (LLM) alignment. Recent studies have explored using LLMs for efficient data collection. However, LLM-generated data often suffers from quality issues, with underrepresented or absent aspects…

Computation and Language · Computer Science 2024-10-08 Fei Wang , Ninareh Mehrabi , Palash Goyal , Rahul Gupta , Kai-Wei Chang , Aram Galstyan

The efficacy of large language models (LLMs) is heavily dependent on the quality of the underlying data, particularly within specialized domains. A common challenge when fine-tuning LLMs for domain-specific applications is the potential…

Computation and Language · Computer Science 2024-03-15 Jianwei Sun , Chaoyang Mei , Linlin Wei , Kaiyu Zheng , Na Liu , Ming Cui , Tianyi Li

Contrastive learning has recently achieved compelling performance in unsupervised sentence representation. As an essential element, data augmentation protocols, however, have not been well explored. The pioneering work SimCSE resorting to a…

Computation and Language · Computer Science 2024-06-17 Dongsheng Zhu , Zhenyu Mao , Jinghui Lu , Rui Zhao , Fei Tan

Confidence estimation is crucial for reflecting the reliability of large language models (LLMs), particularly in the widely used closed-source models. Utilizing data augmentation for confidence estimation is viable, but discussions focus on…

Machine Learning · Computer Science 2025-06-16 Rui Wang , Renyu Zhu , Minmin Lin , Runze Wu , Tangjie Lv , Changjie Fan , Haobo Wang

Text augmentation is a technique for constructing synthetic data from an under-resourced corpus to improve predictive performance. Synthetic data generation is common in numerous domains. However, recently text augmentation has emerged in…

Computation and Language · Computer Science 2023-09-12 Mosleh Mahamud , Zed Lee , Isak Samsten

Conversational recommender systems (CRSs) enhance recommendation quality by engaging users in multi-turn dialogues, capturing nuanced preferences through natural language interactions. However, these systems often face the false negative…

Information Retrieval · Computer Science 2025-08-11 Haozhe Xu , Xiaohua Wang , Changze Lv , Xiaoqing Zheng

Large language models (LLMs) can be used to generate text data for training and evaluating other models. However, creating high-quality datasets with LLMs can be challenging. In this work, we explore human-AI partnerships to facilitate high…

Computation and Language · Computer Science 2023-08-11 John Joon Young Chung , Ece Kamar , Saleema Amershi

Spoken Language Understanding (SLU) converts user utterances into structured semantic representations. Data sparsity is one of the main obstacles of SLU due to the high cost of human annotation, especially when domain changes or a new…

Computation and Language · Computer Science 2019-08-29 Zijian Zhao , Su Zhu , Kai Yu

Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be challenging. Instructing tuning, i.e. tuning models on instruction and sample responses generated by humans…

Computation and Language · Computer Science 2024-01-11 Dennis Ulmer , Elman Mansimov , Kaixiang Lin , Justin Sun , Xibin Gao , Yi Zhang

Large Language Models (LLMs) such as GPT-4 and Llama3 have significantly impacted various fields by enabling high-quality synthetic data generation and reducing dependence on expensive human-generated datasets. Despite this, challenges…

Computation and Language · Computer Science 2025-11-18 Yue Huang , Siyuan Wu , Chujie Gao , Dongping Chen , Qihui Zhang , Yao Wan , Tianyi Zhou , Jianfeng Gao , Chaowei Xiao , Lichao Sun , Xiangliang Zhang

The prevailing paradigm in the domain of Open-Domain Dialogue agents predominantly focuses on the English language, encompassing both models and datasets. Furthermore, the financial and temporal investments required for crowdsourcing such…

Computation and Language · Computer Science 2025-03-06 Ahmed Njifenjou , Virgile Sucal , Bassam Jabaian , Fabrice Lefèvre

The construction of open-domain dialogue systems requires high-quality dialogue datasets. The dialogue data admits a wide variety of responses for a given dialogue history, especially responses with different semantics. However, collecting…

Computation and Language · Computer Science 2022-11-01 Jiao Ou , Jinchao Zhang , Yang Feng , Jie Zhou

Domain adaptation is an essential task in dialog system building because there are so many new dialog tasks created for different needs every day. Collecting and annotating training data for these new tasks is costly since it involves real…

Computation and Language · Computer Science 2019-08-20 Kun Qian , Zhou Yu

Large Language Models (LLMs) hold promise in automating data analysis tasks, yet open-source models face significant limitations in these kinds of reasoning-intensive scenarios. In this work, we investigate strategies to enhance the data…

Computation and Language · Computer Science 2025-11-14 Yuqi Zhu , Yi Zhong , Jintian Zhang , Ziheng Zhang , Shuofei Qiao , Yujie Luo , Lun Du , Da Zheng , Ningyu Zhang , Huajun Chen

Utilizing large language models (LLMs) for data augmentation has yielded encouraging results in mathematical reasoning. However, these approaches face constraints in problem diversity, potentially restricting them to in-domain/distribution…

Machine Learning · Computer Science 2024-09-25 Nuo Chen , Ning Wu , Jianhui Chang , Jia Li

The scarcity of domain-specific dialogue datasets limits the development of dialogue systems across applications. Existing research is constrained by general or niche datasets that lack sufficient scale for training dialogue systems. To…

Computation and Language · Computer Science 2025-02-11 Sathya Krishnan Suresh , Wu Mengjun , Tushar Pranav , Eng Siong Chng

This paper proposes a framework to address the issue of data scarcity in Document-Grounded Dialogue Systems(DGDS). Our model leverages high-resource languages to enhance the capability of dialogue generation in low-resource languages.…

Computation and Language · Computer Science 2023-09-21 Qi Gou , Zehua Xia , Wenzhe Du