English
Related papers

Related papers: Data Augmentation to Improve Large Language Models…

200 papers

In this paper, we investigate the use of data obtained from prompting a large generative language model, ChatGPT, to generate synthetic training data with the aim of augmenting data in low resource scenarios. We show that with appropriate…

Artificial Intelligence · Computer Science 2023-04-28 Solomon Ubani , Suleyman Olcay Polat , Rodney Nielsen

Text data augmentation is an effective strategy for overcoming the challenge of limited sample sizes in many natural language processing (NLP) tasks. This challenge is especially prominent in the few-shot learning scenario, where the data…

The success of ChatGPT has recently attracted numerous efforts to replicate it, with instruction-tuning strategies being a key factor in achieving remarkable results. Instruction-tuning not only significantly enhances the model's…

Computation and Language · Computer Science 2023-03-28 Yunjie Ji , Yong Deng , Yan Gong , Yiping Peng , Qiang Niu , Lei Zhang , Baochang Ma , Xiangang Li

This paper explores the potential of leveraging Large Language Models (LLMs) for data augmentation in multilingual commonsense reasoning datasets where the available training data is extremely limited. To achieve this, we utilise several…

Computation and Language · Computer Science 2023-10-24 Chenxi Whitehouse , Monojit Choudhury , Alham Fikri Aji

This paper presents our system developed for the SemEval-2025 Task 9: The Food Hazard Detection Challenge. The shared task's objective is to evaluate explainable classification systems for classifying hazards and products in two levels of…

Computation and Language · Computer Science 2025-04-30 Foteini Papadopoulou , Osman Mutlu , Neris Özen , Bas H. M. van der Velden , Iris Hendrickx , Ali Hürriyetoğlu

Code search plays a crucial role in software development, enabling developers to retrieve and reuse code using natural language queries. While the performance of code search models improves with an increase in high-quality data, obtaining…

Software Engineering · Computer Science 2024-08-20 Yanlin Wang , Lianghong Guo , Ensheng Shi , Wenqing Chen , Jiachi Chen , Wanjun Zhong , Menghan Wang , Hui Li , Hongyu Zhang , Ziyu Lyu , Zibin Zheng

Machine learning-based automatic scoring faces challenges with unbalanced student responses across scoring categories. To address this, we introduce a novel text data augmentation framework leveraging GPT-4, a generative large language…

Computation and Language · Computer Science 2024-09-09 Luyang Fang , Gyeong-Geon Lee , Xiaoming Zhai

Coverage of ChatGPT-style large language models (LLMs) in the media has focused on their eye-catching achievements, including solving advanced mathematical problems and reaching expert proficiency in medical examinations. But the gradual…

Computers and Society · Computer Science 2024-03-26 Djavan De Clercq , Elias Nehring , Harry Mayne , Adam Mahdi

In 2022, with the release of ChatGPT, large-scale language models gained widespread attention. ChatGPT not only surpassed previous models in terms of parameters and the scale of its pretraining corpus but also achieved revolutionary…

Artificial Intelligence · Computer Science 2024-11-13 Yiming Ju , Huanhuan Ma

The identification of key factors such as medications, diseases, and relationships within electronic health records and clinical notes has a wide range of applications in the clinical field. In the N2C2 2022 competitions, various tasks were…

Computation and Language · Computer Science 2023-06-14 Shouvon Sarker , Lijun Qian , Xishuang Dong

Attention-based pre-trained language models such as GPT-2 brought considerable progress to end-to-end dialogue modelling. However, they also present considerable risks for task-oriented dialogue, such as lack of knowledge grounding or…

Computation and Language · Computer Science 2022-01-17 Jonáš Kulhánek , Vojtěch Hudeček , Tomáš Nekvinda , Ondřej Dušek

Hate speech is one of the main threats posed by the widespread use of social networks, despite efforts to limit it. Although attention has been devoted to this issue, the lack of datasets and case studies centered around scarcely…

Computation and Language · Computer Science 2024-10-11 Camilla Casula , Sara Tonelli

Confidence estimation is crucial for reflecting the reliability of large language models (LLMs), particularly in the widely used closed-source models. Utilizing data augmentation for confidence estimation is viable, but discussions focus on…

Machine Learning · Computer Science 2025-06-16 Rui Wang , Renyu Zhu , Minmin Lin , Runze Wu , Tangjie Lv , Changjie Fan , Haobo Wang

Despite the rapid growth in model architecture, the scarcity of large parallel corpora remains the main bottleneck in Neural Machine Translation. Data augmentation is a technique that enhances the performance of data-hungry models by…

Computation and Language · Computer Science 2023-11-14 Seokjin Oh , Su Ah Lee , Woohwan Jung

An important issue impacting healthcare is a lack of available experts. Machine learning (ML) models could resolve this by aiding in diagnosing patients. However, creating datasets large enough to train these models is expensive. We…

Computation and Language · Computer Science 2024-05-14 Chancellor R. Woolsey , Prakash Bisht , Joshua Rothman , Gondy Leroy

Data augmentation techniques are widely used for enhancing the performance of machine learning models by tackling class imbalance issues and data sparsity. State-of-the-art generative language models have been shown to provide significant…

Computation and Language · Computer Science 2023-01-10 Aleksandra Edwards , Asahi Ushio , Jose Camacho-Collados , Hélène de Ribaupierre , Alun Preece

Emotion recognition in text, the task of identifying emotions such as joy or anger, is a challenging problem in NLP with many applications. One of the challenges is the shortage of available datasets that have been annotated with emotions.…

Computation and Language · Computer Science 2023-10-31 Anna Koufakou , Diego Grisales , Ragy Costa de jesus , Oscar Fox

Open intent detection, a crucial aspect of natural language understanding, involves the identification of previously unseen intents in user-generated text. Despite the progress made in this field, challenges persist in handling new…

Computation and Language · Computer Science 2023-08-28 Yihao Fang , Xianzhi Li , Stephen W. Thomas , Xiaodan Zhu

Recent studies have demonstrated promising performance of ChatGPT and GPT-4 on several medical domain tasks. However, none have assessed its performance using a large-scale real-world electronic health record database, nor have evaluated…

Computation and Language · Computer Science 2023-07-18 Jingqing Zhang , Kai Sun , Akshay Jagadeesh , Mahta Ghahfarokhi , Deepa Gupta , Ashok Gupta , Vibhor Gupta , Yike Guo

Detection of some types of toxic language is hampered by extreme scarcity of labeled training data. Data augmentation - generating new synthetic data from a labeled seed dataset - can help. The efficacy of data augmentation on toxic…

Computation and Language · Computer Science 2020-10-27 Mika Juuti , Tommi Gröndahl , Adrian Flanagan , N. Asokan
‹ Prev 1 2 3 10 Next ›