English
Related papers

Related papers: On LLMs-Driven Synthetic Data Generation, Curation…

200 papers

Large language models (LLMs) have been touted to enable increased productivity in many areas of today's work life. Scientific research as an area of work is no exception: the potential of LLM-based tools to assist in the daily work of…

Software Engineering · Computer Science 2024-04-24 Mohamed Nejjar , Luca Zacharias , Fabian Stiehle , Ingo Weber

Information-seeking conversation, which aims to help users gather information through conversation, has achieved great progress in recent years. However, the research is still stymied by the scarcity of training data. To alleviate this…

Computation and Language · Computer Science 2023-08-15 Siheng Li , Cheng Yang , Yichun Yin , Xinyu Zhu , Zesen Cheng , Lifeng Shang , Xin Jiang , Qun Liu , Yujiu Yang

The increasing complexity of software systems has driven significant advancements in program analysis, as traditional methods unable to meet the demands of modern software development. To address these limitations, deep learning techniques,…

Software Engineering · Computer Science 2025-02-27 Jiayimei Wang , Tao Ni , Wei-Bin Lee , Qingchuan Zhao

Building effective machine learning (ML) workflows to address complex tasks is a primary focus of the Automatic ML (AutoML) community and a critical step toward achieving artificial general intelligence (AGI). Recently, the integration of…

Machine Learning · Computer Science 2024-12-30 Yang Gu , Hengyu You , Jian Cao , Muran Yu , Haoran Fan , Shiyou Qian

Large Language Models (LLMs) are rapidly reshaping machine translation (MT), particularly by introducing instruction-following, in-context learning, and preference-based alignment into what has traditionally been a supervised…

Computation and Language · Computer Science 2026-04-29 Baban Gain , Dibyanayan Bandyopadhyay , Asif Ekbal , Trilok Nath Singh

The emergence of Generative Artificial Intelligence (AI) and Large Language Models (LLMs) has marked a new era of Natural Language Processing (NLP), introducing unprecedented capabilities that are revolutionizing various domains. This paper…

Computation and Language · Computer Science 2024-08-26 Desta Haileselassie Hagos , Rick Battle , Danda B. Rawat

Large Language Models offer new opportunities to devise automated implementation generation methods that can tackle problem solving activities beyond traditional methods, which require algorithmic specifications and can use only static…

Computation and Language · Computer Science 2025-01-06 Hashmath Shaik , Alex Doboli

Synthetically-generated data plays an increasingly larger role in training large language models. However, while synthetic data has been found to be useful, studies have also shown that without proper curation it can cause LLM performance…

Machine Learning · Computer Science 2025-12-02 Kareem Amin , Sara Babakniya , Alex Bie , Weiwei Kong , Umar Syed , Sergei Vassilvitskii

Large language models (LLMs) have revolutionized natural language processing with their exceptional understanding, synthesizing, and reasoning capabilities. However, deploying LLMs on resource-constrained edge devices presents significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-25 Yue Zheng , Yuhao Chen , Bin Qian , Xiufang Shi , Yuanchao Shu , Jiming Chen

With recent advances in large language models (LLMs), the concept of automatically generating children's educational materials has become increasingly realistic. Working toward the goal of age-appropriate simplicity in generated educational…

Computation and Language · Computer Science 2023-10-31 Maria Valentini , Jennifer Weber , Jesus Salcido , Téa Wright , Eliana Colunga , Katharina Kann

Access to large-scale high-quality healthcare databases is key to accelerate medical research and make insightful discoveries about diseases. However, access to such data is often limited by patient privacy concerns, data sharing…

In this study, we explore the growing potential of AI and deep learning technologies, particularly Generative Adversarial Networks (GANs) and Large Language Models (LLMs), for generating synthetic tabular data. Access to quality students…

Machine Learning · Computer Science 2026-05-21 Mohammad Khalil , Sam Urmian , Ronas Shakya , Qinyi Liu

Synthetic data has the potential to improve the performance, training efficiency, and privacy of real training examples. Nevertheless, existing approaches for synthetic text generation are mostly heuristics and cannot generate…

Machine Learning · Computer Science 2025-06-10 Dang Nguyen , Zeman Li , Mohammadhossein Bateni , Vahab Mirrokni , Meisam Razaviyayn , Baharan Mirzasoleiman

Large Language Models (LLMs) hold promise in automating data analysis tasks, yet open-source models face significant limitations in these kinds of reasoning-intensive scenarios. In this work, we investigate strategies to enhance the data…

Computation and Language · Computer Science 2025-11-14 Yuqi Zhu , Yi Zhong , Jintian Zhang , Ziheng Zhang , Shuofei Qiao , Yujie Luo , Lun Du , Da Zheng , Ningyu Zhang , Huajun Chen

Research within sociotechnical domains, such as Software Engineering, fundamentally requires a thorough consideration of the human perspective. However, traditional qualitative data collection methods suffer from challenges related to…

Software Engineering · Computer Science 2023-11-21 Marco A. Gerosa , Bianca Trinkenreich , Igor Steinmacher , Anita Sarma

The rapid development of Large Language Models (LLMs) demonstrates remarkable multilingual capabilities in natural language processing, attracting global attention in both academia and industry. To mitigate potential discrimination and…

Computation and Language · Computer Science 2025-01-08 Kaiyu Huang , Fengran Mo , Xinyu Zhang , Hongliang Li , You Li , Yuanchi Zhang , Weijian Yi , Yulong Mao , Jinchen Liu , Yuzhuang Xu , Jinan Xu , Jian-Yun Nie , Yang Liu

Virtual Assistants (VAs) are important Information Retrieval platforms that help users accomplish various tasks through spoken commands. The speech recognition system (speech-to-text) uses query priors, trained solely on text, to…

Information Retrieval · Computer Science 2024-06-12 Sonal Sannigrahi , Thiago Fraga-Silva , Youssef Oualil , Christophe Van Gysel

One of the limitations of large language models is that they do not have access to up-to-date, proprietary or personal data. As a result, there are multiple efforts to extend language models with techniques for accessing external data. In…

Computation and Language · Computer Science 2023-04-11 Alon Halevy , Jane Dwivedi-Yu

Large language models (LLMs) are becoming increasingly better at a wide range of Natural Language Processing tasks (NLP), such as text generation and understanding. Recently, these models have extended their capabilities to coding tasks,…

Machine Learning · Computer Science 2024-10-23 Nishat Raihan , Mohammed Latif Siddiq , Joanna C. S. Santos , Marcos Zampieri

Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a…

Computation and Language · Computer Science 2024-11-01 Yuxia Wang , Minghan Wang , Muhammad Arslan Manzoor , Fei Liu , Georgi Georgiev , Rocktim Jyoti Das , Preslav Nakov