English
Related papers

Related papers: AgentInstruct: Toward Generative Teaching with Age…

200 papers

We introduce Generalized Instruction Tuning (called GLAN), a general and scalable method for instruction tuning of Large Language Models (LLMs). Unlike prior work that relies on seed examples or existing datasets to construct instruction…

Synthetic data has the potential to improve the performance, training efficiency, and privacy of real training examples. Nevertheless, existing approaches for synthetic text generation are mostly heuristics and cannot generate…

Machine Learning · Computer Science 2025-06-10 Dang Nguyen , Zeman Li , Mohammadhossein Bateni , Vahab Mirrokni , Meisam Razaviyayn , Baharan Mirzasoleiman

In this paper, we explore the utility of translationese as synthetic data created using machine translation for pre-training language models (LMs) for low-resource languages (LRLs). Our simple methodology consists of translating large…

Computation and Language · Computer Science 2025-07-08 Meet Doshi , Raj Dabre , Pushpak Bhattacharyya

Data augmentation techniques are widely used for enhancing the performance of machine learning models by tackling class imbalance issues and data sparsity. State-of-the-art generative language models have been shown to provide significant…

Computation and Language · Computer Science 2023-01-10 Aleksandra Edwards , Asahi Ushio , Jose Camacho-Collados , Hélène de Ribaupierre , Alun Preece

The potential of synthetic data in text-to-speech (TTS) model training has gained increasing attention, yet its rationality and effectiveness require systematic validation. In this study, we systematically investigate the feasibility of…

Sound · Computer Science 2025-12-22 Tingxiao Zhou , Leying Zhang , Zhengyang Chen , Yanmin Qian

Alongside the growth of generative AI, we are witnessing a surge in the use of synthetic data across all stages of the AI development pipeline. It is now common practice for researchers and practitioners to use one large generative model…

Human-Computer Interaction · Computer Science 2025-05-14 Shivani Kapania , Stephanie Ballard , Alex Kessler , Jennifer Wortman Vaughan

Deep generative models have made tremendous progress in modeling complex data, often exhibiting generation quality that surpasses a typical human's ability to discern the authenticity of samples. Undeniably, a key driver of this success is…

Machine Learning · Computer Science 2024-04-03 Quentin Bertrand , Avishek Joey Bose , Alexandre Duplessis , Marco Jiralerspong , Gauthier Gidel

Large Language Model (LLM)-based agentic systems, often comprising multiple models, complex tool invocations, and orchestration protocols, substantially outperform monolithic agents. Yet this very sophistication amplifies their fragility,…

Computation and Language · Computer Science 2025-09-05 Guibin Zhang , Junhao Wang , Junjie Chen , Wangchunshu Zhou , Kun Wang , Shuicheng Yan

The deployment of Large Language Models (LLMs) as agentic orchestrators has revolutionized task automation, but the need for privacy-preserving, cost-effective solutions demands on-device inference capabilities. However, local LLMs…

Artificial Intelligence · Computer Science 2025-11-13 Rohan Kadekodi , Zhan Jin , Keisuke Kamahori , Yile Gu , Sean Khatiri , Noah H. Bayindirli , Sergey Gorbunov , Baris Kasikci

Large Language Models (LLMs) demonstrate strong performance in real-world applications, yet existing open-source instruction datasets often concentrate on narrow domains, such as mathematics or coding, limiting generalization and widening…

Computation and Language · Computer Science 2025-06-16 Jijie Li , Li Du , Hanyu Zhao , Bo-wen Zhang , Liangdong Wang , Boyan Gao , Guang Liu , Yonghua Lin

Rich, open-domain textual data available on the web resulted in great advancements for language processing. However, while that data may be suitable for language processing tasks, they are mostly non-conversational, lacking many phenomena…

Computation and Language · Computer Science 2021-10-19 Yen-Ting Lin , Alexandros Papangelis , Seokhwan Kim , Dilek Hakkani-Tur

With the availability of powerful text-to-image diffusion models, recent works have explored the use of synthetic data to improve image classification performances. These works show that it can effectively augment or even replace real data.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Perla Doubinsky , Nicolas Audebert , Michel Crucianu , Hervé Le Borgne

The rapid advancement of large-scale language models (LLMs) has shown their potential to transform intelligent education systems (IESs) through automated teaching and learning support applications. However, current IESs often rely on…

Computers and Society · Computer Science 2026-01-09 Yuxin Liu , Zeqing Song , Jiong Lou , Chentao Wu , Jie Li

The iterated learning model is an agent model which simulates the transmission of of language from generation to generation. It is used to study how the language adapts to pressures imposed by transmission. In each iteration, a language…

Computation and Language · Computer Science 2024-11-28 Jack Bunyan , Seth Bullock , Conor Houghton

Given the emergence of Generative AI over the last two years and the increasing focus on Agentic AI as a form of Multi-Agent System it is important to explore both how such technologies can impact the use of traditional Agent Toolkits and…

Artificial Intelligence · Computer Science 2026-02-02 Rem Collier , Katharine Beaumont , Andrei Ciortea

Direct prompt-based editing often fails on complex transformations because vague and subjective prompts often require nuanced understanding of what should be changed in the image. Our core intuition is that leveraging compositional image…

Machine Learning · Computer Science 2026-03-10 Subhojyoti Mukherjee , Stefano Petrangeli , Branislav Kveton , Trung Bui , Franck Dernoncourt , Arko Mukherjee

In this paper we propose the use of Generative Adversarial Networks (GAN) to generate artificial training data for machine learning tasks. The generation of artificial training data can be extremely useful in situations such as imbalanced…

Machine Learning · Computer Science 2019-04-22 Fabio Henrique Kiyoiti dos Santos Tanaka , Claus Aranha

Foundation models have revolutionized artificial intelligence, yet their application in recommender systems remains limited by reasoning opacity and knowledge constraints. This paper introduces AgenticRAG, a novel framework that combines…

Information Retrieval · Computer Science 2025-10-06 Bo Ma , Hang Li , ZeHua Hu , XiaoFan Gui , LuYao Liu , Simon Liu

Data imbalance in training data often leads to biased predictions from trained models, which in turn causes ethical and social issues. A straightforward solution is to carefully curate training data, but given the enormous scale of modern…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Moon Ye-Bin , Nam Hyeon-Woo , Wonseok Choi , Nayeong Kim , Suha Kwak , Tae-Hyun Oh

Recent advances in large language models (LLMs) have sparked growing interest in building generalist agents that can learn through online interactions. However, applying reinforcement learning (RL) to train LLM agents in multi-turn,…

Artificial Intelligence · Computer Science 2025-10-07 Hanchen Zhang , Xiao Liu , Bowen Lv , Xueqiao Sun , Bohao Jing , Iat Long Iong , Zhenyu Hou , Zehan Qi , Hanyu Lai , Yifan Xu , Rui Lu , Hongning Wang , Jie Tang , Yuxiao Dong