中文
相关论文

相关论文: SynDy: Synthetic Dynamic Dataset Generation Framew…

200 篇论文

Realistic, large-scale, and well-labeled cybersecurity datasets are essential for training and evaluating Intrusion Detection Systems (IDS). However, they remain difficult to obtain due to privacy constraints, data sensitivity, and the cost…

This paper presents a simulation workflow for generating synthetic LiDAR datasets to support autonomous vehicle perception, robotics research, and sensor security analysis. Leveraging the CoppeliaSim simulation environment and its Python…

机器人学 · 计算机科学 2025-06-24 Abhishek Phadke , Shakib Mahmud Dipto , Pratip Rana

Recent advances in large language model (LLM) training have highlighted the need for diverse, high-quality instruction data. Recently, many works are exploring synthetic data generation using LLMs. However, they primarily focus on prompt…

计算与语言 · 计算机科学 2024-12-10 Yifang Chen , David Zhu , Simon Du , Kevin Jamieson , Yang Liu

Effective document reranking is essential for improving search relevance across diverse applications. While Large Language Models (LLMs) excel at reranking due to their deep semantic understanding and reasoning, their high computational…

计算与语言 · 计算机科学 2025-10-03 Dimitar Peshevski , Kiril Blazhevski , Martin Popovski , Gjorgji Madjarov

The widespread use of big data across sectors has raised major privacy concerns, especially when sensitive information is shared or analyzed. Regulations such as GDPR and HIPAA impose strict controls on data handling, making it difficult to…

机器学习 · 计算机科学 2025-12-10 Anantaa Kotal , Anupam Joshi

Synthetic datasets, recognized for their cost effectiveness, play a pivotal role in advancing computer vision tasks and techniques. However, when it comes to remote sensing image processing, the creation of synthetic datasets becomes…

计算机视觉与模式识别 · 计算机科学 2023-09-06 Jian Song , Hongruixuan Chen , Naoto Yokoya

The US Decennial Census provides valuable data for both research and policy purposes. Census data are subject to a variety of disclosure avoidance techniques prior to release in order to preserve respondent confidentiality. While many are…

计算机与社会 · 计算机科学 2025-10-02 Cynthia Dwork , Kristjan Greenewald , Manish Raghavan

The LLM-as-a-judge paradigm enables flexible, user-defined evaluation, but its effectiveness is often limited by the scarcity of diverse, representative data for refining criteria. We present a tool that integrates synthetic data generation…

Fine-tuning for large language models (LLMs) typically requires substantial amounts of high-quality supervised data, which is both costly and labor-intensive to acquire. While synthetic data generation has emerged as a promising solution,…

计算与语言 · 计算机科学 2025-05-28 Zihong Chen , Wanli Jiang , Jinzhe Li , Zhonghang Yuan , Huanjun Kong , Wanli Ouyang , Nanqing Dong

The in-context learning ability of large language models (LLMs) enables them to generalize to novel downstream tasks with relatively few labeled examples. However, they require enormous computational resources to be deployed. Alternatively,…

计算与语言 · 计算机科学 2024-01-09 Jean Kaddour , Qi Liu

Recent advancements in large language models (LLMs) have led to the development of highly potent models like OpenAI's ChatGPT. These models have exhibited exceptional performance in a variety of tasks, such as question answering, essay…

计算与语言 · 计算机科学 2023-04-12 Ruixiang Tang , Xiaotian Han , Xiaoqian Jiang , Xia Hu

Synthetic data generation, a cornerstone of Generative Artificial Intelligence, promotes a paradigm shift in data science by addressing data scarcity and privacy while enabling unprecedented performance. As synthetic data becomes more…

机器学习 · 统计学 2024-03-12 Xiaotong Shen , Yifei Liu , Rex Shen

Imbalanced data are commonly present in real-world applications. While data synthesis can effectively mitigate data scarcity for rare classes, and LLMs have revolutionized text generation, the application of LLMs to the synthesis of…

The pursuit of diverse, complex, and large-scale instruction data is crucial for automatically aligning large language models (LLMs). While there are methods capable of generating synthetic instructions at scale, they either suffer from…

计算与语言 · 计算机科学 2025-06-05 Chiwei Zhu , Benfeng Xu , Xiaorui Wang , Zhendong Mao

We propose scaling up 3D scene reconstruction by training with synthesized data. At the core of our work is MegaSynth, a procedurally generated 3D dataset comprising 700K scenes - over 50 times larger than the prior real dataset DL3DV -…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Hanwen Jiang , Zexiang Xu , Desai Xie , Ziwen Chen , Haian Jin , Fujun Luan , Zhixin Shu , Kai Zhang , Sai Bi , Xin Sun , Jiuxiang Gu , Qixing Huang , Georgios Pavlakos , Hao Tan

Supervised fine-tuning (SFT) is a common method to enhance the tool calling capabilities of Large Language Models (LLMs), with the training data often being synthesized. The current data synthesis process generally involves sampling a set…

计算与语言 · 计算机科学 2025-03-18 Zezhong Wang , Xingshan Zeng , Weiwen Liu , Liangyou Li , Yasheng Wang , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Large language models (LLMs) achieve strong performance across diverse tasks, largely driven by high-quality web data used in pre-training. However, recent studies indicate this data source is rapidly depleting. Synthetic data emerges as a…

Noisy labels are ubiquitous in real-world datasets, especially in the large-scale ones derived from crowdsourcing and web searching. It is challenging to train deep neural networks with noisy datasets since the networks are prone to…

计算机视觉与模式识别 · 计算机科学 2024-06-26 Yangdi Lu , Wenbo He

Effective document intelligence models rely on large amounts of annotated training data. However, procuring sufficient and high-quality data poses significant challenges due to the labor-intensive and costly nature of data acquisition.…

Our ability to synthesize sensory data that preserves specific statistical properties of the real data has had tremendous implications on data privacy and big data analytics. The synthetic data can be used as a substitute for selective real…

机器学习 · 计算机科学 2017-02-01 Moustafa Alzantot , Supriyo Chakraborty , Mani B. Srivastava