中文
相关论文

相关论文: Expert Routing with Synthetic Data for Continual L…

200 篇论文

Training student models on synthetic data generated by strong teacher models is a promising way to distilling the capabilities of teachers. However, recent studies show that stronger models are not always optimal teachers, revealing a…

Deep learning methods typically require vast amounts of training data to reach their full potential. While some publicly available datasets exists, domain specific data always needs to be collected and manually labeled, an expensive, time…

计算机视觉与模式识别 · 计算机科学 2019-02-27 Stefan Hinterstoisser , Olivier Pauly , Hauke Heibel , Martina Marek , Martin Bokeloh

The acquisition of large-scale, high-quality data is a resource-intensive and time-consuming endeavor. Compared to conventional Data Augmentation (DA) techniques (e.g. cropping and rotation), exploiting prevailing diffusion models for data…

计算机视觉与模式识别 · 计算机科学 2024-03-20 Yunxiang Fu , Chaoqi Chen , Yu Qiao , Yizhou Yu

For a fixed parameter size, the capabilities of large models are primarily determined by the quality and quantity of its training data. Consequently, training datasets now grow faster than the rate at which new data is indexed on the web,…

机器学习 · 计算机科学 2025-09-12 Minqi Jiang , João G. M. Araújo , Will Ellsworth , Sian Gooding , Edward Grefenstette

Semantic scene understanding is crucial for robotics and computer vision applications. In autonomous driving, 3D semantic segmentation plays an important role for enabling safe navigation. Despite significant advances in the field, the…

计算机视觉与模式识别 · 计算机科学 2026-03-02 Lucas Nunes , Rodrigo Marcuzzi , Jens Behley , Cyrill Stachniss

Recent advances in large language model (LLM) training have highlighted the need for diverse, high-quality instruction data. Recently, many works are exploring synthetic data generation using LLMs. However, they primarily focus on prompt…

计算与语言 · 计算机科学 2024-12-10 Yifang Chen , David Zhu , Simon Du , Kevin Jamieson , Yang Liu

Most approaches to dense anomaly detection rely on generative modeling or on discriminative methods that train with negative data. We consider a recent hybrid method that optimizes the same shared representation according to cross-entropy…

计算机视觉与模式识别 · 计算机科学 2023-05-25 Anja Delić , Matej Grcić , Siniša Šegvić

Generative text-to-image models enable us to synthesize unlimited amounts of images in a controllable manner, spurring many recent efforts to train vision models with synthetic data. However, every synthetic image ultimately originates from…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Scott Geng , Cheng-Yu Hsieh , Vivek Ramanujan , Matthew Wallingford , Chun-Liang Li , Pang Wei Koh , Ranjay Krishna

Training supervised deep neural networks that perform defect detection and segmentation requires large-scale fully-annotated datasets, which can be hard or even impossible to obtain in industrial environments. Generative AI offers…

计算机视觉与模式识别 · 计算机科学 2024-01-09 Gabriele Valvano , Antonino Agostino , Giovanni De Magistris , Antonino Graziano , Giacomo Veneri

Deep learning models need a sufficient amount of data in order to be able to find the hidden patterns in it. It is the purpose of generative modeling to learn the data distribution, thus allowing us to sample more data and augment the…

机器学习 · 计算机科学 2024-11-28 José Fernando Núñez , Jamie Arjona , Javier Béjar

Data limitation is one of the most common issues in training machine learning classifiers for medical applications. Due to ethical concerns and data privacy, the number of people that can be recruited to such experiments is generally…

音频与语音处理 · 电气工程与系统科学 2020-04-14 Bahman Mirheidari , Yilin Pan , Daniel Blackburn , Ronan O'Malley , Traci Walker , Annalena Venneri , Markus Reuber , Heidi Christensen

Access to individual-level health data is essential for gaining new insights and advancing science. In particular, modern methods based on artificial intelligence rely on the availability of and access to large datasets. In the health…

Real-time semantic segmentation models offer an excellent balance between accuracy and inference speed. However, deploying these models in dynamic real world environments often requires the ability to learn novel classes incrementally…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Yujing Zhou , Prashant Shekhar , Thomas Yang , Yongxin Liu

Modern foundation models often undergo iterative ``bootstrapping'' in their post-training phase: a model generates synthetic data, an external verifier filters out low-quality samples, and the high-quality subset is used for further…

机器学习 · 计算机科学 2025-10-17 Pu Yang , Yunzhen Feng , Ziyuan Chen , Yuhang Wu , Zhuoyuan Li

Lifelong person re-identification attempts to recognize people across cameras and integrate new knowledge from continuous data streams. Key challenges involve addressing catastrophic forgetting caused by parameter updating and domain shift,…

计算机视觉与模式识别 · 计算机科学 2024-11-12 Hongyu Chen , Bingliang Jiao , Wenxuan Wang , Peng Wang

Learning-to-defer (L2D) routes each decision to a system's own predictor or to an external expert. Streaming time-series settings break the offline-L2D assumptions: the data are non-stationary, expert availability shifts over time, and the…

机器学习 · 计算机科学 2026-05-21 Yannis Montreuil , Letian Yu , Axel Carlier , Lai Xing Ng , Wei Tsang Ooi

The LLM-as-a-judge paradigm enables flexible, user-defined evaluation, but its effectiveness is often limited by the scarcity of diverse, representative data for refining criteria. We present a tool that integrates synthetic data generation…

Data-Free Knowledge Distillation (KD) allows knowledge transfer from a trained neural network (teacher) to a more compact one (student) in the absence of original training data. Existing works use a validation set to monitor the accuracy of…

机器学习 · 计算机科学 2024-07-30 Kuluhan Binici , Shivam Aggarwal , Nam Trung Pham , Karianto Leman , Tulika Mitra

Exploiting synthetic data to learn deep models has attracted increasing attention in recent years. However, the intrinsic domain difference between synthetic and real images usually causes a significant performance drop when applying the…

计算机视觉与模式识别 · 计算机科学 2018-04-10 Yuhua Chen , Wen Li , Luc Van Gool

Data augmentation is crucial for pixel-wise annotation tasks like semantic segmentation, where labeling requires significant effort and intensive labor. Traditional methods, involving simple transformations such as rotations and flips,…

计算机视觉与模式识别 · 计算机科学 2025-09-05 Quang-Huy Che , Duc-Tri Le , Bich-Nga Pham , Duc-Khai Lam , Vinh-Tiep Nguyen