中文
相关论文

相关论文: Analyzing and Mitigating Model Collapse in Rectifi…

200 篇论文

Consistency models have been proposed for fast generative modeling, achieving results competitive with diffusion and flow models. However, these methods exhibit inherent instability and limited reproducibility when training from scratch,…

机器学习 · 计算机科学 2026-02-02 Youngjoong Kim , Duhoe Kim , Woosung Kim , Jaesik Park

Diffusion models have shown great promise for image and video generation, but sampling from state-of-the-art models requires expensive numerical integration of a generative ODE. One approach for tackling this problem is rectified flows,…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Sangyun Lee , Zinan Lin , Giulia Fanti

Generative artificial intelligence is rapidly transforming the supply side of training data: an increasing share of new tokens, images, and structured records is produced by previous-generation models rather than by human originators.…

综合经济学 · 经济学 2026-05-21 Gustav Olaf Yunus Laitinen-Fredriksson Lundström-Imanov

The growing number of pretrained models in Machine Learning (ML) presents significant challenges for practitioners. Given a new dataset, they need to determine the most suitable deep learning (DL) pipeline, consisting of the pretrained…

机器学习 · 计算机科学 2025-06-17 Fabio Ferreira

Modality gap significantly restricts the effectiveness of multimodal fusion. Previous methods often use techniques such as diffusion models and adversarial learning to reduce the modality gap, but they typically focus on one-to-one…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Sijie Mai , Shiqin Han

We propose ReinFlow, a simple yet effective online reinforcement learning (RL) framework that fine-tunes a family of flow matching policies for continuous robotic control. Derived from rigorous RL theory, ReinFlow injects learnable noise…

机器人学 · 计算机科学 2026-01-09 Tonghe Zhang , Chao Yu , Sichang Su , Yu Wang

The diffusion models including Denoising Diffusion Probabilistic Models (DDPM) and score-based generative models have demonstrated excellent performance in speech synthesis tasks. However, its effectiveness comes at the cost of numerous…

声音 · 计算机科学 2024-02-01 Wenhao Guan , Qi Su , Haodong Zhou , Shiyu Miao , Xingjia Xie , Lin Li , Qingyang Hong

Recently, rectified flow (RF)-based models have achieved state-of-the-art performance in many areas for both the multi-step and one-step generation. However, only a few theoretical works analyze the discretization complexity of RF-based…

机器学习 · 计算机科学 2025-08-13 Ruofeng Yang , Zhaoyu Zhu , Bo Jiang , Cheng Chen , Shuai Li

Generative modeling techniques such as Diffusion and Flow Matching have achieved significant successes in generating designable and diverse protein backbones. However, many current models are computationally expensive, requiring hundreds or…

生物大分子 · 定量生物学 2025-10-30 Junhua Chen , Simon Mathis , Charles Harris , Kieran Didi , Pietro Lio

This work presents, to the best of the authors' knowledge, the first generalizable and fully data-driven adaptive framework designed to stabilize deep learning (DL) autoregressive forecasting models over long time horizons, with the goal of…

流体动力学 · 物理学 2025-05-06 Rodrigo Abadía-Heredia , Manuel Lopez-Martin , Soledad Le Clainche

Synthetic data has been proposed as a solution to address the issue of high-quality data scarcity in the training of large language models (LLMs). Studies have shown that synthetic data can effectively improve the performance of LLMs on…

计算与语言 · 计算机科学 2024-06-19 Jie Chen , Yupeng Zhang , Bingning Wang , Wayne Xin Zhao , Ji-Rong Wen , Weipeng Chen

Federated Learning (FL) has emerged as a powerful paradigm for decentralized model training, yet it remains vulnerable to deep leakage (DL) attacks that reconstruct private client data from shared model updates. While prior DL methods have…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Isaac Baglin , Xiatian Zhu , Simon Hadfield

Given the ease of creating synthetic data from machine learning models, new models can be potentially trained on synthetic data generated by previous models. This recursive training process raises concerns about the long-term impact on…

机器学习 · 计算机科学 2024-12-24 Ananda Theertha Suresh , Andrew Thangaraj , Aditya Nanda Kishore Khandavally

The increasing prevalence of synthetic data in training loops has raised concerns about model collapse, where generative models degrade when trained on their own outputs. While prior work focuses on this self-consuming process, we study an…

机器学习 · 计算机科学 2025-03-12 Weiguo Gao , Ming Li

Machine learning methods, such as diffusion models, are widely explored as a promising way to accelerate high-fidelity fluid dynamics computation via a super-resolution process from faster-to-compute low-fidelity input. However, existing…

计算工程、金融与科学 · 计算机科学 2025-12-24 Ruoyan Li , Zijie Huang , Haixin Wang , Guancheng Wan , Yizhou Sun , Wei Wang

High-quality power flow datasets are essential for training machine learning models in power systems. However, security and privacy concerns restrict access to real-world data, making statistically accurate and physically consistent…

机器学习 · 计算机科学 2025-08-26 Milad Hoseinpour , Vladimir Dvorkin

Deep learning model effectiveness in classification tasks is often challenged by the quality and quantity of training data whenever they are affected by strong spurious correlations between specific attributes and target labels. This…

As Large Language Models (LLMs) become increasingly prevalent, their generated outputs are proliferating across the web, risking a future where machine-generated content dilutes human-authored text. Since online data is the primary resource…

计算与语言 · 计算机科学 2025-09-23 George Drayson , Emine Yilmaz , Vasileios Lampos

Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit…

计算机视觉与模式识别 · 计算机科学 2026-03-09 Hila Chefer , Patrick Esser , Dominik Lorenz , Dustin Podell , Vikash Raja , Vinh Tong , Antonio Torralba , Robin Rombach

In this study, we proposed an efficient approach based on a deep learning (DL) denoising autoencoder (DAE) model for denoising noisy flow fields. The DAE operates on a self-learning principle and does not require clean data as training…

流体动力学 · 物理学 2024-08-06 Linqi Yu , Mustafa Z. Yousif , Dan Zhou , Meng Zhang , Jungsub Lee , Hee-Chang Lim