English
Related papers

Related papers: Gradual Fine-Tuning for Flow Matching Models

200 papers

Training diffusion models on limited datasets poses challenges in terms of limited generation capacity and expressiveness, leading to unsatisfactory results in various downstream tasks utilizing pretrained diffusion models, such as domain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jiwan Hur , Jaehyun Choi , Gyojin Han , Dong-Jae Lee , Junmo Kim

MeanFlow (MF) has recently been established as a framework for one-step generative modeling. However, its ``fastforward'' nature introduces key challenges in both the training objective and the guidance mechanism. First, the original MF's…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhengyang Geng , Yiyang Lu , Zongze Wu , Eli Shechtman , J. Zico Kolter , Kaiming He

Point cloud foundation models demonstrate strong generalization, yet adapting them to downstream tasks remains challenging in low-data regimes. Full fine-tuning often leads to overfitting and significant drift from pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Sneha Paul , Zachary Patterson , Nizar Bouguila

Pretrained Foundation Models (PFMs) have transformed numerous applications by enabling efficient adaptation to customized tasks. Parameter-Efficient Fine-Tuning (PEFT) has emerged as a resource-efficient alternative to full fine-tuning,…

Machine Learning · Computer Science 2025-06-16 Baoquan Zhang , Guangning Xu , Michael. K. Ng

Modern instruction-tuned large language models (LLMs) have made remarkable progress in code generation. However, these LLMs fine-tuned with standard supervised fine-tuning (SFT) sometimes generate plausible-looking but functionally…

Software Engineering · Computer Science 2026-01-14 Lishui Fan , Zhongxin Liu , Haoye Wang , Lingfeng Bao , Xin Xia , Shanping Li

Deep generative models provide state-of-the-art performance across a wide array of applications, with recent studies showing increasing applicability for science and engineering. Despite a growing corpus of literature focused on the…

Machine Learning · Computer Science 2026-05-14 Jacob K. Christopher , James E. Warner , Ferdinando Fioretto

Pre-trained vision-language models (VLMs) exhibit strong zero-shot generalization but remain vulnerable to adversarial perturbations. Existing classification-guided adversarial fine-tuning methods often disrupt pre-trained cross-modal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Yubo Cui , Xianchao Guan , Zijun Xiong , Zheng Zhang

Time Series Foundation Models (TSFMs) advance generalization and data efficiency in time series forecasting by unified large-scale pretraining. But TSFMs remain lacking when adapting to specific downstream forecasting tasks for two reasons.…

Signal Processing · Electrical Eng. & Systems 2026-05-04 Siyang Li , Yize Chen , Zijie Zhu , Yuxin Pan , Yan Guo , Ming Huang , Hui Xiong

Supervised Fine-Tuning (SFT) is the standard paradigm for domain adaptation, yet it frequently incurs the cost of catastrophic forgetting. In sharp contrast, on-policy Reinforcement Learning (RL) effectively preserves general capabilities.…

Machine Learning · Computer Science 2026-01-06 Muxi Diao , Lele Yang , Wuxuan Gong , Yutong Zhang , Zhonghao Yan , Yufei Han , Kongming Liang , Weiran Xu , Zhanyu Ma

Backpropagation-based approaches aim to align diffusion models with reward functions through end-to-end backpropagation of the reward gradient within the denoising chain, offering a promising perspective. However, due to the computational…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Xiefan Guo , Miaomiao Cui , Liefeng Bo , Di Huang

By pretraining on trillions of tokens, an LLM gains the capability of text generation. However, to enhance its utility and reduce potential harm, SFT and alignment are applied sequentially to the pretrained model. Because SFT and alignment…

Computation and Language · Computer Science 2026-05-11 Zhichao Wang , Bin Bi , Zixu Zhu , Xiangbo Mao , Jun Wang , Shiyu Wang , Cheng Wang , Dong Nie , Lingzi Hong

The prevailing post-training paradigm for Large Reasoning Models (LRMs) - Supervised Fine-Tuning (SFT) followed by Reinforcement Learning (RL) - suffers from an intrinsic optimization mismatch: the rigid supervision inherent in SFT induces…

Machine Learning · Computer Science 2026-03-19 Zhengyang Zhao , Lu Ma , Yizhen Jiang , Xiaochen Ma , Zimo Meng , Chengyu Shen , Lexiang Tang , Haoze Sun , Peng Pei , Wentao Zhang

Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's velocity independently, considering only its location and time…

Machine Learning · Computer Science 2025-11-11 Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber

Fine-tuning pre-trained models has recently yielded remarkable performance gains in graph neural networks (GNNs). In addition to pre-training techniques, inspired by the latest work in the natural language fields, more recent work has…

Machine Learning · Computer Science 2023-12-12 Shengrui Li , Xueting Han , Jing Bai

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

Adapting large-scale foundation flow and diffusion generative models to optimize task-specific objectives while preserving prior information is crucial for real-world applications such as molecular design, protein docking, and creative…

Machine Learning · Computer Science 2025-12-01 Riccardo De Santi , Marin Vlastelica , Ya-Ping Hsieh , Zebang Shen , Niao He , Andreas Krause

This paper proposes a novel method, Explicit Flow Matching (ExFM), for training and analyzing flow-based generative models. ExFM leverages a theoretically grounded loss function, ExFM loss (a tractable form of Flow Matching (FM) loss), to…

Machine Learning · Computer Science 2024-07-03 Gleb Ryzhakov , Svetlana Pavlova , Egor Sevriugov , Ivan Oseledets

With the prevalence of pre-training-fine-tuning paradigm, how to efficiently adapt the pre-trained model to the downstream tasks has been an intriguing issue. Parameter-Efficient Fine-Tuning (PEFT) methods have been proposed for low-cost…

Machine Learning · Computer Science 2024-06-11 Weixi Song , Zuchao Li , Lefei Zhang , Hai Zhao , Bo Du

Despite the massive success of fine-tuning Pre-trained Language Models (PLMs), they remain susceptible to out-of-distribution input. Dataset cartography is a simple yet effective dual-model approach that improves the robustness of…

Computation and Language · Computer Science 2024-12-12 Yupei Du , Albert Gatt , Dong Nguyen

Modeling transformations between arbitrary data distributions is a fundamental scientific challenge, arising in applications like drug discovery and evolutionary simulation. While flow matching offers a natural framework for this task, its…

Machine Learning · Computer Science 2025-10-09 Shiye Su , Yuhui Zhang , Linqi Zhou , Rajesh Ranganath , Serena Yeung-Levy