English
Related papers

Related papers: Improved techniques for fine-tuning flow models vi…

200 papers

This study addresses a distributed optimization with a novel class of coupling of variables, called clique-wise coupling. A clique is a node set of a complete subgraph of an undirected graph. This setup is an extension of pairwise coupled…

Optimization and Control · Mathematics 2023-04-24 Yuto Watanabe , Kazunori Sakurama

Diffusion models have achieved significant progress in both image and video generation while still suffering from huge computation costs. As an effective solution, flow matching aims to reflow the diffusion process of diffusion models into…

Graphics · Computer Science 2025-03-13 Lei Ke , Haohang Xu , Xuefei Ning , Yu Li , Jiajun Li , Haoling Li , Yuxuan Lin , Dongsheng Jiang , Yujiu Yang , Linfeng Zhang

Adjoint method is widely used in aerodynamic design because only once solution of flow field is required for adjoint method to obtain the gradients of all design variables. However, the calculation cost of adjoint vector is approximately…

Fluid Dynamics · Physics 2021-01-01 Mengfei Xu , Shufang Song , Xuxiang Sun , Wengang Chen , Weiwei Zhang

For a given {\it misfit function}, a specified optimality measure of a model, its gradient describes the manner in which one may alter properties of the system to march towards a stationary point. The adjoint method, arising from…

Solar and Stellar Astrophysics · Physics 2015-05-28 Shravan Hanasoge , Aaron Birch , Laurent Gizon , Jeroen Tromp

Iterative generative models such as Flow Matching and Diffusion models have demonstrated strong test-time scaling behavior, where additional inference computation can improve generation quality. In contrast, Drift Models offer efficient…

Machine Learning · Computer Science 2026-05-19 Chenrui Ma , Xi Xiao , Lin Zhao , Tianyang Wang , Ferdinando Fioretto , Yanning Shen

Flow-matching policies have emerged as a powerful paradigm for generalist robotics. These models are trained to imitate an action chunk, conditioned on sensor observations and textual instructions. Often, training demonstrations are…

Machine Learning · Computer Science 2025-07-22 Samuel Pfrommer , Yixiao Huang , Somayeh Sojoudi

Adjoint-based sensitivity analysis is of interest in computational science due to its ability to compute sensitivities at a lower cost with respect to several design parameters. However, conventional sensitivity analysis methods fail in the…

Numerical Analysis · Mathematics 2025-07-15 Pranshul Thakur , Siva Nadarajah

End-to-end autonomous driving is typically built upon imitation learning (IL), yet its performance is constrained by the quality of human demonstrations. To overcome this limitation, recent methods incorporate reinforcement learning (RL)…

Robotics · Computer Science 2026-04-13 Zhexi Lian , Haoran Wang , Xuerun Yan , Weimeng Lin , Xianhong Zhang , Yongyu Chen , Jia Hu

Multi-step LLM pipelines can solve complex tasks, but jointly optimizing prompts across steps remains challenging due to missing step-level supervision and inter-step dependency. We propose ADOPT, an adaptive dependency-guided joint prompt…

Computation and Language · Computer Science 2026-04-09 Minjun Zhao , Xinyu Zhang , Shuai Zhang , Deyang Li , Ruifeng Shi

Applications for kinetic equations such as optimal design and inverse problems often involve finding unknown parameters through gradient-based optimization algorithms. Based on the adjoint-state method, we derive two different frameworks…

Numerical Analysis · Mathematics 2021-06-02 Russel Caflisch , Denis Silantyev , Yunan Yang

The effectiveness of the machine learning methods for real-world tasks depends on the proper structure of the modeling pipeline. The proposed approach is aimed to automate the design of composite machine learning pipelines, which is…

Preference learning extends the performance of Code LLMs beyond traditional supervised fine-tuning by leveraging relative quality comparisons. In existing approaches, a set of n candidate solutions is evaluated based on test case success…

Computation and Language · Computer Science 2025-10-10 Jie Wu , Haoling Li , Xin Zhang , Xiao Liu , Yangyu Huang , Jianwen Luo , Yizhen Zhang , Zuchao Li , Ruihang Chu , Yujiu Yang , Scarlett Li

Sequential recommendation predicts each user's next item based on their historical interaction sequence. Recently, diffusion models have attracted significant attention in this area due to their strong ability to model user interest…

Information Retrieval · Computer Science 2025-08-26 Li Li , Mingyue Cheng , Yuyang Ye , Zhiding Liu , Enhong Chen

Flow matching has emerged as a simulation-free alternative to diffusion-based generative modeling, producing samples by solving an ODE whose time-dependent velocity field is learned along an interpolation between a simple source…

Machine Learning · Statistics 2026-04-10 Shivam Kumar , Yixin Wang , Lizhen Lin

This work addresses the challenge of personalizing trajectories generated in automated decision-making systems by introducing a resource-efficient approach that enables rapid adaptation to individual users' preferences. Our method leverages…

Machine Learning · Computer Science 2025-03-25 Wen Zheng Terence Ng , Jianda Chen , Yuan Xu , Tianwei Zhang

Optimal transport (OT) and Schr{\"o}dinger bridge (SB) problems have emerged as powerful frameworks for transferring probability distributions with minimal cost. However, existing approaches typically focus on endpoint matching while…

Optimization and Control · Mathematics 2025-10-09 Xu Duan , Dongmei Chen

The present paper aims at providing a numerical strategy to deal with PDE-constrained optimization problems solved with the adjoint method. It is done through out a unified formulation of the constraint PDE and the adjoint model. The…

Optimization and Control · Mathematics 2017-12-01 Gino I. Montecinos , Juan Lopez-Rios , Jaime H. Ortega , Rodrigo Lecaros

This paper presents a novel framework for aligning learnable latent spaces to arbitrary target distributions by leveraging flow-based generative models as priors. Our method first pretrains a flow model on the target features to capture the…

Machine Learning · Computer Science 2026-03-17 Yizhuo Li , Yuying Ge , Yixiao Ge , Ying Shan , Ping Luo

We present a novel particle filtering framework for continuous-time dynamical systems with continuous-time measurements. Our approach is based on the duality between estimation and optimal control, which allows reformulating the estimation…

Optimization and Control · Mathematics 2021-10-08 Qinsheng Zhang , Amirhossein Taghvaei , Yongxin Chen

Direct preference optimization (DPO) has shown success in aligning diffusion models with human preference. Previous approaches typically assume a consistent preference label between final generations and noisy samples at intermediate steps,…

Machine Learning · Computer Science 2025-02-05 Jie Ren , Yuhang Zhang , Dongrui Liu , Xiaopeng Zhang , Qi Tian