English
Related papers

Related papers: Efficient Adjoint Matching for Fine-tuning Diffusi…

200 papers

A neural network model of a differential equation, namely neural ODE, has enabled the learning of continuous-time dynamical systems and probabilistic distributions with high accuracy. The neural ODE uses the same network repeatedly during a…

Machine Learning · Computer Science 2021-10-20 Takashi Matsubara , Yuto Miyatake , Takaharu Yaguchi

Vision-language models (VLMs) like CLIP excel in zero-shot learning by aligning image and text representations through contrastive pretraining. Existing approaches to unsupervised adaptation (UA) for fine-grained classification with VLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Eman Ali , Sathira Silva , Chetan Arora , Muhammad Haris Khan

Although diffusion-based real-world image restoration (Real-IR) has achieved remarkable progress, efficiently leveraging ultra-large-scale pre-trained text-to-image (T2I) models and fully exploiting their potential remain significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Purui Bai , Junxian Duan , Pin Wang , Jinhua Hao , Ming Sun , Chao Zhou , Huaibo Huang

This paper addresses the challenge of achieving high-quality and fast image generation that aligns with complex human preferences. While recent advancements in diffusion models and distillation have enabled rapid generation, the effective…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yihong Luo , Tianyang Hu , Weijian Luo , Kenji Kawaguchi , Jing Tang

Diffusion models excel in solving imaging inverse problems due to their ability to model complex image priors. However, their reliance on large, clean datasets for training limits their practical use where clean data is scarce. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Weimin Bai , Yifei Wang , Wenzheng Chen , He Sun

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis

Recent advances in deep learning and automatic speech recognition (ASR) have enabled the end-to-end (E2E) ASR system and boosted the accuracy to a new level. The E2E systems implicitly model all conventional ASR components, such as the…

In this paper, we explore a novel image matting task aimed at achieving efficient inference under various computational cost constraints, specifically FLOP limitations, using a single matting network. Existing matting methods which have not…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Qinglin Liu , Zonglin Li , Xiaoqian Lv , Xin Sun , Ru Li , Shengping Zhang

Self-rewarding have emerged recently as a powerful tool in the field of Natural Language Processing (NLP), allowing language models to generate high-quality relevant responses by providing their own rewards during training. This innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Safouane El Ghazouali , Arnaud Gucciardi , Umberto Michelucci

Diffusion models (DMs) have achieved state-of-the-art generative performance but suffer from high sampling latency due to their sequential denoising nature. Existing solver-based acceleration methods often face image quality degradation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Beier Zhu , Ruoyu Wang , Tong Zhao , Hanwang Zhang , Chi Zhang

Diffusion models offer superior generation quality at the expense of extensive sampling steps. Distillation methods, with Distribution Matching Distillation (DMD) as a popular example, can mitigate this issue, but performance degradation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Xu Wang , Zexian Li , Litong Gong , Tiezheng Ge , Zhijie Deng

The Stable Diffusion Model (SDM) is a prevalent and effective model for text-to-image (T2I) and image-to-image (I2I) generation. Despite various attempts at sampler optimization, model distillation, and network quantification, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jinchao Zhu , Yuxuan Wang , Siyuan Pan , Pengfei Wan , Di Zhang , Gao Huang

We have made significant progress towards building foundational video diffusion models. As these models are trained using large-scale unsupervised data, it has become crucial to adapt these models to specific downstream tasks. Adapting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Mihir Prabhudesai , Russell Mendonca , Zheyang Qin , Katerina Fragkiadaki , Deepak Pathak

The objective for establishing dense correspondence between paired images consists of two terms: a data term and a prior term. While conventional techniques focused on defining hand-designed prior terms, which are difficult to formulate,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-26 Jisu Nam , Gyuseong Lee , Sunwoo Kim , Hyeonsu Kim , Hyoungwon Cho , Seyeon Kim , Seungryong Kim

Establishing object-level correspondence between egocentric and exocentric views is essential for intelligent assistants to deliver precise and intuitive visual guidance. However, this task faces numerous challenges, including extreme…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yijun Hu , Bing Fan , Xin Gu , Haiqing Ren , Dongfang Liu , Heng Fan , Libo Zhang

Safe and effective motion planning is crucial for autonomous robots. Diffusion models excel at capturing complex agent interactions, a fundamental aspect of decision-making in dynamic environments. Recent studies have successfully applied…

Robotics · Computer Science 2025-07-18 Giwon Lee , Daehee Park , Jaewoo Jeong , Kuk-Jin Yoon

We study Bayesian inverse problems with mixed noise, modeled as a combination of additive and multiplicative Gaussian components. While traditional inference methods often assume fixed or known noise characteristics, real-world…

Machine Learning · Computer Science 2025-10-17 Paul Hagemann , Robert Gruhlke , Bernhard Stankewitz , Claudia Schillings , Gabriele Steidl

Adaptive gradient methods, such as Adam and LAMB, have demonstrated excellent performance in the training of large language models. Nevertheless, the need for adaptivity requires maintaining second-moment estimates of the per-parameter…

Computation and Language · Computer Science 2023-08-08 Yang Luo , Xiaozhe Ren , Zangwei Zheng , Zhuo Jiang , Xin Jiang , Yang You

Recent diffusion and flow matching models have demonstrated strong capabilities in image generation and editing by progressively removing noise through iterative sampling. While this enables flexible inversion for semantic-preserving edits,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Yasong Dai , Zeeshan Hayder , David Ahmedt-Aristizabal , Hongdong Li

While diffusion distillation has enabled one-step generation through methods like Variational Score Distillation, adapting distilled models to emerging new controls -- such as novel structural constraints or latest user preferences --…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Yihong Luo , Tianyang Hu , Yifan Song , Jiacheng Sun , Zhenguo Li , Jing Tang