English
Related papers

Related papers: Sculpting Features from Noise: Reward-Guided Hiera…

200 papers

Fine-tuning plays a crucial role in adapting models to downstream tasks with minimal training efforts. However, the rapidly increasing size of foundation models poses a daunting challenge for accommodating foundation model fine-tuning in…

Machine Learning · Computer Science 2025-04-18 Shiwei Ding , Lan Zhang , Zhenlin Wang , Giuseppe Ateniese , Xiaoyong Yuan

Text-to-image diffusion models often face a severe trilemma in human portrait generation: text-image alignment, photorealism, and human-perceived aesthetics inherently inhibit one another. Supervised Fine-Tuning (SFT) is an effective method…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Yunlong Wang , Jinjin Shi , Wenbin Gao , Xuran Xu , Runyu Shi , Ying Huang

Text-based image segmentation aims to delineate object boundaries within an image from text prompts, offering higher flexibility and broader application scope compared to traditional fixed-category segmentation tasks. Recent studies have…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Zishen Qu , Xuesong Li , Haijian Gu , Hongwei Kang , Quan Meng , Tianrui Niu , Xin Yang , Ruidong Pan

Modeling and reconstructing multidimensional physical dynamics from sparse and off-grid observations presents a fundamental challenge in scientific research. Recently, diffusion-based generative modeling shows promising potential for…

Machine Learning · Computer Science 2025-09-30 Panqi Chen , Yifan Sun , Lei Cheng , Yang Yang , Weichang Li , Yang Liu , Weiqing Liu , Jiang Bian , Shikai Fang

Diffusion models are powerful generative models that can produce highly realistic samples for various tasks. Typically, these models are constructed using centralized, independently and identically distributed (IID) training data. However,…

Machine Learning · Computer Science 2025-03-14 Zihao Peng , Xijun Wang , Shengbo Chen , Hong Rao , Cong Shen

Data-driven dynamics prediction often fails under environmental shifts, while traditional fine-tuning remains computationally prohibitive for hardware-constrained or data-scarce applications. We propose DynaDiff, a generative meta-learning…

Computational Engineering, Finance, and Science · Computer Science 2026-05-05 Ruikun Li , Huandong Wang , Jingtao Ding , Yuan Yuan , Qingmin Liao , Yong Li

Diffusion models enable high-quality virtual try-on (VTO) with their established image synthesis abilities. Despite the extensive end-to-end training of large pre-trained models involved in current VTO methods, real-world applications often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Xingzi Xu , Qi Li , Shuwen Qiu , Julien Han , Karim Bouyarmane

This study presents a generative optimization framework that builds on a fine-tuned diffusion model and reward-directed sampling to generate high-performance engineering designs. The framework adopts a parametric representation of the…

Machine Learning · Computer Science 2025-08-05 Hadi Keramati , Patrick Kirchen , Mohammed Hannan , Rajeev K. Jaiman

Discrete diffusion models generate sequences by iteratively denoising samples corrupted by categorical noise, offering an appealing alternative to autoregressive decoding for structured and symbolic generation. However, standard training…

Machine Learning · Computer Science 2026-02-04 Huu Binh Ta , Michael Cardei , Alvaro Velasquez , Ferdinando Fioretto

Finding local correspondences between images with different viewpoints requires local descriptors that are robust against geometric transformations. An approach for transformation invariance is to integrate out the transformations by…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Yuan Liu , Zehong Shen , Zhixuan Lin , Sida Peng , Hujun Bao , Xiaowei Zhou

Predicting interfacial thermodynamics across molecular and continuum scales remains a central challenge in computational science. Classical density functional theory (cDFT) provides a first-principles route to connect microscopic…

Computational Physics · Physics 2026-01-01 Edoardo Monti , Peter Yatsyshin , Konstantinos Gkagkas , Andrew B. Duncan

Feature selection aims to identify the most pattern-discriminative feature subset. In prior literature, filter (e.g., backward elimination) and embedded (e.g., Lasso) methods have hyperparameters (e.g., top-K, score thresholding) and tie to…

Machine Learning · Computer Science 2024-03-07 Wangyang Ying , Dongjie Wang , Haifeng Chen , Yanjie Fu

Finding correspondences between images is a fundamental problem in computer vision. In this paper, we show that correspondence emerges in image diffusion models without any explicit supervision. We propose a simple strategy to extract this…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Luming Tang , Menglin Jia , Qianqian Wang , Cheng Perng Phoo , Bharath Hariharan

Diffusion models have proven to be highly effective in generating high-quality images. However, adapting large pre-trained diffusion models to new domains remains an open challenge, which is critical for real-world applications. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Enze Xie , Lewei Yao , Han Shi , Zhili Liu , Daquan Zhou , Zhaoqiang Liu , Jiawei Li , Zhenguo Li

Diffusion Transformer (DiT), an emerging diffusion model for visual generation, has demonstrated superior performance but suffers from substantial computational costs. Our investigations reveal that these costs primarily stem from the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Wangbo Zhao , Yizeng Han , Jiasheng Tang , Kai Wang , Hao Luo , Yibing Song , Gao Huang , Fan Wang , Yang You

The surge in Large Language Models (LLMs) has revolutionized natural language processing, but fine-tuning them for specific tasks often encounters challenges in balancing performance and preserving general instruction-following abilities.…

Computation and Language · Computer Science 2024-05-29 Zhaorui Yang , Tianyu Pang , Haozhe Feng , Han Wang , Wei Chen , Minfeng Zhu , Qian Liu

Enhancing the efficiency of high-quality image generation using Diffusion Models (DMs) is a significant challenge due to the iterative nature of the process. Flow Matching (FM) is emerging as a powerful generative modeling paradigm based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Pascal Zwick , Nils Friederich , Maximilian Beichter , Lennart Hilbert , Ralf Mikut , Oliver Bringmann

We introduce the Fixed Point Diffusion Model (FPDM), a novel approach to image generation that integrates the concept of fixed point solving into the framework of diffusion-based generative modeling. Our approach embeds an implicit fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xingjian Bai , Luke Melas-Kyriazi

Diffusion Transformers (DiT) have emerged as a widely adopted backbone for high-fidelity image and video generation, yet their iterative denoising process incurs high computational costs. Existing training-free acceleration methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Hanshuai Cui , Zhiqing Tang , Qianli Ma , Zhi Yao , Weijia Jia

Diffusion models face a fundamental trade-off between generation quality and computational efficiency. Latent Diffusion Models (LDMs) offer an efficient solution but suffer from potential information loss and non-end-to-end training. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhennan Chen , Junwei Zhu , Xu Chen , Jiangning Zhang , Xiaobin Hu , Hanzhen Zhao , Chengjie Wang , Jian Yang , Ying Tai