中文
相关论文

相关论文: From Reflection to Perfection: Scaling Inference-T…

200 篇论文

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Text-to-image generation executes a diffusion workflow comprising multiple models centered on a base diffusion model. Existing serving systems treat each workflow as an opaque monolith, provisioning, placing, and scaling all constituent…

分布式、并行与集群计算 · 计算机科学 2026-04-10 Lingyun Yang , Suyi Li , Tianyu Feng , Xiaoxiao Jiang , Zhipeng Di , Weiyi Lu , Kan Liu , Yinghao Yu , Tao Lan , Guodong Yang , Lin Qu , Liping Zhang , Wei Wang

Diffusion models excel in high-quality generation but suffer from slow inference due to iterative sampling. While recent methods have successfully transformed diffusion models into one-step generators, they neglect model size reduction,…

计算机视觉与模式识别 · 计算机科学 2024-07-19 Yuanzhi Zhu , Xingchao Liu , Qiang Liu

Diffusion and flow-matching models achieve remarkable generative performance but at the cost of many sampling steps, this slows inference and limits applicability to time-critical tasks. The ReFlow procedure can accelerate sampling by…

机器学习 · 计算机科学 2024-10-11 Beomsu Kim , Yu-Guan Hsieh , Michal Klein , Marco Cuturi , Jong Chul Ye , Bahjat Kawar , James Thornton

Recent text-to-image diffusion models have achieved remarkable visual fidelity but often struggle with semantic alignment to complex prompts. We introduce CritiFusion, a novel inference-time framework that integrates a multimodal semantic…

计算机视觉与模式识别 · 计算机科学 2026-01-01 ZhenQi Chen , TsaiChing Ni , YuanFu Yang

We propose a new finetuning method to provide pre-trained large language models (LMs) the ability to scale test-time compute through the diffusion framework. By increasing the number of diffusion steps, we show our finetuned models achieve…

计算与语言 · 计算机科学 2025-06-04 Edoardo Cetin , Tianyu Zhao , Yujin Tang

Text-based diffusion models have exhibited remarkable success in generation and editing, showing great promise for enhancing visual content with their generative prior. However, applying these models to video super-resolution remains…

计算机视觉与模式识别 · 计算机科学 2023-12-12 Shangchen Zhou , Peiqing Yang , Jianyi Wang , Yihang Luo , Chen Change Loy

Recent years have witnessed the prosperity of reference-based image super-resolution (Ref-SR). By importing the high-resolution (HR) reference images into the single image super-resolution (SISR) approach, the ill-posed nature of this…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Zihan Wang , Ziliang Xiong , Hongying Tang , Xiaobing Yuan

Instruction tuning is critical to large language models (LLMs) for achieving better instruction following and task adaptation capabilities but its success heavily relies on the training data quality. Many recent methods focus on improving…

计算与语言 · 计算机科学 2024-06-11 Ming Li , Lichang Chen , Jiuhai Chen , Shwai He , Jiuxiang Gu , Tianyi Zhou

Self-supervised feed-forward methods for scene flow estimation offer real-time efficiency, but their supervision from two-frame point correspondences is unreliable and often breaks down under occlusions. Multi-frame supervision has the…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Qingwen Zhang , Chenhan Jiang , Xiaomeng Zhu , Yunqi Miao , Yushan Zhang , Olov Andersson , Patric Jensfelt

Image fusion seeks to seamlessly integrate foreground objects with background scenes, producing realistic and harmonious fused images. Unlike existing methods that directly insert objects into the background, adaptive and interactive fusion…

计算机视觉与模式识别 · 计算机科学 2025-04-14 Junjia Huang , Pengxiang Yan , Jiyang Liu , Jie Wu , Zhao Wang , Yitong Wang , Liang Lin , Guanbin Li

Advanced diffusion models like RPG, Stable Diffusion 3 and FLUX have made notable strides in compositional text-to-image generation. However, these methods typically exhibit distinct strengths for compositional generation, with some…

计算机视觉与模式识别 · 计算机科学 2025-02-06 Xinchen Zhang , Ling Yang , Guohao Li , Yaqi Cai , Jiake Xie , Yong Tang , Yujiu Yang , Mengdi Wang , Bin Cui

Recent advancements in controllable text-to-image (T2I) diffusion models, such as Ctrl-X and FreeControl, have demonstrated robust spatial and appearance control without requiring auxiliary module training. However, these models often…

计算机视觉与模式识别 · 计算机科学 2025-08-14 Jiwon Kim , Pureum Kim , SeonHwa Kim , Soobin Park , Eunju Cha , Kyong Hwan Jin

This paper presents SANA-1.5, a linear Diffusion Transformer for efficient scaling in text-to-image generation. Building upon SANA-1.0, we introduce three key innovations: (1) Efficient Training Scaling: A depth-growth paradigm that enables…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Enze Xie , Junsong Chen , Yuyang Zhao , Jincheng Yu , Ligeng Zhu , Chengyue Wu , Yujun Lin , Zhekai Zhang , Muyang Li , Junyu Chen , Han Cai , Bingchen Liu , Daquan Zhou , Song Han

This tutorial provides an in-depth guide on inference-time guidance and alignment methods for optimizing downstream reward functions in diffusion models. While diffusion models are renowned for their generative modeling capabilities,…

人工智能 · 计算机科学 2025-01-22 Masatoshi Uehara , Yulai Zhao , Chenyu Wang , Xiner Li , Aviv Regev , Sergey Levine , Tommaso Biancalani

Focus is a cornerstone of photography, yet autofocus systems often fail to capture the intended subject, and users frequently wish to adjust focus after capture. We introduce a novel method for realistic post-capture refocusing using video…

计算机视觉与模式识别 · 计算机科学 2025-12-30 SaiKiran Tedla , Zhoutong Zhang , Xuaner Zhang , Shumian Xin

Recent text-driven motion generation methods span both discrete token-based approaches and continuous-latent formulations. MotionGPT3 exemplifies the latter paradigm, combining a learned continuous motion latent space with a diffusion-based…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Jaymin Ban , JiHong Jeon , SangYeop Jeong

The diffusion-based text-to-image model harbors immense potential in transferring reference style. However, current encoder-based approaches significantly impair the text controllability of text-to-image models while transferring styles. In…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Tianhao Qi , Shancheng Fang , Yanze Wu , Hongtao Xie , Jiawei Liu , Lang Chen , Qian He , Yongdong Zhang

Large-scale text-guided image diffusion models have shown astonishing results in text-to-image (T2I) generation. However, applying these models to synthesize textures for 3D geometries remains challenging due to the domain gap between 2D…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Jiawei Lu , Yingpeng Zhang , Zengjun Zhao , He Wang , Kun Zhou , Tianjia Shao

Scaling video diffusion transformers is fundamentally bottlenecked by two compounding costs: the expensive quadratic complexity of attention per step, and the iterative sampling steps. In this work, we propose EFlow, an efficient few-step…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Dogyun Park , Yanyu Li , Sergey Tulyakov , Anil Kag