English
Related papers

Related papers: Scaling Image and Video Generation via Test-Time E…

200 papers

Test-time scaling (TTS) has proven effective in enhancing the reasoning capabilities of large language models (LLMs). Verification plays a key role in TTS, simultaneously influencing (1) reasoning performance and (2) compute efficiency, due…

Artificial Intelligence · Computer Science 2025-10-31 Hao Mark Chen , Guanxi Lu , Yasuyuki Okoshi , Zhiwen Mo , Masato Motomura , Hongxiang Fan

While inference-time scaling through search has revolutionized Large Language Models, translating these gains to image generation has proven difficult. Recent attempts to apply search strategies to continuous diffusion models show limited…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Erik Riise , Mehmet Onurcan Kaya , Dim P. Papadopoulos

This tutorial provides an in-depth guide on inference-time guidance and alignment methods for optimizing downstream reward functions in diffusion models. While diffusion models are renowned for their generative modeling capabilities,…

Artificial Intelligence · Computer Science 2025-01-22 Masatoshi Uehara , Yulai Zhao , Chenyu Wang , Xiner Li , Aviv Regev , Sergey Levine , Tommaso Biancalani

Distilled autoregressive diffusion models facilitate real-time short video synthesis but suffer from severe error accumulation during long-sequence generation. While existing Test-Time Optimization (TTO) methods prove effective for images…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xunzhi Xiang , Zixuan Duan , Guiyu Zhang , Haiyu Zhang , Zhe Gao , Junta Wu , Shaofeng Zhang , Tengfei Wang , Qi Fan , Chunchao Guo

Test-time scaling (TTS) has demonstrated remarkable success in enhancing large language models, yet its application to next-token prediction (NTP) autoregressive (AR) image generation remains largely uncharted. Existing TTS approaches for…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Harold Haodong Chen , Xianfeng Wu , Wen-Jie Shu , Rongjin Guo , Disen Lan , Harry Yang , Ying-Cong Chen

Large Language Model (LLM) agents can increasingly automate complex reasoning through Test-Time Scaling (TTS), iterative refinement guided by reward signals. However, many real-world tasks involve multi-stage pipeline whose final outcomes…

Machine Learning · Computer Science 2025-12-30 Shuyu Gan , James Mooney , Pan Hao , Renxiang Wang , Mingyi Hong , Qianwen Wang , Dongyeop Kang

Diffusion models have gained attention for their success in modeling complex distributions, achieving impressive perceptual quality in SR tasks. However, existing diffusion-based SR methods often suffer from high computational costs,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Rui Qin , Qijie Wang , Ming Sun , Haowei Zhu , Chao Zhou , Bin Wang

Test-Time Scaling (TTS) improves the reasoning performance of Large Language Models (LLMs) by allocating additional compute during inference. We conduct a structured survey of TTS methods and categorize them into sampling-based,…

Computation and Language · Computer Science 2025-06-06 Ho-Lam Chung , Teng-Yun Hsiao , Hsiao-Ying Huang , Chunerh Cho , Jian-Ren Lin , Zhang Ziwei , Yun-Nung Chen

Large denoising diffusion models, such as Stable Diffusion, have been trained on billions of image-caption pairs to perform text-conditioned image generation. As a byproduct of this training, these models have acquired general knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Alexandros Graikos , Nebojsa Jojic , Dimitris Samaras

The advancements in generative modeling, particularly the advent of diffusion models, have sparked a fundamental question: how can these models be effectively used for discriminative tasks? In this work, we find that generative models can…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Mihir Prabhudesai , Tsung-Wei Ke , Alexander C. Li , Deepak Pathak , Katerina Fragkiadaki

Despite advances in reinforcement learning (RL)-based video reasoning with large language models (LLMs), data collection and fine-tuning remain significant challenges. These methods often rely on large-scale supervised fine-tuning (SFT)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Ziyang Wang , Jaehong Yoon , Shoubin Yu , Md Mohaiminul Islam , Gedas Bertasius , Mohit Bansal

We introduce EvoFlows, a variable-length protein sequence-to-sequence modeling approach designed for protein engineering. Existing protein language models are poorly suited for optimization tasks: autoregressive models require full sequence…

Machine Learning · Computer Science 2026-04-09 Nicolas Deutschmann , Constance Ferragu , Jonathan D. Ziegler , Shayan Aziznejad , Eli Bixby

To fully leverage the capabilities of diffusion models, we are often interested in optimizing downstream reward functions during inference. While numerous algorithms for reward-guided generation have been recently proposed due to their…

Machine Learning · Computer Science 2025-04-18 Masatoshi Uehara , Xingyu Su , Yulai Zhao , Xiner Li , Aviv Regev , Shuiwang Ji , Sergey Levine , Tommaso Biancalani

Recent advances in 3D Gaussian diffusion models suffer from time-intensive denoising and post-denoising processing due to the massive number of Gaussian primitives, resulting in slow generation and limited scalability along sampling…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeyuan Yin , Xiaoming Liu

A common recipe to improve diffusion models at test-time so that samples score highly against a user-specified reward is to introduce the gradient of the reward into the dynamics of the diffusion itself. This procedure is often ill posed,…

Text-conditioned image generation models have recently shown immense qualitative success using denoising diffusion processes. However, unlike discriminative vision-and-language models, it is a non-trivial task to subject these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Benno Krojer , Elinor Poole-Dayan , Vikram Voleti , Christopher Pal , Siva Reddy

Text spotting, a task involving the extraction of textual information from image or video sequences, faces challenges in cross-domain adaption, such as image-to-image and image-to-video generalization. In this paper, we introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yuliang Liu , Mingxin Huang , Hao Yan , Linger Deng , Weijia Wu , Hao Lu , Chunhua Shen , Lianwen Jin , Xiang Bai

Recent text-to-image diffusion models achieve impressive visual quality through extensive scaling of training data and model parameters, yet they often struggle with complex scenes and fine-grained details. Inspired by the self-reflection…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Le Zhuo , Liangbing Zhao , Sayak Paul , Yue Liao , Renrui Zhang , Yi Xin , Peng Gao , Mohamed Elhoseiny , Hongsheng Li

Graph generation is a fundamental problem in graph learning with broad applications across Web-scale systems, knowledge graphs, and scientific domains such as drug and material discovery. Recent approaches leverage diffusion models for…

Machine Learning · Computer Science 2026-03-18 Jiachi Zhao , Zehong Wang , Yamei Liao , Chuxu Zhang , Yanfang Ye

Training robots in simulation requires diverse 3D scenes that reflect the specific challenges of downstream tasks. However, scenes that satisfy strict task requirements, such as high-clutter environments with plausible spatial arrangement,…

Robotics · Computer Science 2025-08-27 Nicholas Pfaff , Hongkai Dai , Sergey Zakharov , Shun Iwase , Russ Tedrake