English
Related papers

Related papers: VASR: Variance-Aware Systematic Resampling for Rew…

200 papers

Sequential Monte Carlo (SMC) methods represent a classical set of techniques to simulate a sequence of probability measures through a simple selection/mutation mechanism. However, the associated selection functions and mutation kernels…

Statistics Theory · Mathematics 2021-02-16 Qiming Du , Arnaud Guyader

In this article we develop a new sequential Monte Carlo (SMC) method for multilevel (ML) Monte Carlo estimation. In particular, the method can be used to estimate expectations with respect to a target probability distribution over an…

Computation · Statistics 2017-03-16 Alexandros Beskos , Ajay Jasra , Kody Law , Youssef Marzouk , Yan Zhou

We describe and analyze a variance reduction approach for Monte Carlo (MC) sampling that accelerates the estimation of statistics of computationally expensive simulation models using an ensemble of models with lower cost. These lower cost…

Computation · Statistics 2021-05-04 Alex A. Gorodetsky , Gianluca Geraci , Mike Eldred , John D. Jakeman

Text-to-3D generation based on score distillation of pre-trained 2D diffusion models has gained increasing interest, with variational score distillation (VSD) as a remarkable example. VSD proves that vanilla score distillation can be…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yu Lei , Bingde Liu , Qingsong Xie , Haonan Lu , Zhijie Deng

The iterative and stochastic nature of diffusion models enables test-time scaling, whereby spending additional compute during denoising generates higher-fidelity samples. Increasing the number of denoising steps is the primary scaling axis,…

Machine Learning · Computer Science 2025-09-09 Vignav Ramesh , Morteza Mardani

Diffusion-based text-to-video (T2V) models have achieved significant success but continue to be hampered by the slow sampling speed of their iterative sampling processes. To address the challenge, consistency models have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Jiachen Li , Weixi Feng , Tsu-Jui Fu , Xinyi Wang , Sugato Basu , Wenhu Chen , William Yang Wang

Reinforcement learning (RL) with continuous time and state/action spaces is often data-intensive and brittle under nuisance variability and shift, motivating methods that exploit value-preserving structures to stabilize and improve…

Machine Learning · Computer Science 2026-05-08 Zuyuan Zhang , Fei Xu Yu , Tian Lan

History-dependent sampling can reduce long-run Monte Carlo variance by discouraging redundant revisits, but existing schemes typically encode history through empirical measure on finite state spaces, which is infeasible in high-dimensional…

Machine Learning · Computer Science 2026-05-26 Jie Hu , Lingyun Chen , Geeho Kim , Jinyoung Choi , Bohyung Han , Do Young Eun

Video super-resolution (VSR) seeks to reconstruct high-resolution frames from low-resolution inputs. While diffusion-based methods have substantially improved perceptual quality, extending them to video remains challenging for two reasons:…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Jintong Hu , Bin Chen , Zhenyu Hu , Jiayue Liu , Guo Wang , Lu Qi

In the last decade, sequential Monte-Carlo methods (SMC) emerged as a key tool in computational statistics. These algorithms approximate a sequence of distributions by a sequence of weighted empirical measures associated to a weighted…

Statistics Theory · Mathematics 2007-06-13 R. Douc , France E. Moulines

Schr\"odinger bridge (SB) has emerged as the go-to method for optimizing transportation plans in diffusion models. However, SB requires estimating the intractable forward score functions, inevitably resulting in the costly implicit training…

Machine Learning · Computer Science 2025-05-27 Wei Deng , Weijian Luo , Yixin Tan , Marin Biloš , Yu Chen , Yuriy Nevmyvaka , Ricky T. Q. Chen

We introduce $\Psi$-Sampler, an SMC-based framework incorporating pCNL-based initial particle sampling for effective inference-time reward alignment with a score-based generative model. Inference-time reward alignment with score-based…

Machine Learning · Computer Science 2025-10-28 Taehoon Yoon , Yunhong Min , Kyeongmin Yeo , Minhyuk Sung

Pre-trained text-to-image (T2I) diffusion models have shown strong potential for real-world image super-resolution (Real-ISR), owing to their noise-started generation process that enables realistic texture synthesis and captures the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Wei Zhu , Kai Zhang , Yu Zheng , Lei Luo , Yong Guo , Jian Yang

Generative priors of large-scale text-to-image diffusion models enable a wide range of new generation and editing applications on diverse visual modalities. However, when adapting these priors to complex visual modalities, often represented…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Subin Kim , Kyungmin Lee , June Suk Choi , Jongheon Jeong , Kihyuk Sohn , Jinwoo Shin

Reinforcement learning with verifiable rewards (RLVR) has emerged as an effective post-training paradigm for improving the reasoning capabilities of large language models. However, existing group-based RLVR methods often suffer from severe…

Machine Learning · Computer Science 2026-05-26 Haechan Kim , Soohyun Ryu , Gyouk Chu , Doohyuk Jang , Eunho Yang

Fine-grained visual reasoning remains a core challenge for multimodal large language models (MLLMs). The recently introduced ReasonMap highlights this gap by showing that even advanced MLLMs struggle with spatial reasoning in structured and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Sicheng Feng , Kaiwen Tuo , Song Wang , Lingdong Kong , Jianke Zhu , Huan Wang

Many machine learning problems involve Monte Carlo gradient estimators. As a prominent example, we focus on Monte Carlo variational inference (MCVI) in this paper. The performance of MCVI crucially depends on the variance of its stochastic…

Machine Learning · Statistics 2018-07-05 Alexander Buchholz , Florian Wenzel , Stephan Mandt

In this paper we tackle Image Super Resolution (ISR), using recent advances in Visual Auto-Regressive (VAR) modeling. VAR iteratively estimates the residual in latent space between gradually increasing image scales, a process referred to as…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Enrique Sanchez , Isma Hadji , Adrian Bulat , Christos Tzelepis , Brais Martinez , Georgios Tzimiropoulos

Recent advances in volumetric super-resolution (SR) have demonstrated strong performance in medical and scientific imaging, with transformer- and CNN-based approaches achieving impressive results even at extreme scaling factors. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 August Leander Høeg , Sophia Wiinberg Bardenfleth , Hans Martin Kjer , Tim Bjørn Dyrby , Vedrana Andersen Dahl , Anders Bjorholm Dahl

It has been established that diverse behaviors spanning the controllable subspace of an Markov decision process can be trained by rewarding a policy for being distinguishable from other policies \citep{gregor2016variational,…

Machine Learning · Computer Science 2020-01-28 Steven Hansen , Will Dabney , Andre Barreto , Tom Van de Wiele , David Warde-Farley , Volodymyr Mnih