English
Related papers

Related papers: Adaptive Moments are Surprisingly Effective for Pl…

200 papers

Foundation models enable prompt-based classifiers for zero-shot and few-shot learning. Nonetheless, the conventional method of employing fixed prompts suffers from distributional shifts that negatively impact generalizability to unseen…

Machine Learning · Computer Science 2024-10-29 Yingjun Du , Gaowen Liu , Yuzhang Shang , Yuguang Yao , Ramana Kompella , Cees G. M. Snoek

Models of stochastic image deformation allow study of time-continuous stochastic effects transforming images by deforming the image domain. Applications include longitudinal medical image analysis with both population trends and random…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Alexander Christgau , Alexis Arnaudon , Stefan Sommer

The estimation of normalizing constants is a fundamental step in probabilistic model comparison. Sequential Monte Carlo methods may be used for this task and have the advantage of being inherently parallelizable. However, the standard…

Machine Learning · Statistics 2016-08-16 Marco Fraccaro , Ulrich Paquet , Ole Winther

Diffusion models have shown significant progress in image translation tasks recently. However, due to their stochastic nature, there's often a trade-off between style transformation and content preservation. Current strategies aim to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Gihyun Kwon , Jong Chul Ye

The motivation for this paper stems from the desire to develop an adaptive sampling method for solving constrained optimization problems in which the objective function is stochastic and the constraints are deterministic. The method…

Optimization and Control · Mathematics 2021-01-01 Yuchen Xie , Raghu Bollapragada , Richard Byrd , Jorge Nocedal

Masked diffusion models have shown promising performance in generating high-quality samples in a wide range of domains, but accelerating their sampling process remains relatively underexplored. To investigate efficient samplers for masked…

Machine Learning · Computer Science 2026-04-23 Satoshi Hayakawa , Yuhta Takida , Masaaki Imaizumi , Hiromi Wakaki , Yuki Mitsufuji

Video generation has recently emerged as a central task in the field of generative AI. However, the substantial computational cost inherent in video synthesis makes model distillation a critical technique for efficient deployment. Despite…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yuyang You , Yongzhi Li , Jiahui Li , Yadong Mu , Quan Chen , Peng Jiang

Probability density estimation is a core problem of statistics and signal processing. Moment methods are an important means of density estimation, but they are generally strongly dependent on the choice of feasible functions, which severely…

Machine Learning · Statistics 2023-07-06 Guangyu Wu , Anders Lindquist

This paper considers sequential adaptive estimation of sparse signals under a constraint on the total sensing effort. The advantage of adaptivity in this context is the ability to focus more resources on regions of space where signal…

Methodology · Statistics 2013-04-03 Dennis Wei , Alfred O. Hero

In this work, an adaptive predictive control scheme for linear systems with unknown parameters and bounded additive disturbances is proposed. In contrast to related adaptive control approaches that robustly consider the parametric…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Johannes Teutsch , Christopher Narr , Sebastian Kerz , Dirk Wollherr , Marion Leibold

Denoising diffusion models have become ubiquitous for generative modeling. The core idea is to transport the data distribution to a Gaussian by using a diffusion. Approximate samples from the data distribution are then obtained by…

Diffusion models offer stable training and state-of-the-art performance for deep generative modeling tasks. Here, we consider their use in the context of multivariate subsurface modeling and probabilistic inversion. We first demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Roberto Miele , Niklas Linde

Score-based diffusion models are a highly effective method for generating samples from a distribution of images. We consider scenarios where the training data comes from a noisy version of the target distribution, and present an efficiently…

Machine Learning · Statistics 2025-09-30 Dennis Elbrächter , Giovanni S. Alberti , Matteo Santacesaria

In the first part of this paper, we consider a family of continuous-time dynamical systems coupled with diffusion-transmutation processes. Under certain conditions, such randomly perturbed dynamical systems can be interpreted as an averaged…

Optimization and Control · Mathematics 2024-08-21 Getachew K. Befekadu

Conditional diffusion models rely on language-to-image alignment methods to steer the generation towards semantically accurate outputs. Despite the success of this architecture, misalignment and hallucinations remain common issues and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Vasco Ramos , Regev Cohen , Idan Szpektor , Joao Magalhaes

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines

We propose an adaptive proximal gradient method for minimizing the sum of two functions, where one is a simple convex function, and the other belongs to one of the three classes: nonconvex smooth, convex nonsmooth, or convex smooth. The key…

Optimization and Control · Mathematics 2026-05-08 Zimeng Wang , Alp Yurtsever

New classes of sounds constantly emerge with a few samples, making it challenging for models to adapt to dynamic acoustic environments. This challenge motivates us to address the new problem of few-shot class-incremental audio…

Sound · Computer Science 2023-05-30 Wei Xie , Yanxiong Li , Qianhua He , Wenchang Cao , Tuomas Virtanen

Temporally consistent video-to-video generation is critical for applications such as style transfer and upsampling. In this paper, we provide a theoretical analysis of warped noise - a recently proposed technique for training video…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Chao Liu , Arash Vahdat

Diffusion generative models unlock new possibilities for inverse problems as they allow for the incorporation of strong empirical priors in scientific inference. Recently, diffusion models are repurposed for solving inverse problems using…