English
Related papers

Related papers: Dimension-Free Multimodal Sampling via Preconditio…

200 papers

Sampling of sharp posteriors in high dimensions is a challenging problem, especially when gradients of the likelihood are unavailable. In low to moderate dimensions, affine-invariant methods, a class of ensemble-based gradient-free methods,…

Methodology · Statistics 2022-02-23 Matthew M. Dunlop , Georg Stadler

In this paper, we provide new insights on the Unadjusted Langevin Algorithm. We show that this method can be formulated as a first order optimization algorithm of an objective functional defined on the Wasserstein space of order $2$. Using…

Computation · Statistics 2018-03-30 Alain Durmus , Szymon Majewski , Błażej Miasojedow

For multivariate co-generation in scientific applications, we advocate pairwise block rather than joint modeling of all variables. This design mitigates the computational burden and data imbalance. To this end, we propose an Annealed…

Machine Learning · Computer Science 2026-03-10 Hantao Zhang , Jieke Wu , Mingda Xu , Xiao Hu , Yingxuan You , Pascal Fua

We identify and analyze a surprising phenomenon of Latent Diffusion Models (LDMs) where the final steps of the diffusion can degrade sample quality. In contrast to conventional arguments that justify early stopping for numerical stability,…

Machine Learning · Statistics 2026-03-03 Yu-Han Wu , Quentin Berthet , Gérard Biau , Claire Boyer , Romuald Elie , Pierre Marion

Mean-field Langevin dynamics (MLFD) is a class of interacting particle methods that tackle convex optimization over probability measures on a manifold, which are scalable, versatile, and enjoy computational guarantees. However, some…

Optimization and Control · Mathematics 2025-01-03 Guillaume Wang , Alireza Mousavi-Hosseini , Lénaïc Chizat

We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm for learning adaptive policies that can be transferred between environments of varying dynamics, by imitating a small number of demonstrations collected from a single…

Machine Learning · Computer Science 2020-08-31 Yiren Lu , Jonathan Tompson

Sampling from log-concave distributions is a well researched problem that has many applications in statistics and machine learning. We study the distributions of the form $p^{*}\propto\exp(-f(x))$, where…

Machine Learning · Computer Science 2019-09-13 Ruoqi Shen , Yin Tat Lee

This paper introduces alternating-direction implicit (ADI) solvers of higher order of time-accuracy (orders two to six) for the compressible Navier-Stokes equations in two- and three-dimensional curvilinear domains. The higher-order…

Computational Physics · Physics 2018-01-11 Oscar Bruno , Max Cubillos

Active learning (AL) aims to improve model performance within a fixed labeling budget by choosing the most informative data points to label. Existing AL focuses on the single-domain setting, where all data come from the same domain (e.g.,…

Machine Learning · Computer Science 2024-02-12 Guang-Yuan Hao , Hengguan Huang , Haotian Wang , Jie Gao , Hao Wang

This work explores a novel perspective on solving nonconvex and nonsmooth optimization problems by leveraging sampling based methods. Instead of treating the objective function purely through traditional (often deterministic) optimization…

Optimization and Control · Mathematics 2025-05-21 Nahom Seyoum , Haoxiang You

In this paper we consider a new probability sampling methods based on Langevin diffusion dynamics to resolve the problem of existing Monte Carlo algorithms when draw samples from high dimensional target densities. We extent…

Machine Learning · Computer Science 2025-03-31 Z. Zarezadeh , N. Zarezadeh

Monte Carlo sampling for Bayesian posterior inference is a common approach used in machine learning. The Markov Chain Monte Carlo procedures that are used are often discrete-time analogues of associated stochastic differential equations…

Machine Learning · Statistics 2020-02-14 Xiaocheng Shang , Zhanxing Zhu , Benedict Leimkuhler , Amos J. Storkey

Deep learning-based sequence models are extensively employed in Time Series Anomaly Detection (TSAD) tasks due to their effective sequential modeling capabilities. However, the ability of TSAD is limited by two key challenges: (i) the…

Machine Learning · Computer Science 2024-08-21 Junqi Chen , Xu Tan , Sylwan Rahardja , Jiawei Yang , Susanto Rahardja

We develop a new method which extends Dynamic Mode Decomposition (DMD) to incorporate the effect of control to extract low-order models from high-dimensional, complex systems. DMD finds spatial-temporal coherent modes, connects local-linear…

Optimization and Control · Mathematics 2014-09-24 Joshua L. Proctor , Steven L. Brunton , J. Nathan Kutz

Deep learning models in medical imaging often encounter challenges when adapting to new clinical settings unseen during training. Test-time adaptation offers a promising approach to optimize models for these unseen domains, yet its…

Machine Learning · Computer Science 2024-10-28 Sameer Ambekar , Julia A. Schnabel , Cosmin I. Bercea

The core challenge in unsupervised anomaly detection is identifying abnormal patterns without prior knowledge of their characteristics. While existing methods have addressed aspects of this problem, they often struggle to learn a robust…

Machine Learning · Computer Science 2026-05-12 Prithul Sarker , Sushmita Sarker , Nicholas G. Murray , Alireza Tavakkoli

Unsupervised domain adaptation (UDA) provides a strategy for improving machine learning performance in data-rich (target) domains where ground truth labels are inaccessible but can be found in related (source) domains. In cases where…

Machine Learning · Computer Science 2023-07-24 Garrett Wilson , Janardhan Rao Doppa , Diane J. Cook

In the field of high-dimensional data analysis, modeling methods based on quantile loss function are highly regarded due to their ability to provide a comprehensive statistical perspective and effective handling of heterogeneous data. In…

Computation · Statistics 2025-01-14 Xiaofei Wu , Dingzi Guo , Rongmei Liang , Zhimin Zhang

Medical semi-supervised segmentation is a technique where a model is trained to segment objects of interest in medical images with limited annotated data. Existing semi-supervised segmentation methods are usually based on the smoothness…

Image and Video Processing · Electrical Eng. & Systems 2023-10-03 Thanh Nguyen-Duc , Trung Le , Roland Bammer , He Zhao , Jianfei Cai , Dinh Phung

This paper proposes and analyzes a dampened proximal alternating direction method of multipliers (DP.ADMM) for solving linearly-constrained nonconvex optimization problems where the smooth part of the objective function is nonseparable.…

Optimization and Control · Mathematics 2023-01-05 Weiwei Kong , Renato D. C. Monteiro
‹ Prev 1 8 9 10 Next ›