English
Related papers

Related papers: An algorithm for variable density sampling with bl…

200 papers

The problem of sampling constrained continuous distributions has frequently appeared in many machine/statistical learning models. Many Monte Carlo Markov Chain (MCMC) sampling methods have been adapted to handle different types of…

Computation · Statistics 2023-02-21 Shiwei Lan , Lulu Kang

This paper focuses on multi-block optimization problems over transport polytopes, which underlie various applications including strongly correlated quantum physics and machine learning. Conventional block coordinate descent-type methods for…

Optimization and Control · Mathematics 2024-08-27 Yukuan Hu , Mengyu Li , Xin Liu , Cheng Meng

We develop a distributed algorithm for convex Empirical Risk Minimization, the problem of minimizing large but finite sum of convex functions over networks. The proposed algorithm is derived from directly discretizing the second-order…

Optimization and Control · Mathematics 2018-11-07 Jingzhao Zhang , César A. Uribe , Aryan Mokhtari , Ali Jadbabaie

Rejection Sampling is a fundamental Monte-Carlo method. It is used to sample from distributions admitting a probability density function which can be evaluated exactly at any given point, albeit at a high computational cost. However,…

Machine Learning · Statistics 2018-10-23 Juliette Achdou , Joseph C. Lam , Alexandra Carpentier , Gilles Blanchard

Being able to adequately process and combine data arising from different sites is crucial in neuroimaging, but is difficult, owing to site, sequence and acquisition-parameter dependent biases. It is important therefore to design algorithms…

Image and Video Processing · Electrical Eng. & Systems 2021-11-05 Pedro Borges , Richard Shaw , Thomas Varsavsky , Kerstin Klaser , David Thomas , Ivana Drobnjak , Sebastien Ourselin , M Jorge Cardoso

Decentralized optimization is critical for solving large-scale machine learning problems over distributed networks, where multiple nodes collaborate through local communication. In practice, the variances of stochastic gradient estimators…

Optimization and Control · Mathematics 2026-02-13 Hongxu Chen , Ke Wei , Luo Luo

Volumetry is one of the principal downstream applications of 3D medical image segmentation, for example, to detect abnormal tissue growth or for surgery planning. Conformal Prediction is a promising framework for uncertainty quantification,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Benjamin Lambert , Florence Forbes , Senan Doyle , Michel Dojat

The naive importance sampling (IS) estimator generally does not work well in examples involving simultaneous inference on several targets, as the importance weights can take arbitrarily large values, making the estimator highly unstable. In…

Methodology · Statistics 2022-04-20 Vivekananda Roy , Evangelos Evangelou

Efficient sampling of many-dimensional and multimodal density functions is a task of great interest in many research fields. We describe an algorithm that allows parallelizing inherently serial Markov chain Monte Carlo (MCMC) sampling by…

Computation · Statistics 2020-08-10 Vasyl Hafych , Philipp Eller , Oliver Schulz , Allen Caldwell

High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random-walk Metropolis algorithms. The assumptions under which weak convergence results are proved are however restrictive: the…

Methodology · Statistics 2022-02-16 Sebastian M Schmon , Philippe Gagnon

This work explores a novel perspective on solving nonconvex and nonsmooth optimization problems by leveraging sampling based methods. Instead of treating the objective function purely through traditional (often deterministic) optimization…

Optimization and Control · Mathematics 2025-05-21 Nahom Seyoum , Haoxiang You

This work presents a parallel variant of the algorithm introduced in [Acceleration of block coordinate descent methods with identification strategies Comput. Optim. Appl. 72(3):609--640, 2019] to minimize the sum of a partially separable…

Optimization and Control · Mathematics 2025-08-06 Ronaldo Lopes , Sandra A. Santos , Paulo J. S. Silva

Dealing with visualizations containing large data set is a challenging issue and, in the field of Information Visualization, almost every visual technique reveals its drawback when visualizing large number of items. To deal with this…

Graphics · Computer Science 2017-01-26 Enrico Bertini , Giuseppe Santucci

This paper addresses the problem of sampling from binary distributions with constraints. In particular, it proposes an MCMC method to draw samples from a distribution of the set of all states at a specified distance from some reference…

Computation · Statistics 2012-03-19 Firas Hamze , Nando de Freitas

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

Machine Learning · Statistics 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

Recently, deep learning methods have made a significant improvement in compressive sensing image reconstruction task. In the existing methods, the scene is measured block by block due to the high computational complexity. This results in…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Jiang Du , Xuemei Xie , Chenye Wang , Guangming Shi , Xun Xu , Yuxiang Wang

This paper introduces a practical sampling method for training surrogate models in the context of uncertainty propagation. We propose a heuristic method to uniformly draw samples within highest density regions of the density given by the…

Methodology · Statistics 2025-09-15 Jocelyn Minini , Micha Wasem

Dynamic Magnetic Resonance Imaging (MRI) is known to be a powerful and reliable technique for the dynamic imaging of internal organs and tissues, making it a leading diagnostic tool. A major difficulty in using MRI in this setting is the…

Image and Video Processing · Electrical Eng. & Systems 2023-03-24 Tamir Shor , Tomer Weiss , Dor Noti , Alex Bronstein

In this paper we analyze the randomized block-coordinate descent (RBCD) methods proposed in [8,11] for minimizing the sum of a smooth convex function and a block-separable convex function. In particular, we extend Nesterov's technique…

Optimization and Control · Mathematics 2013-05-22 Zhaosong Lu , Lin Xiao

We investigate fully self-consistent multiscale quantum-classical algorithms on current generation superconducting quantum computers, in a unified approach to tackle the correlated electronic structure of large systems in both quantum…