English
Related papers

Related papers: Integration with an Adaptive Harmonic Mean Algorit…

200 papers

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

In this paper, we introduce a new approach for integrating score-based models with the Metropolis-Hastings algorithm. While traditional score-based diffusion models excel in accurately learning the score function from data points, they lack…

Machine Learning · Computer Science 2025-04-01 Ahmed Aloui , Ali Hasan , Juncheng Dong , Zihao Wu , Vahid Tarokh

Bayesian inference promises to ground and improve the performance of deep neural networks. It promises to be robust to overfitting, to simplify the training procedure and the space of hyperparameters, and to provide a calibrated measure of…

Machine Learning · Computer Science 2019-08-12 Jonathan Heek , Nal Kalchbrenner

This paper presents a new Bayesian model and algorithm for nonlinear unmixing of hyperspectral images. The model proposed represents the pixel reflectances as linear combinations of the endmembers, corrupted by nonlinear (with respect to…

Methodology · Statistics 2015-10-06 Yoann Altmann , Marcelo Pereyra , Stephen McLaughlin

Despite all the benefits of automated hyperparameter optimization (HPO), most modern HPO algorithms are black-boxes themselves. This makes it difficult to understand the decision process which leads to the selected configuration, reduces…

Machine Learning · Computer Science 2023-02-14 Julia Moosbauer , Giuseppe Casalicchio , Marius Lindauer , Bernd Bischl

The performance of Hamiltonian Monte Carlo simulations crucially depends on both the integration timestep and the number of integration steps. We present an adaptive general-purpose framework to automatically tune such parameters, based on…

Computational Physics · Physics 2025-12-10 Henrik Christiansen , Federico Errica , Francesco Alesiani

We consider an unconstrained continuous optimization problem where, in each iteration, gradient estimates may be arbitrarily corrupted with a probability greater than 1/2. Additionally, function value estimates may exhibit heavy-tailed…

Optimization and Control · Mathematics 2025-11-25 Katya Scheinberg , Miaolan Xie

A key goal in the design of probabilistic inference algorithms is identifying and exploiting properties of the distribution that make inference tractable. Lifted inference algorithms identify symmetry as a property that enables efficient…

Artificial Intelligence · Computer Science 2019-07-02 Steven Holtzen , Todd Millstein , Guy Van den Broeck

The interpretation of cosmological observables requires the use of increasingly sophisticated theoretical models. Since these models are becoming computationally very expensive and display non-trivial uncertainties, the use of standard…

Cosmology and Nongalactic Astrophysics · Physics 2020-10-14 Marcos Pellejero-Ibañez , Raul E. Angulo , Giovanni Aricó , Matteo Zennaro , Sergio Contreras , Jens Stücker

Hamiltonian Monte Carlo (HMC) is widely used for sampling from high dimensional target distributions with densities known up to proportionality. While HMC exhibits favorable scaling properties in high dimensions, it struggles with strongly…

Computation · Statistics 2025-07-30 Joonha Park

We study numerical integration of functions depending on an infinite number of variables. We provide lower error bounds for general deterministic linear algorithms and provide matching upper error bounds with the help of suitable multilevel…

Numerical Analysis · Mathematics 2021-02-09 Josef Dick , Michael Gnewuch

Practical systems often suffer from hardware impairments that already appear during signal generation. Despite the limiting effect of such input-noise impairments on signal processing systems, they are routinely ignored in the literature.…

Signal Processing · Electrical Eng. & Systems 2021-10-04 Ramina Ghods , Charles Jeon , Arian Maleki , Christoph Studer

This paper presents an unsupervised Bayesian algorithm for hyperspectral image unmixing accounting for endmember variability. The pixels are modeled by a linear combination of endmembers weighted by their corresponding abundances. However,…

Methodology · Statistics 2015-10-28 Abderrahim Halimi , Nicolas Dobigeon , Jean-Yves Tourneret

Many scientific and engineering problems require to perform Bayesian inferences in function spaces, in which the unknowns are of infinite dimension. In such problems, many standard Markov Chain Monte Carlo (MCMC) algorithms become arbitrary…

Numerical Analysis · Mathematics 2016-04-12 Zhe Feng , Jinglai Li

This paper proposes and analyzes fully data driven methods for inference about the mean function of a stochastic process from a sample of independent trajectories of the process, observed at discrete time points and corrupted by additive…

Methodology · Statistics 2009-05-20 F. Bunea , M. H. Wegkamp , A. E. Ivanescu

Several researchers have described two-part models with patient-specific stochastic processes for analysing longitudinal semicontinuous data. In theory, such models can offer greater flexibility than the standard two-part model with…

Applications · Statistics 2017-03-28 Sean Yiu , Brian Tom

Gaussian latent variable models are a key class of Bayesian hierarchical models with applications in many fields. Performing Bayesian inference on such models can be challenging as Markov chain Monte Carlo algorithms struggle with the…

Computation · Statistics 2020-11-09 Charles C. Margossian , Aki Vehtari , Daniel Simpson , Raj Agrawal

We address the problem of estimating a high-dimensional matrix from linear measurements, with a focus on designing optimal rank-adaptive algorithms. These algorithms infer the matrix by estimating its singular values and the corresponding…

Information Theory · Computer Science 2026-05-12 Frédéric Zheng , Yassir Jedra , Alexandre Proutiere

In recent years, various interacting particle samplers have been developed to sample from complex target distributions, such as those found in Bayesian inverse problems. These samplers are motivated by the mean-field limit perspective and…

Computation · Statistics 2023-12-22 Björn Sprungk , Simon Weissmann , Jakob Zech

We study the sample median of independently generated quasi-Monte Carlo estimators based on randomized digital nets and prove it approximates the target integral value at almost the optimal convergence rate for various function spaces. In…

Numerical Analysis · Mathematics 2025-02-21 Zexin Pan