English
Related papers

Related papers: Fast high-dimensional node generation with variabl…

200 papers

Dynamic Programming (DP) suffers from the well-known ``curse of dimensionality'', further exacerbated by the need to compute expectations over process noise in stochastic models. This paper presents a Monte Carlo-based sampling approach for…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Mohammad S. Ramadan , Ahmad Al-Tawaha , Mohamed Shouman , Ahmed Atallah , Ming Jin

Sampling from multimodal distributions is a challenging task in scientific computing. When a distribution has an exact symmetry between the modes, direct jumps among them can accelerate the samplings significantly. However, the…

Numerical Analysis · Mathematics 2024-01-05 Lexing Ying

Analyzing high-dimensional data with manifold learning algorithms often requires searching for the nearest neighbors of all observations. This presents a computational bottleneck in statistical manifold learning when observations of…

Machine Learning · Computer Science 2022-03-11 Fan Cheng , Anastasios Panagiotelis , Rob J Hyndman

We present a novel distributed computing framework that is robust to slow compute nodes, and is capable of both approximate and exact computation of linear operations. The proposed mechanism integrates the concepts of randomized sketching…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Burak Bartan , Mert Pilanci

A scaled Chebyshev node distribution is studied in this paper. It is proved that the node distribution is optimal for interpolation in $C_M^{s+1}[-1,1]$, the set of $(s+1)$-time differentiable functions whose $(s+1)$-th derivatives are…

Numerical Analysis · Mathematics 2013-05-28 N. S. Hoang

The HMC algorithm, combining the advantages of molecular dynamics and Monte-Carlo methods, is the most efficient algorithm to simulate QCD including the effects of sea quarks. In the standard approach momentum fields are generated with a…

High Energy Physics - Lattice · Physics 2012-12-18 Alberto Ramos

We present a novel computational framework for density control in high-dimensional state spaces. The considered dynamical system consists of a large number of indistinguishable agents whose behaviors can be collectively modeled as a…

Optimization and Control · Mathematics 2023-07-26 Shaojun Ma , Mengxue Hou , Xiaojing Ye , Haomin Zhou

This paper presents a novel way to approximate a distribution governing a system of coupled particles with a product of independent distributions. The approach is an extension of mean field theory that allows the independent distributions…

Statistical Mechanics · Physics 2007-05-23 David H. Wolpert

We present a Multi-Index Quasi-Monte Carlo method for the solution of elliptic partial differential equations with random coefficients. By combining the multi-index sampling idea with randomly shifted rank-1 lattice rules, the algorithm…

Numerical Analysis · Mathematics 2017-06-20 Pieterjan Robbe , Dirk Nuyens , Stefan Vandewalle

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

Statistical Mechanics · Physics 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan

Several issues in machine learning and inverse problems require to generate discrete data, as if sampled from a model probability distribution. A common way to do so relies on the construction of a uniform probability distribution over a…

Optimization and Control · Mathematics 2021-06-16 Quentin Merigot , Filippo Santambrogio , Clément Sarrazin

We construct deterministic particle solutions for linear and fast diffusion equations using a nonlocal approximation. We exploit the $2$-Wasserstein gradient flow structure of the equations in order to obtain the nonlocal approximating PDEs…

Analysis of PDEs · Mathematics 2024-08-06 José Antonio Carrillo , Antonio Esposito , Jakub Skrzeczkowski , Jeremy Sheung-Him Wu

Denoising diffusion probabilistic models and score-matching models have proven to be very powerful for generative tasks. While these approaches have also been applied to the generation of discrete graphs, they have, so far, relied on…

Machine Learning · Computer Science 2023-08-17 Kilian Konstantin Haefeli , Karolis Martinkus , Nathanaël Perraudin , Roger Wattenhofer

Estimating the density of a continuous random variable X has been studied extensively in statistics, in the setting where n independent observations of X are given a priori and one wishes to estimate the density from that. Popular methods…

Computation · Statistics 2021-09-09 Pierre L'Ecuyer , Florian Puchhammer

In this paper we present a novel approach towards variance reduction for discretised diffusion processes. The proposed approach involves specially constructed control variates and allows for a significant reduction in the variance for the…

Probability · Mathematics 2017-09-19 Denis Belomestny , Stefan Häfner , Tigran Nagapetyan , Mikhail Urusov

There is a rich literature on clustering functional data with applications to time-series modeling, trajectory data, and even spatio-temporal applications. However, existing methods routinely perform global clustering that enforces…

Methodology · Statistics 2024-12-16 Tsung-Hung Yao , Suprateek Kundu

This paper proposes an algorithm to generate random numbers from any member of the truncated multivariate elliptical family of distributions with a strictly decreasing density generating function. Based on Neal (2003) and Ho et al. (2012),…

Computation · Statistics 2021-12-20 Katherine A. L. Valeriano , Christian E. Galarza , Larissa A. Matos

This paper proposes a nonmonotone proximal quasi-Newton algorithm for unconstrained convex multiobjective composite optimization problems. To design the search direction, we minimize the max-scalarization of the variations of the Hessian…

Optimization and Control · Mathematics 2023-10-04 Xiaoxue Jiang

The local Universe provides a unique opportunity for testing cosmology and theories of structure formation. To facilitate this opportunity we present a new method for the reconstruction of the quasi-linear matter density and velocity fields…

Cosmology and Nongalactic Astrophysics · Physics 2018-07-11 Yehuda Hoffman , Edoardo Carlesi , Daniel Pomarède , Hélène M. Courtois , Stefan Gottlöber , Noam I. Libeskind , Jenny G. Sorce , Gustavo Yepes

The discrete nature of transmitted symbols poses challenges for achieving optimal detection in multiple-input multiple-output (MIMO) systems associated with a large number of antennas. Recently, the combination of two powerful machine…

Signal Processing · Electrical Eng. & Systems 2024-12-11 Xingyu Zhou , Le Liang , Jing Zhang , Chao-Kai Wen , Shi Jin