English
Related papers

Related papers: On the Randomization of Frolov's Algorithm for Mul…

200 papers

We prove that a variant of the classical Sobolev space of first-order dominating mixed smoothness is equivalent (under a certain condition) to the unanchored ANOVA space on $\mathbb{R}^d$, for $d \geq 1$. Both spaces are Hilbert spaces…

Numerical Analysis · Mathematics 2021-11-30 Alexander D. Gilbert , Frances Y. Kuo , Ian H. Sloan

We develop a novel unified randomized block-coordinate primal-dual algorithm to solve a class of nonsmooth constrained convex optimization problems, which covers different existing variants and model settings from the literature. We prove…

Optimization and Control · Mathematics 2021-10-29 Quoc Tran-Dinh , Deyi Liu

Random smoothing data augmentation is a unique form of regularization that can prevent overfitting by introducing noise to the input data, encouraging the model to learn more generalized features. Despite its success in various…

Machine Learning · Statistics 2023-05-15 Liang Ding , Tianyang Hu , Jiahang Jiang , Donghao Li , Wenjia Wang , Yuan Yao

We present a simple universal algorithm for high-dimensional integration which has the optimal error rate (independent of the dimension) in all weighted Korobov classes both in the randomized and the deterministic setting. Our theoretical…

Numerical Analysis · Mathematics 2024-12-02 Takashi Goda , David Krieg

This paper studies numerical integration over the unit sphere $ \mathbb{S}^2 \subset \mathbb{R}^{3} $ by using spherical $t$-design, which is an equal positive weights quadrature rule with polynomial precision $t$. We investigate two kinds…

Numerical Analysis · Mathematics 2016-11-10 Congpei An , Siyong Chen

The manifold hypothesis suggests that the generalization performance of machine learning methods improves significantly when the intrinsic dimension of the input distribution's support is low. In the context of KRR, we investigate two…

Machine Learning · Computer Science 2026-01-23 Rustem Takhanov

In this work, we present an algorithmically tractable safe approximation of distributionally robust optimization (DRO) problems that contain univariate indicator functions. The latter appear in different applications, but render the model…

Optimization and Control · Mathematics 2026-01-22 Jana Dienstbier , Frauke Liers , Florian Rösel , Jan Rolfes

We introduce a novel class of algorithms to efficiently approximate the unknown return distributions in policy evaluation problems from distributional reinforcement learning (DRL). The proposed distributional dynamic programming algorithms…

Machine Learning · Statistics 2024-07-22 Julian Gerstenberg , Ralph Neininger , Denis Spiegel

We present randomized algorithms based on block Krylov space method for estimating the trace and log-determinant of Hermitian positive semi-definite matrices. Using the properties of Chebyshev polynomial and Gaussian random matrix, we…

Numerical Analysis · Mathematics 2020-03-03 Hanyu Li , Yuanyang Zhu

This paper considers stochastic-constrained stochastic optimization where the stochastic constraint is to satisfy that the expectation of a random function is below a certain threshold. In particular, we study the setting where data samples…

Optimization and Control · Mathematics 2026-01-27 Yeongjong Kim , Dabeen Lee

We investigate the numerical approximation of integrals over $\mathbb{R}^d$ equipped with the standard Gaussian measure $\gamma$ for integrands belonging to the Gaussian-weighted Sobolev spaces $W^\alpha_p(\mathbb{R}^d, \gamma)$ of mixed…

Numerical Analysis · Mathematics 2023-06-21 Dinh Dũng , Van Kien Nguyen

The spectral risk has wide applications in machine learning, especially in real-world decision-making, where people are not only concerned with models' average performance. By assigning different weights to the losses of different sample…

Optimization and Control · Mathematics 2024-07-23 Yuze Ge , Rujun Jiang

We propose and analyse randomized cubature formulae for the numerical integration of functions with respect to a given probability measure $\mu$ defined on a domain $\Gamma \subseteq \mathbb{R}^d$, in any dimension $d$. Each cubature…

Numerical Analysis · Mathematics 2020-12-04 Giovanni Migliorati , Fabio Nobile

In this article we present applications of smooth numbers to the unconditional derandomization of some well-known integer factoring algorithms. We begin with Pollard's $p-1$ algorithm, which finds in random polynomial time the prime…

Number Theory · Mathematics 2009-05-12 Bartosz Zralek

In this work, we consider the distributed optimization of non-smooth convex functions using a network of computing units. We investigate this problem under two regularity assumptions: (1) the Lipschitz continuity of the global objective…

Optimization and Control · Mathematics 2018-06-04 Kevin Scaman , Francis Bach , Sébastien Bubeck , Yin Tat Lee , Laurent Massoulié

In this paper, we consider distributed optimization problems where $n$ agents, each possessing a local cost function, collaboratively minimize the average of the local cost functions over a connected network. To solve the problem, we…

Optimization and Control · Mathematics 2023-03-24 Kun Huang , Xiao Li , Andre Milzarek , Shi Pu , Junwen Qiu

Sobolev embeddings, of arbitrary order, are considered into function spaces on domains of $\mathbb R^n$ endowed with measures whose decay on balls is dominated by a power $d$ of their radius. Norms in arbitrary rearrangement-invariant…

Functional Analysis · Mathematics 2019-12-10 Andrea Cianchi , Luboš Pick , Lenka Slavíková

Krylov methods rely on iterated matrix-vector products $A^k u_j$ for an $n\times n$ matrix $A$ and vectors $u_1,\ldots,u_m$. The space spanned by all iterates $A^k u_j$ admits a particular basis -- the \emph{maximal Krylov basis} -- which…

Symbolic Computation · Computer Science 2024-08-21 Vincent Neiger , Clément Pernet , Gilles Villard

Strong approximation errors of both finite element semi-discretization and spatio-temporal full discretization are analyzed for the stochastic Allen-Cahn equation driven by additive noise in space dimension $d \leq 3$. The full…

Numerical Analysis · Mathematics 2020-08-04 Ruisheng Qi , Xiaojie Wang

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach