English
Related papers

Related papers: Uniform Approximations for Randomized Hadamard Tra…

200 papers

Random features have been introduced to scale up kernel methods via randomization techniques. In particular, random Fourier features and orthogonal random features were used to approximate the popular Gaussian kernel. Random Fourier…

Machine Learning · Computer Science 2024-10-22 Nizar Demni , Hachem Kadri

Approximation using Fourier features is a popular technique for scaling kernel methods to large-scale problems, with myriad applications in machine learning and statistics. This method replaces the integral representation of a…

Machine Learning · Statistics 2024-08-26 Ayoub Belhadji , Qianyu Julie Zhu , Youssef Marzouk

We present a tight parametrical Hermite-Hadamard type inequality with probability measure, which yields a considerably closer upper bound for the mean value of convex function than the classical one. Our inequality becomes equality not only…

Classical Analysis and ODEs · Mathematics 2020-04-17 Milan Merkle , Zoran D. Mitrović

Existing convergence of distributed optimization methods in non-Euclidean geometries typically rely on kernel assumptions: (i) global Lipschitz smoothness and (ii) bi-convexity of the associated Bregman divergence function. Unfortunately,…

Optimization and Control · Mathematics 2026-03-16 Junwen Qiu , Ziyang Zeng , Leilei Mei , Junyu Zhang

A new transform over finite fields, the finite field Hartley transform (FFHT), was recently introduced and a number of promising applications on the design of efficient multiple access systems and multilevel spread spectrum sequences were…

Numerical Analysis · Computer Science 2015-02-06 H. M. de Oliveira , R. G. F. Távora , R. J. Cintra , R. M. Campello de Souza

Random feature neural network approximations of the potential in Hamiltonian systems yield approximations of molecular dynamics correlation observables that have the expected error $\mathcal{O}\big((K^{-1}+J^{-1/2})^{\frac{1}{2}}\big)$, for…

Numerical Analysis · Mathematics 2024-06-24 Xin Huang , Petr Plechac , Mattias Sandberg , Anders Szepessy

In this paper, we take a step towards developing efficient hard thresholding methods for low-rank tensor recovery from memory-efficient linear measurements with tensorial structure. Theoretical guarantees for many standard iterative…

Numerical Analysis · Mathematics 2025-02-06 Shambhavi Suryanarayanan , Elizaveta Rebrova

We investigate an algorithm named histogram transform ensembles (HTE) density estimator whose effectiveness is supported by both solid theoretical analysis and significant experimental performance. On the theoretical side, by decomposing…

Statistics Theory · Mathematics 2019-11-27 Hanyuan Hang

Many practical problems need the output of a machine learning model to satisfy a set of constraints, $K$. Nevertheless, there is no known guarantee that classical neural network architectures can exactly encode constraints while…

Machine Learning · Computer Science 2022-02-10 Anastasis Kratsios , Behnoosh Zamanlooy , Tianlin Liu , Ivan Dokmanić

We consider the problem of efficiently approximating and encoding high-dimensional data sampled from a probability distribution $\rho$ in $\mathbb{R}^D$, that is nearly supported on a $d$-dimensional set $\mathcal{M}$ - for example…

Machine Learning · Statistics 2017-07-19 Wenjing Liao , Mauro Maggioni

Generalized matrix approximation plays a fundamental role in many machine learning problems, such as CUR decomposition, kernel approximation, and matrix low rank approximation. Especially with today's applications involved in larger and…

Numerical Analysis · Computer Science 2016-09-09 Haishan Ye , Qiaoming Ye , Zhihua Zhang

Consider the case that we observe $n$ independent and identically distributed copies of a random variable with a probability distribution known to be an element of a specified statistical model. We are interested in estimating an infinite…

Statistics Theory · Mathematics 2017-09-20 Mark J. van der Laan , Aurélien F. Bibaut

Modern scientific instruments produce vast amounts of data, which can overwhelm the processing ability of computer systems. Lossy compression of data is an intriguing solution, but comes with its own drawbacks, such as potential signal…

Approximation of scattered data is often a task in many engineering problems. The Radial Basis Function (RBF) approximation is appropriate for large scattered (unordered) datasets in d-dimensional space. This approach is useful for a higher…

Numerical Analysis · Computer Science 2018-06-21 Zuzana Majdisova , Vaclav Skala

We extend our work for compression of currents and varifolds to a compression algorithm for the embedded normal cycles representation of shape, restricted to the constant normal kernel case, using the Nystrom approximation in Reproducing…

Numerical Analysis · Mathematics 2026-05-26 Allen Paul , Neill Campbell , Tony Shardlow

In this article we consider the graph alignment problem from the perspective of high-dimensional statistics: we aim to estimate an unknown permutation $\pi^*$ from the observation of two correlated random adjacency matrices $A_1$, $A_2$. We…

Probability · Mathematics 2025-10-30 Laurent Massoulié

A reproducing kernel can define an embedding of a data point into an infinite dimensional reproducing kernel Hilbert space (RKHS). The norm in this space describes a distance, which we call the kernel distance. The random Fourier features…

Machine Learning · Computer Science 2026-03-24 Di Chen , Jeff M. Phillips

Recently, experiments have been reported where researchers were able to perform high dynamic range (HDR) tomography in a heuristic fashion, by fusing multiple tomographic projections. This approach to HDR tomography has been inspired by HDR…

Information Theory · Computer Science 2021-05-11 Matthias Beckmann , Ayush Bhandari , Felix Krahmer

Quantum machine learning models are designed for performing learning tasks. Some quantum classifier models are proposed to assign classes of inputs based on fidelity measurements. Quantum Hadamard test is a well-known quantum algorithm for…

Quantum Physics · Physics 2025-08-07 Vivek Mehta , Arghya Choudhury , Utpal Roy

Pseudo-hermitian matrices are matrices hermitian with respect to an indefinite metric. They can be thought of as the truncation of pseudo-hermitian operators, defined over some Krein space, together with the associated metric, to a finite…

Mathematical Physics · Physics 2022-02-03 Joshua Feinberg , Roman Riser