English
Related papers

Related papers: Fast Cross-validation in Harmonic Approximation

200 papers

Based on phase retrieval, lensless coherent imaging and in particular holography offers quantitative phase and amplitude images. This is of particular importance for spectral ranges where suitable lenses are challenging, such as for hard…

Image and Video Processing · Electrical Eng. & Systems 2022-09-01 Simon Huhn , Leon Merten Lohse , Jens Lucht , Tim Salditt

Cross-validation (CV) is one of the most popular tools for assessing and selecting predictive models. However, standard CV suffers from high computational cost when the number of folds is large. Recently, under the empirical risk…

Methodology · Statistics 2023-05-30 Yuetian Luo , Zhimei Ren , Rina Foygel Barber

Recently, a new polynomial basis over binary extension fields was proposed such that the fast Fourier transform (FFT) over such fields can be computed in the complexity of order $\mathcal{O}(n\lg(n))$, where $n$ is the number of points…

Information Theory · Computer Science 2016-08-16 Sian-Jheng Lin , Tareq Y. Al-Naffouri , Yunghsiang S. Han

We develop a fast and accurate method for 3D alignment, recovering the rotation and translation that best align a reference volume with a noisy observation. Classical matched filtering evaluates cross-correlation over a large discretized…

Signal Processing · Electrical Eng. & Systems 2026-03-17 Fabian Kruse , Valentin Debarnot , Vinith Kishore , Ivan Dokmanić

We present a novel and mathematically transparent approach to function approximation and the training of large, high-dimensional neural networks, based on the approximate least-squares solution of associated Fredholm integral equations of…

Numerical Analysis · Mathematics 2024-07-17 Patrick Gelß , Aizhan Issagali , Ralf Kornhuber

Recently, randomized algorithms for low-rank approximation of quaternion matrices have received increasing attention. However, for large-scale problems, existing quaternion orthonormalizations are inefficient, leading to slow rangefinders.…

Numerical Analysis · Mathematics 2024-06-19 Chao Chang , Yuning Yang

The present work aims at deriving theoretical guaranties on the behavior of some cross-validation procedures applied to the $k$-nearest neighbors ($k$NN) rule in the context of binary classification. Here we focus on the leave-$p$-out…

Statistics Theory · Mathematics 2017-10-13 Alain Celisse , Tristan Mary-Huard

In order to realize fault-tolerant quantum computation, tight evaluation of error threshold under practical noise models is essential. While non-Clifford noise is ubiquitous in experiments, the error threshold under non-Clifford noise…

Quantum Physics · Physics 2017-11-15 Yasunari Suzuki , Keisuke Fujii , Masato Koashi

This paper introduces a new strategy for setting the regularization parameter when solving large-scale discrete ill-posed linear problems by means of the Arnoldi-Tikhonov method. This new rule is essentially based on the discrepancy…

Numerical Analysis · Mathematics 2013-07-02 Silvia Gazzola , Paolo Novati , Maria Rosaria Russo

The problem of computing the Fourier Transform of a signal whose spectrum is dominated by a small number $k$ of frequencies quickly and using a small number of samples of the signal in time domain (the Sparse FFT problem) has received…

Data Structures and Algorithms · Computer Science 2017-08-18 Michael Kapralov

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

This paper introduces a fast algorithm, applicable throughout the electromagnetic spectrum, for the numerical solution of problems of scattering by periodic surfaces in two-dimensional space. The proposed algorithm remains highly accurate…

Computational Physics · Physics 2018-05-25 Oscar Bruno , Martín Maas

In this paper, we study a fractional-order variant of the asymptotical regularization method, called {\it Fractional Asymptotical Regularization (FAR)}, for solving linear ill-posed operator equations in a Hilbert space setting. We assign…

Numerical Analysis · Mathematics 2019-07-16 Ye Zhang , Bernd Hofmann

Randomized smoothing is sound when using infinite precision. However, we show that randomized smoothing is no longer sound for limited floating-point precision. We present a simple example where randomized smoothing certifies a radius of…

Machine Learning · Computer Science 2023-04-26 Václav Voráček , Matthias Hein

For a large class of regularized models, leave-one-out cross-validation can be efficiently estimated with an approximate leave-one-out formula (ALO). We consider the problem of adjusting hyperparameters so as to optimize ALO. We derive…

Machine Learning · Statistics 2020-11-23 Ryan Burn

Smoothing of noisy sample covariances is an important component in functional data analysis. We propose a novel covariance smoothing method based on penalized splines and associated software. The proposed method is a bivariate spline…

Methodology · Statistics 2017-04-07 Luo Xiao , Cai Li , William Checkley , Ciprian M. Crainiceanu

Regularization techniques are necessary to compute meaningful solutions to discrete ill-posed inverse problems. The well-known 2-norm Tikhonov regularization method equipped with a discretization of the gradient operator as regularization…

Numerical Analysis · Mathematics 2024-06-05 Silvia Gazzola , Ali Gholami

Fast Fourier Transform (FFT) is one of the most important tools in digital signal processing. FFT costs O(N \log N) for transforming a signal of length N. Recently, Sparse Fourier Transform (SFT) has emerged as a critical issue addressing…

Data Structures and Algorithms · Computer Science 2015-05-25 Sung-Hsien Hsieh , Chun-Shien Lu , Soo-Chang Pei

We study the mean-squared error of $k$-fold cross-validation as a risk estimator, with particular emphasis on how its accuracy depends on the number of folds $k$. Despite the widespread use of cross-validation, principled guidance for…

Statistics Theory · Mathematics 2026-05-26 Ido Nachum , Rüdiger Urbanke , Thomas Weinberger

In computer vision, the estimation of the fundamental matrix is a basic problem that has been extensively studied. The accuracy of the estimation imposes a significant influence on subsequent tasks such as the camera trajectory…

Computer Vision and Pattern Recognition · Computer Science 2015-04-15 Hao Wu , Yi Wan