English
Related papers

Related papers: Fast Cross-validation in Harmonic Approximation

200 papers

We consider the problem of selecting the best estimator among a family of Tikhonov regularized estimators, or, alternatively, to select a linear combination of these regularizers that is as good as the best regularizer in the family. Our…

Statistics Theory · Mathematics 2019-05-30 Pierre C Bellec , Dana Yang

In this work, we investigate data fitting problems with random noises. A randomized progressive iterative regularization method is proposed. It works well for large-scale matrix computations and converges in expectation to the least-squares…

Numerical Analysis · Mathematics 2025-06-05 Dakang Cen , Wenlong Zhang , Junbin Zhong

A space-time interface-fitted approximation of an inverse source problem for the advection-diffusion equation with moving subdomains is investigated. The problem is reformulated as an optimization problem using Tikhonov regularization. A…

Numerical Analysis · Mathematics 2025-02-11 Thi Thanh Mai Ta , Quang Huy Nguyen , Dinh Nho Hào

We present improved algorithms for fast calculation of the inverse square root for single-precision floating-point numbers. The algorithms are much more accurate than the famous fast inverse square root algorithm and have the same or…

Numerical Analysis · Computer Science 2018-02-22 Cezary J. Walczyk , Leonid V. Moroz , Jan L. Cieśliński

Problems in machine learning (ML) can involve noisy input data, and ML classification methods have reached limiting accuracies when based on standard ML data sets consisting of feature vectors and their classes. Greater accuracy will…

Machine Learning · Statistics 2013-12-31 Yue Fan , Louise Raphael , Mark Kon

In this paper we propose a tool for high-dimensional approximation based on trigonometric polynomials where we allow only low-dimensional interactions of variables. In a general high-dimensional setting, it is already possible to deal with…

Numerical Analysis · Mathematics 2021-11-09 Felix Bartel , Daniel Potts , Michael Schmischke

For the Tikhonov regularization of ill-posed nonlinear operator equations, convergence is studied in a Hilbert scale setting. We include the case of oversmoothing penalty terms, which means that the exact solution does not belong to the…

Numerical Analysis · Mathematics 2020-02-03 Bernd Hofmann , Robert Plato

We study strategies for increasing the precision in the blurring models by maintaining a complexity in the related numerical linear algebra procedures (matrix-vector product, linear system solution, computation of eigenvalues etc.) of the…

Numerical Analysis · Mathematics 2009-06-16 Marco Donatelli

Nowadays, analysing data from different classes or over a temporal grid has attracted a great deal of interest. As a result, various multiple graphical models for learning a collection of graphical models simultaneously have been derived by…

Optimization and Control · Mathematics 2021-04-23 Ning Zhang , Yangjing Zhang , Defeng Sun , Kim-Chuan Toh

In this article, we rigorously establish the consistency of generalized cross-validation as a parameter-choice rule for solving inverse problems. We prove that the index chosen by leave-one-out GCV achieves a non-asymptotic, order-optimal…

Numerical Analysis · Mathematics 2025-06-18 Tim Jahn , Mikhail Kirilin

For linear inverse problem with Gaussian random noise we show that Tikhonov regularization algorithm is minimax in the class of linear estimators and is asymptotically minimax in the sense of sharp asymptotic in the class of all estimators.…

Statistics Theory · Mathematics 2017-06-08 Mikhail Ermakov

It is a well-known fact that adding noise to the input data often improves network performance. While the dropout technique may be a cause of memory loss, when it is applied to recurrent connections, Tikhonov regularization, which can be…

Machine Learning · Computer Science 2017-08-11 Andrei Turkin

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

Normalized cross-correlation is the reference approach to carry out template matching on images. When it is computed in Fourier space, it can handle efficiently template translations but it cannot do so with template rotations. Including…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 José María Almira , Harold Phelippeau , Antonio Martinez-Sanchez

This paper is concerned with the inverse scattering problem which aims to determine the spatially distributed dielectric constant coefficient of the 2D Helmholtz equation from multifrequency backscatter data associated with a single…

Numerical Analysis · Mathematics 2020-02-25 Trung Truong , Dinh-Liem Nguyen , Michael Klibanov

One of the key assumptions in the stability and convergence analysis of variational regularization is the ability of finding global minimizers. However, such an assumption is often not feasible when the regularizer is a black box or…

Optimization and Control · Mathematics 2023-07-05 Daniel Obmann , Markus Haltmeier

The k-fold cross-validation is commonly used to evaluate the effectiveness of SVMs with the selected hyper-parameters. It is known that the SVM k-fold cross-validation is expensive, since it requires training k SVMs. However, little work…

Machine Learning · Computer Science 2017-02-07 Zeyi Wen , Bin Li , Rao Kotagiri , Jian Chen , Yawen Chen , Rui Zhang

We develop a general framework for estimating the $L_\infty(\mathbb{T}^d)$ error for the approximation of multivariate periodic functions belonging to specific reproducing kernel Hilbert spaces (RHKS) using approximants that are…

Numerical Analysis · Mathematics 2019-09-06 Lutz Kämmerer

We present an extension of the linear sampling method for solving the sound-soft inverse acoustic scattering problem with randomly distributed point sources. The theoretical justification of our sampling method is based on the…

Numerical Analysis · Mathematics 2023-03-21 Josselin Garnier , Houssem Haddar , Hadrien Montanelli

The analysis of Tikhonov regularization for nonlinear ill-posed equations with smoothness promoting penalties is an important topic in inverse problem theory. With focus on Hilbert scale models, the case of oversmoothing penalties, i.e.,…

Numerical Analysis · Mathematics 2024-04-18 Bernd Hofmann , Christopher Hofmann , Peter Mathé , Robert Plato