English
Related papers

Related papers: A Sparse Fast Chebyshev Transform for High-Dimensi…

200 papers

Series expansions have been a cornerstone of applied mathematics and engineering for centuries. In this paper, we revisit the Taylor series expansion from a modern Machine Learning perspective. Specifically, we introduce the Fast Continuous…

Machine Learning · Computer Science 2021-11-12 Henning Lange , J. Nathan Kutz

We present an implementation of Pagh's compressed matrix multiplication algorithm, a randomized algorithm that constructs sketches of matrices to compute an unbiased estimate of their product. By leveraging fast polynomial multiplication…

Data Structures and Algorithms · Computer Science 2026-01-15 Joel Andersson , Matti Karppa

Fast Fourier Transform (FFT) is an essential tool in scientific and engineering computation. The increasing demand for mixed-precision FFT has made it possible to utilize half-precision floating-point (FP16) arithmetic for faster speed and…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-26 Binrui Li , Shenggan Cheng , James Lin

We design a new, fast algorithm for agnostically learning univariate probability distributions whose densities are well approximated by piecewise polynomial functions. Let $f$ be the density function of an arbitrary univariate distribution,…

Data Structures and Algorithms · Computer Science 2015-06-03 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

We propose and analyze a weighted greedy scheme for computing deterministic sample configurations in multidimensional space for performing least-squares polynomial approximations on $L^2$ spaces weighted by a probability density function.…

Numerical Analysis · Mathematics 2017-08-07 Ling Guo , Akil Narayan , Liang Yan , Tao Zhou

Trace estimators allow to approximate thermodynamic equilibrium observables with astonishing accuracy. A prominent representative is the finite-temperature Lanczos method (FTLM) which relies on a Krylov space expansion of the exponential…

Strongly Correlated Electrons · Physics 2021-12-07 H. Schlüter , F. Gayk , H. -J. Schmidt , A. Honecker , J. Schnack

In recent years, various subspace algorithms have been developed to handle large-scale optimization problems. Although existing subspace Newton methods require fewer iterations to converge in practice, the matrix operations and full…

Optimization and Control · Mathematics 2024-06-05 Taisei Miyaishi , Ryota Nozawa , Pierre-Louis Poirion , Akiko Takeda

Kernel methods are a highly effective and widely used collection of modern machine learning algorithms. A fundamental limitation of virtually all such methods are computations involving the kernel matrix that naively scale quadratically…

Machine Learning · Computer Science 2021-06-09 John Paul Ryan , Sebastian Ament , Carla P. Gomes , Anil Damle

We introduce Quasi-Threshold Mover (QTM), an algorithm to solve the quasi-threshold (also called trivially perfect) graph editing problem with edge insertion and deletion. Given a graph it computes a quasi-threshold graph which is close in…

Data Structures and Algorithms · Computer Science 2020-04-28 Ulrik Brandes , Michael Hamann , Ben Strasser , Dorothea Wagner

The non-equidistant fast Fourier transform (NFFT) is an extension of the famous fast Fourier transform (FFT), which can be applied to non-equidistantly sampled data in time/space or frequency domain. It is an approximative algorithm that…

Mathematical Software · Computer Science 2023-01-31 Tobias Knopp , Marija Boberg , Mirco Grosser

Compression-based similarity measures are effectively employed in applications on diverse data types with a basically parameter-free approach. Nevertheless, there are problems in applying these techniques to medium-to-large datasets which…

Machine Learning · Statistics 2012-10-03 Daniele Cerra , Mihai Datcu

We propose a randomized algorithm with quadratic convergence rate for convex optimization problems with a self-concordant, composite, strongly convex objective function. Our method is based on performing an approximate Newton step using a…

Optimization and Control · Mathematics 2021-05-18 Jonathan Lacotte , Yifei Wang , Mert Pilanci

We develop a sparse spectral method for a class of fractional differential equations, posed on $\mathbb{R}$, in one dimension. These equations can include sqrt-Laplacian, Hilbert, derivative and identity terms. The numerical method utilizes…

Numerical Analysis · Mathematics 2024-06-12 Ioannis P. A. Papadopoulos , Sheehan Olver

We consider the least-squares approximation of a matrix C in the set of doubly stochastic matrices with the same sparsity pattern as C. Our approach is based on applying the well-known Alternating Direction Method of Multipliers (ADMM) to a…

Optimization and Control · Mathematics 2019-10-14 Nikitas Rontsis , Paul J. Goulart

Approximating a univariate function on the interval $[-1,1]$ with a polynomial is among the most classical problems in numerical analysis. When the function evaluations come with noise, a least-squares fit is known to reduce the effect of…

Numerical Analysis · Mathematics 2025-07-08 Takeru Matsuda , Yuji Nakatsukasa

We carry Chebyshev-polynomial expansion of the inverse localization length of Hermitian and non-Hermitian random chains as function of energy. For Hermitian models, the expansion produces numerically this energy-dependent function in one…

Disordered Systems and Neural Networks · Physics 2016-12-21 Naomichi Hatano , Joshua Feinberg

Accurate calculations of the spectral density in a strongly correlated quantum many-body system are of fundamental importance to study its dynamics in the linear response regime. Typical examples are the calculation of inclusive and…

Nuclear Theory · Physics 2022-06-15 Joanna E. Sobczyk , Alessandro Roggero

For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate…

Optimization and Control · Mathematics 2018-02-21 Zhewei Yao , Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

Accurate approximation of complex nonlinear functions is a fundamental challenge across many scientific and engineering domains. Traditional neural network architectures, such as Multi-Layer Perceptrons (MLPs), often struggle to efficiently…

Machine Learning · Computer Science 2024-06-17 Sidharth SS , Keerthana AR , Gokul R , Anas KP

The paper presents a general strategy to solve ordinary differential equations (ODE), where some coefficient depend on the spatial variable and on additional random variables. The approach is based on the application of a recently developed…

Numerical Analysis · Mathematics 2019-07-17 Maximilian Bochmann , Lutz Kämmerer , Daniel Potts