English
Related papers

Related papers: Deterministic Sparse Sublinear FFT with Improved N…

200 papers

Sparse matrix factorization is the problem of approximating a matrix $\mathbf{Z}$ by a product of $J$ sparse factors $\mathbf{X}^{(J)} \mathbf{X}^{(J-1)} \ldots \mathbf{X}^{(1)}$. This paper focuses on identifiability issues that appear in…

Machine Learning · Computer Science 2021-11-18 Léon Zheng , Elisa Riccietti , Rémi Gribonval

In this work, we show that for all statistical estimation problems, a natural MMSE instability (discontinuity) condition implies the failure of stable algorithms, serving as a version of OGP for estimation tasks. Using this criterion, we…

Statistics Theory · Mathematics 2026-03-24 Xifan Yu , Ilias Zadik

The problem of computing the Fourier Transform of a signal whose spectrum is dominated by a small number $k$ of frequencies quickly and using a small number of samples of the signal in time domain (the Sparse FFT problem) has received…

Data Structures and Algorithms · Computer Science 2017-08-18 Michael Kapralov

In this paper, we present two variations of an algorithm for signal reconstruction from one-bit or two-bit noisy observations of the discrete Fourier transform (DFT). The one-bit observations of the DFT correspond to the sign of its real…

Signal Processing · Electrical Eng. & Systems 2022-05-25 Mohak Goyal , Animesh Kumar

We consider the classical 1D phase retrieval problem. In order to overcome the difficulties associated with phase retrieval from measurements of the Fourier magnitude, we treat recovery from the magnitude of the short-time Fourier transform…

Information Theory · Computer Science 2015-06-23 Yonina C. Eldar , Pavel Sidorenko , Dustin G. Mixon , Shaby Barel , Oren Cohen

This is the second part in a series of papers on multi-step schemes for solving coupled forward backward stochastic differential equations (FBSDEs). We extend the basic idea in our former paper [W. Zhao, Y. Fu and T. Zhou, SIAM J. Sci.…

Numerical Analysis · Mathematics 2016-07-26 Yu Fu , Weidong Zhao , Tao Zhou

Nonnegative matrix factorization (NMF) has become a ubiquitous tool for data analysis. An important variant is the sparse NMF problem which arises when we explicitly require the learnt features to be sparse. A natural measure of sparsity is…

Machine Learning · Computer Science 2013-03-20 Vamsi K. Potluru , Sergey M. Plis , Jonathan Le Roux , Barak A. Pearlmutter , Vince D. Calhoun , Thomas P. Hayes

We present a sparse matrix permutation from graph theory that gives stable incomplete Lower-Upper (LU) preconditioners necessary for iterative solutions to the steady state density matrix for quantum optomechanical systems. This reordering…

Quantum Physics · Physics 2015-01-28 P. D. Nation , J. R. Johansson , M. P. Blencowe , A. J. Rimberg

We consider the problem of finding a sparse solution for an underdetermined linear system of equations when the known parameters on both sides of the system are subject to perturbation. This problem is particularly relevant to…

Systems and Control · Computer Science 2016-06-16 Reza Arablouei

We address the problem of reconstructing sparse signals from noisy and compressive measurements using a feed-forward deep neural network (DNN) with an architecture motivated by the iterative shrinkage-thresholding algorithm (ISTA). We…

Machine Learning · Computer Science 2017-05-23 Debabrata Mahapatra , Subhadip Mukherjee , Chandra Sekhar Seelamantula

We consider the problem of exactly learning an $s$-sparse real-valued Boolean polynomial of degree $d$ of the form $f:\{ 0,1\}^n \rightarrow \mathbb{R}$. This problem corresponds to decomposing functions in the AND basis and is known as…

Machine Learning · Computer Science 2026-02-09 Yigit Efe Erginbas , Justin Singh Kang , Elizabeth Polito , Kannan Ramchandran

The fast Fourier transform (FFT) is one of the most successful numerical algorithms of the 20th century and has found numerous applications in many branches of computational science and engineering. The FFT algorithm can be derived from a…

Numerical Analysis · Mathematics 2021-02-10 Daan Camps , Roel Van Beeumen , Chao Yang

Resolvent analysis provides a framework to predict coherent spatio-temporal structures of largest linear energy amplification, through a singular value decomposition (SVD) of the resolvent operator, obtained by linearizing the Navier-Stokes…

Fluid Dynamics · Physics 2024-10-01 Barbara Lopez-Doriga , Eric Ballouz , H. Jane Bae , Scott T. M. Dawson

Discrete transforms such as the discrete Fourier transform (DFT) and the discrete Hartley transform (DHT) are important tools in numerical analysis. The successful application of transform techniques relies on the existence of efficient…

Numerical Analysis · Computer Science 2015-02-06 H. M. de Oliveira , R. J. Cintra , R. M. Campello de Souza

We revisit the problem of finding optimal strategies for deterministic Markov Decision Processes (DMDPs), and a closely related problem of testing feasibility of systems of $m$ linear inequalities on $n$ real variables with at most two…

Data Structures and Algorithms · Computer Science 2021-10-29 Adam Karczmarz

A novel efficient and high accuracy numerical method for the time-fractional differential equations (TFDEs) is proposed in this work. We show the equivalence between TFDEs and the integer-order extended parametric differential equations…

Numerical Analysis · Mathematics 2025-05-13 Peng Ding , Zhiping Mao

Feature selection, as a vital dimension reduction technique, reduces data dimension by identifying an essential subset of input features, which can facilitate interpretable insights into learning and inference processes. Algorithmic…

Machine Learning · Computer Science 2022-01-06 Xinxing Wu , Qiang Cheng

Nonnegative matrix factorization (NMF) has become a very popular technique in machine learning because it automatically extracts meaningful features through a sparse and part-based representation. However, NMF has the drawback of being…

Machine Learning · Statistics 2012-12-07 Nicolas Gillis

An efficient procedure for error-value calculations based on fast discrete Fourier transforms (DFT) in conjunction with Berlekamp-Massey-Sakata algorithm for a class of affine variety codes is proposed. Our procedure is achieved by…

Information Theory · Computer Science 2012-10-02 Hajime Matsui

Fine-tuning pre-trained models has been ubiquitously proven to be effective in a wide range of NLP tasks. However, fine-tuning the whole model is parameter inefficient as it always yields an entirely new model for each task. Currently, many…

Computation and Language · Computer Science 2022-11-29 Zihao Fu , Haoran Yang , Anthony Man-Cho So , Wai Lam , Lidong Bing , Nigel Collier