English
Related papers

Related papers: Adaptive Sparse M\"obius Transforms for Learning P…

200 papers

Learning large scale nonlinear ordinary differential equation (ODE) systems from data is known to be computationally and statistically challenging. We present a framework together with the adaptive integral matching (AIM) algorithm for…

Statistics Theory · Mathematics 2017-10-27 Frederik Vissing Mikkelsen , Niels Richard Hansen

Dictionary learning is the task of determining a data-dependent transform that yields a sparse representation of some observed data. The dictionary learning problem is non-convex, and usually solved via computationally complex iterative…

Machine Learning · Computer Science 2016-11-30 Cristian Rusu , Nuria Gonzalez-Prelcic , Robert Heath

We present a variational Bayesian method of joint image reconstruction and point spread function (PSF) estimation when the PSF of the imaging device is only partially known. To solve this semi-blind deconvolution problem, prior…

Data Analysis, Statistics and Probability · Physics 2013-03-18 Se Un Park , Nicolas Dobigeon , Alfred O. Hero

Partial observability is a common challenge in many reinforcement learning applications, which requires an agent to maintain memory, infer latent states, and integrate this past information into exploration. This challenge leads to a number…

Machine Learning · Computer Science 2020-10-27 Chi Jin , Sham M. Kakade , Akshay Krishnamurthy , Qinghua Liu

We introduce a new algorithm, called adaptive sparse backfitting algorithm, for solving high dimensional Sparse Additive Model (SpAM) utilizing symmetric, non-negative definite smoothers. Unlike the previous sparse backfitting algorithm,…

Machine Learning · Statistics 2014-11-13 Yan Li

The Fast Fourier Transform(FFT) is a classic signal processing algorithm that is utilized in a wide range of applications. For image processing, FFT computes on every pixel's value of an image, regardless of their properties in frequency…

Signal Processing · Electrical Eng. & Systems 2020-02-25 Sheng Shi , Runkai Yang , Haihang You

We develop a technique to design efficiently computable estimators for sparse linear regression in the simultaneous presence of two adversaries: oblivious and adaptive. We design several robust algorithms that outperform the state of the…

Machine Learning · Computer Science 2024-11-01 Chih-Hung Liu , Gleb Novikov

In this paper, we consider the problem of learning functions over sets, i.e., functions that are invariant to permutations of input set items. Recent approaches of pooling individual element embeddings can necessitate extremely large…

Machine Learning · Computer Science 2020-01-13 Chirag Pabbaraju , Prateek Jain

Recently, the study of linear misspecified bandits has generated intriguing implications of the hardness of learning in bandits and reinforcement learning (RL). In particular, Du et al. (2020) show that even if a learner is given linear…

Machine Learning · Computer Science 2023-03-31 Jialin Dong , Lin F. Yang

The problem of computing the Fourier Transform of a signal whose spectrum is dominated by a small number $k$ of frequencies quickly and using a small number of samples of the signal in time domain (the Sparse FFT problem) has received…

Data Structures and Algorithms · Computer Science 2017-08-18 Michael Kapralov

Given a zero-dimensional ideal I in K[x1,...,xn] of degree D, the transformation of the ordering of its Groebner basis from DRL to LEX is a key step in polynomial system solving and turns out to be the bottleneck of the whole solving…

Symbolic Computation · Computer Science 2017-03-01 Jean-Charles Faugère , Chenqi Mou

Full waveform inversion (FWI) delivers high-resolution images of the subsurface by minimizing iteratively the misfit between the recorded and calculated seismic data. It has been attacked successfully with the Gauss-Newton method and…

Geophysics · Physics 2016-11-07 Lingchen Zhu , Entao Liu , James H. McClellan

We study the convergence of a class of gradient-based Model-Agnostic Meta-Learning (MAML) methods and characterize their overall complexity as well as their best achievable accuracy in terms of gradient norm for nonconvex loss functions. We…

Machine Learning · Computer Science 2020-05-19 Alireza Fallah , Aryan Mokhtari , Asuman Ozdaglar

Sparsity-based models and techniques have been exploited in many signal processing and imaging applications. Data-driven methods based on dictionary and sparsifying transform learning enable learning rich image features from data, and can…

Machine Learning · Computer Science 2019-09-25 Saiprasad Ravishankar , Anna Ma , Deanna Needell

We propose an efficient ADMM method with guarantees for high-dimensional problems. We provide explicit bounds for the sparse optimization problem and the noisy matrix decomposition problem. For sparse optimization, we establish that the…

Machine Learning · Computer Science 2015-07-08 Hanie Sedghi , Anima Anandkumar , Edmond Jonckheere

We present a new deterministic algorithm for the sparse Fourier transform problem, in which we seek to identify k << N significant Fourier coefficients from a signal of bandwidth N. Previous deterministic algorithms exhibit quadratic…

Numerical Analysis · Mathematics 2012-07-27 David Lawlor , Yang Wang , Andrew Christlieb

Deep neural networks are state-of-the-art models for understanding the content of images, video and raw input data. However, implementing a deep neural network in embedded systems is a challenging task, because a typical deep neural…

Machine Learning · Computer Science 2016-04-22 Xichuan Zhou , Shengli Li , Kai Qin , Kunping Li , Fang Tang , Shengdong Hu , Shujun Liu , Zhi Lin

We consider the following Stochastic Boolean Function Evaluation problem, which is closely related to several problems from the literature. A matroid $\mathcal{M}$ (in compact representation) on ground set $E$ is given, and each element…

Data Structures and Algorithms · Computer Science 2026-01-13 Lisa Hellerstein , Benedikt M. Plank , Kevin Schewior

The state-of-the-art automotive radars employ multidimensional discrete Fourier transforms (DFT) in order to estimate various target parameters. The DFT is implemented using the fast Fourier transform (FFT), at sample and computational…

Signal Processing · Electrical Eng. & Systems 2018-01-16 Shaogang Wang , Vishal M. Patel , Athina Petropulu

We address the recovery of sparse vectors in an overcomplete, linear and noisy multiple measurement framework, where the measurement matrix is known upto a permutation of its rows. We derive sparse Bayesian learning (SBL) based updates for…

Information Theory · Computer Science 2018-02-05 Ranjitha Prasad