English
Related papers

Related papers: The Fast Cauchy Transform and Faster Robust Linear…

200 papers

In multiple scientific and technological applications we face the problem of having low dimensional data to be justified by a linear model defined in a high dimensional parameter space. The difference in dimensionality makes the problem…

Other Computer Science · Computer Science 2016-08-04 Jorge Fernandez-de-Cossio-Diaz , Roberto Mulet

We describe a fast solver for linear systems with reconstructable Cauchy-like structure, which requires O(rn^2) floating point operations and O(rn) memory locations, where n is the size of the matrix and r its displacement rank. The solver…

Numerical Analysis · Mathematics 2021-09-21 Antonio Arico' , Giuseppe Rodriguez

Subset selection for the rank $k$ approximation of an $n\times d$ matrix $A$ offers improvements in the interpretability of matrices, as well as a variety of computational savings. This problem is well-understood when the error measure is…

Data Structures and Algorithms · Computer Science 2023-04-20 David P. Woodruff , Taisuke Yasuda

We study the well-posedness of Cauchy problems on the upper half space $\mathbb{R}^{n+1}_+$ associated to higher order systems $\partial_t u =(-1)^{m+1}\mbox{div}_m A\nabla ^m u$ with bounded measurable and uniformly elliptic coefficients.…

Analysis of PDEs · Mathematics 2020-07-30 Wiktoria Zatoń

The maximization of submodular functions have found widespread application in areas such as machine learning, combinatorial optimization, and economics, where practitioners often wish to enforce various constraints; the matroid constraint…

Data Structures and Algorithms · Computer Science 2023-05-02 Monika Henzinger , Paul Liu , Jan Vondrak , Da Wei Zheng

We consider the optimization of a quadratic objective function whose gradients are only accessible through a stochastic oracle that returns the gradient at any given point plus a zero-mean finite variance random error. We present the first…

Optimization and Control · Mathematics 2016-02-25 Aymeric Dieuleveut , Nicolas Flammarion , Francis Bach

Motivated by applications in single-cell biology and metagenomics, we investigate the problem of matrix reordering based on a noisy disordered monotone Toeplitz matrix model. We establish the fundamental statistical limit for this problem…

Statistics Theory · Mathematics 2023-08-15 T. Tony Cai , Rong Ma

We study in-context learning problems where a Transformer is pretrained on tasks drawn from a mixture distribution $\pi=\sum_{\alpha\in\mathcal{A}} \lambda_{\alpha} \pi_{\alpha}$, called the pretraining prior, in which each mixture…

Machine Learning · Statistics 2026-05-08 Tianyi Ma , Tengyao Wang , Richard J. Samworth

An "oblivious subspace embedding (OSE)" given some parameters eps,d is a distribution D over matrices B in R^{m x n} such that for any linear subspace W in R^n with dim(W) = d it holds that Pr_{B ~ D}(forall x in W ||B x||_2 in (1 +/-…

Data Structures and Algorithms · Computer Science 2012-11-07 Jelani Nelson , Huy L. Nguyen

We study regularity properties of solutions to nonlinear and nonlocal evolution problems driven by the so-called \emph{$0$-order fractional $p-$Laplacian} type operators: $$ \partial_t u(x,t)=\mathcal{J}_p u(x,t):=\int_{\mathbb{R}^n}…

Analysis of PDEs · Mathematics 2024-04-02 Matteo Bonforte , Ariel Salort

We study the algorithmic problem of sparse mean estimation in the presence of adversarial outliers. Specifically, the algorithm observes a \emph{corrupted} set of samples from $\mathcal{N}(\mu,\mathbf{I}_d)$, where the unknown mean $\mu \in…

Data Structures and Algorithms · Computer Science 2024-03-08 Ankit Pensia

We begin a study of a multi-parameter family of Cauchy initial-value problems for the modified nonlinear Schr\"odinger equation, analyzing the solution in the semiclassical limit. We use the inverse scattering transform for this equation,…

Exactly Solvable and Integrable Systems · Physics 2012-08-09 Jeffery C. DiFranco , Peter D. Miller

In this paper, we consider a well-known sparse optimization problem that aims to find a sparse solution of a possibly noisy underdetermined system of linear equations. Mathematically, it can be modeled in a unified manner by minimizing…

Optimization and Control · Mathematics 2021-10-01 Lei Yang , Xiaojun Chen , Shuhuang Xiang

The attention mechanism is the key to large language models, and the attention matrix serves as an algorithmic and computational bottleneck for such a scheme. In this paper, we define two problems, motivated by designing fast algorithms for…

Machine Learning · Computer Science 2024-04-03 Zhao Song , Junze Yin , Lichen Zhang

We study fast algorithms for statistical regression problems under the strong contamination model, where the goal is to approximately optimize a generalized linear model (GLM) given adversarially corrupted samples. Prior works in this line…

Data Structures and Algorithms · Computer Science 2021-06-23 Arun Jambulapati , Jerry Li , Tselil Schramm , Kevin Tian

In this paper, we investigate the Cauchy problem for both linear and semi-linear elliptic equations. In general, the equations have the form \[ \frac{\partial^{2}}{\partial…

Analysis of PDEs · Mathematics 2015-12-10 Nguyen Huy Tuan , Dang Duc Trong , Le Duc Thang , Vo Anh Khoa

Recently, many works have focused on the characterization of non-linear dimensionality reduction methods obtained by quantizing linear embeddings, e.g., to reach fast processing time, efficient data compression procedures, novel…

Information Theory · Computer Science 2016-12-30 Laurent Jacques , Valerio Cambareri

We investigate the inverse Cauchy and data completion problems for elliptic partial differential equations in a bounded domain $D \subset \mathbb{R}^d$, $d \ge 2$, with a special emphasis on the steady-state heat conduction in anisotropic…

Numerical Analysis · Mathematics 2025-06-06 Iulian Cîmpean , Andreea Grecu , Liviu Marin

In this paper, we consider the following inverse maintenance problem: given $A \in \mathbb{R}^{n\times d}$ and a number of rounds $r$, we receive a $n\times n$ diagonal matrix $D^{(k)}$ at round $k$ and we wish to maintain an efficient…

Data Structures and Algorithms · Computer Science 2015-10-15 Yin Tat Lee , Aaron Sidford

Subsampling methods have been recently proposed to speed up least squares estimation in large scale settings. However, these algorithms are typically not robust to outliers or corruptions in the observed covariates. The concept of influence…

Machine Learning · Statistics 2014-06-20 Brian McWilliams , Gabriel Krummenacher , Mario Lucic , Joachim M. Buhmann