English
Related papers

Related papers: Structural Conditions for Projection-Cost Preserva…

200 papers

We consider the problem of noisy matrix completion, in which the goal is to reconstruct a structured matrix whose entries are partially observed in noise. Standard approaches to this underdetermined inverse problem are based on assuming…

Machine Learning · Statistics 2017-09-04 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

Projection maintenance is one of the core data structure tasks. Efficient data structures for projection maintenance have led to recent breakthroughs in many convex programming algorithms. In this work, we further extend this framework to…

Data Structures and Algorithms · Computer Science 2024-09-09 Zhao Song , Xin Yang , Yuanyuan Yang , Lichen Zhang

Random Projections have been widely used to generate embeddings for various graph learning tasks due to their computational efficiency. The majority of applications have been justified through the Johnson-Lindenstrauss Lemma. In this paper,…

Social and Information Networks · Computer Science 2024-07-30 Tvrtko Tadić , Cassiano Becker , Jennifer Neville

It is often desirable to reduce the dimensionality of a large dataset by projecting it onto a low-dimensional subspace. Matrix sketching has emerged as a powerful technique for performing such dimensionality reduction very efficiently. Even…

Machine Learning · Computer Science 2022-06-15 Michał Dereziński , Feynman Liang , Zhenyu Liao , Michael W. Mahoney

Low Rank Approximation (LRA) of a matrix is a hot research subject, fundamental for Matrix and Tensor Computations and Big Data Mining and Analysis. Computations with low rank matrices can be performed at sublinear cost -- by using much…

Numerical Analysis · Mathematics 2025-08-11 Qi Luan , Victor Y. Pan , John Svadlenka , Liang Zhao

Low-rank structure have been profoundly studied in data mining and machine learning. In this paper, we show a dense matrix $X$'s low-rank approximation can be rapidly built from its left and right random projections $Y_1=XA_1$ and…

Machine Learning · Statistics 2011-12-23 Tianyi Zhou , Dacheng Tao

We provide new approximation guarantees for greedy low rank matrix estimation under standard assumptions of restricted strong convexity and smoothness. Our novel analysis also uncovers previously unknown connections between the low rank…

Machine Learning · Statistics 2017-03-09 Rajiv Khanna , Ethan Elenberg , Alexandros G. Dimakis , Sahand Negahban

This paper is about minimum cost constrained selection of inputs and outputs for generic arbitrary pole placement. The input-output set is constrained in the sense that the set of states that each input can influence and the set of states…

Optimization and Control · Mathematics 2018-01-11 Shana Moothedath , Prasanna Chaporkar , Madhu N. Belur

We study the problem of structured prediction under test-time budget constraints. We propose a novel approach applicable to a wide range of structured prediction problems in computer vision and natural language processing. Our approach…

Machine Learning · Statistics 2016-06-09 Tolga Bolukbasi , Kai-Wei Chang , Joseph Wang , Venkatesh Saligrama

We consider a framework for structured prediction based on search in the space of complete structured outputs. Given a structured input, an output is produced by running a time-bounded search procedure guided by a learned cost function, and…

Machine Learning · Computer Science 2012-07-03 Janardhan Rao Doppa , Alan Fern , Prasad Tadepalli

A methodology for using random sketching in the context of model order reduction for high-dimensional parameter-dependent systems of equations was introduced in [Balabanov and Nouy 2019, Part I]. Following this framework, we here construct…

Numerical Analysis · Mathematics 2022-03-25 Oleg Balabanov , Anthony Nouy

Applications in machine learning and data mining require computing pairwise Lp distances in a data matrix A. For massive high-dimensional data, computing all pairwise distances of A can be infeasible. In fact, even storing A or all pairwise…

Machine Learning · Computer Science 2008-12-18 Ping Li

Recent developments in engineering techniques for spatial data collection such as geographic information systems have resulted in an increasing need for methods to analyze large spatial data sets. These sorts of data sets can be found in…

Methodology · Statistics 2020-08-14 Toshihiro Hirano

The long-standing problem of minimal projections is addressed from a computational point of view. Techniques to determine bounds on the projection constants of univariate polynomial spaces are presented. The upper bound, produced by a…

Numerical Analysis · Mathematics 2018-01-15 Simon Foucart , Jean-Bernard Lasserre

One of the main difficulties in micromagnetics simulation is the norm preserving constraints $\|\mathbf{m}\|=1$ at the continuous or the discrete level. Another difficulty is the stability with the time step constraint. Using standard…

Numerical Analysis · Mathematics 2026-02-12 Changjian Xie , Yingxi Miao , Haocheng Yang

This paper considers the creation of parametric surrogate models for applications in science and engineering where the goal is to predict high-dimensional spatiotemporal output quantities of interest, such as pressure, temperature and…

Computational Physics · Physics 2022-03-24 Chi Hoang , Kenny Chowdhary , Kookjin Lee , Jaideep Ray

Low-rank approximations are essential in modern data science. The interpolative decomposition provides one such approximation. Its distinguishing feature is that it reuses columns from the original matrix. This enables it to preserve matrix…

Numerical Analysis · Mathematics 2022-06-08 Rishi Advani , Sean O'Hagan

In this papers, we couple the parareal algorithm with projection methods of the trajectory on a specific manifold, defined by the preservation of some conserved quantities of the differential equations. First, projection methods are…

Numerical Analysis · Mathematics 2017-05-24 Liying Zhang , Weien Zhou , Lihai ji

A host of problems involve the recovery of structured signals from a dimensionality reduced representation such as a random projection; examples include sparse signals (compressive sensing) and low-rank matrices (matrix completion). Given…

Information Theory · Computer Science 2012-05-22 Shirin Jalali , Arian Maleki , Richard Baraniuk

A simple formula is proved to be a tight estimate for the condition number of the full rank linear least squares residual with respect to the matrix of least squares coefficients and scaled 2-norms. The tight estimate reveals that the…

Numerical Analysis · Mathematics 2015-03-13 Joseph F. Grcar