English
Related papers

Related papers: Structural Conditions for Projection-Cost Preserva…

200 papers

We consider the matrix completion problem of recovering a structured low rank matrix with partially observed entries with mixed data types. Vast majority of the solutions have proposed computationally feasible estimators with strong…

Machine Learning · Statistics 2020-05-27 Daqian Sun , Martin T. Wells

We present an adaptation of two recent low-rank approximation technique proposed for first-order model reduction systems to the second-order systems. The resulting reduced order models are guaranteed to keep the second order structure which…

Dynamical Systems · Mathematics 2015-12-01 Younes Chahlaoui

This paper discusses the topic of dimensionality reduction for $k$-means clustering. We prove that any set of $n$ points in $d$ dimensions (rows in a matrix $A \in \RR^{n \times d}$) can be projected into $t = \Omega(k / \eps^2)$…

Artificial Intelligence · Computer Science 2011-05-05 Christos Boutsidis , Anastasios Zouzias , Petros Drineas

We show a methodology for the computation of the probability of deadline miss for a periodic real-time task scheduled by a resource reservation algorithm. We propose a modelling technique for the system that reduces the computation of such…

Performance · Computer Science 2016-04-28 Luigi Palopoli , Daniele Fontanelli , Luca Abeni , Bernardo Villalba Frías

Embeddings provide compact representations of signals in order to perform efficient inference in a wide variety of tasks. In particular, random projections are common tools to construct Euclidean distance-preserving embeddings, while…

Data Structures and Algorithms · Computer Science 2019-09-05 Diego Valsesia , Sophie Marie Fosson , Chiara Ravazzi , Tiziano Bianchi , Enrico Magli

Different notions on regularity of sets and of collection of sets play an important role in the analysis of the convergence of projection algorithms in nonconvex scenarios. While some projection algorithms can be applied to feasibility…

Optimization and Control · Mathematics 2023-10-24 Rubén Campoy

In this paper, we develop a new alternating projection method to compute nonnegative low rank matrix approximation for nonnegative matrices. In the nonnegative low rank matrix approximation method, the projection onto the manifold of fixed…

Machine Learning · Computer Science 2020-09-10 Guangjing Song , Michael K. Ng , Tai-Xiang Jiang

In high performance computing, scheduling of tasks and allocation to machines is very critical especially when we are dealing with heterogeneous execution costs. Simulations can be performed with a large variety of environments and…

Performance · Computer Science 2018-03-23 Louis-Claude Canon , Mohamad El Sayah , Pierre-Cyrille Héam

Existing results for low-rank matrix recovery largely focus on quadratic loss, which enjoys favorable properties such as restricted strong convexity/smoothness (RSC/RSM) and well conditioning over all low rank matrices. However, many…

Machine Learning · Statistics 2021-11-17 Lijun Ding , Yuqian Zhang , Yudong Chen

The modern ability to collect vast quantities of data poses a challenge for parameter estimation problems. When posed as a nonlinear least squares problem fitting a model to data, the cost of each iteration grows linearly with the amount of…

Numerical Analysis · Mathematics 2019-03-01 Jeffrey M. Hokanson

We study conditional risk minimization (CRM), i.e. the problem of learning a hypothesis of minimal risk for prediction at the next step of sequentially arriving dependent data. Despite it being a fundamental problem, successful learning in…

Machine Learning · Statistics 2018-11-06 Alexander Zimin , Christoph Lampert

We study the rank-three lifting problem for incidence matrices of finite projective planes through residue-level determinant constraints invisible to tropical valuations alone. In residue characteristic $\neq 3$, any rank-$\le 3$ lift of…

Rings and Algebras · Mathematics 2026-05-12 Jaehwan Kim

This work proposes an adaptive structure-preserving model order reduction method for finite-dimensional parametrized Hamiltonian systems modeling non-dissipative phenomena. To overcome the slowly decaying Kolmogorov width typical of…

Numerical Analysis · Mathematics 2022-02-02 Jan S. Hesthaven , Cecilia Pagliantini , Nicolò Ripamonti

Mappings to structured output spaces (strings, trees, partitions, etc.) are typically learned using extensions of classification algorithms to simple graphical structures (eg., linear chains) in which search and parameter estimation can be…

Machine Learning · Computer Science 2009-07-07 Hal Daumé , Daniel Marcu

In this paper, we present and analyze a new set of low-rank recovery algorithms for linear inverse problems within the class of hard thresholding methods. We provide strategies on how to set up these algorithms via basic ingredients for…

Numerical Analysis · Computer Science 2013-01-15 Anastasios Kyrillidis , Volkan Cevher

We provide a simple proof of the Johnson-Lindenstrauss lemma for sub-Gaussian variables. We extend the analysis to identify how sparse projections can be, and what the cost of sparsity is on the target dimension.The Johnson-Lindenstrauss…

Statistics Theory · Mathematics 2024-09-25 Aurélien Garivier , Emmanuel Pilliat

Structured low-rank approximation is the problem of minimizing a weighted Frobenius distance to a given matrix among all matrices of fixed rank in a linear space of matrices. We study exact solutions to this problem by way of computational…

Optimization and Control · Mathematics 2017-02-23 Giorgio Ottaviani , Pierre-Jean Spaenlehauer , Bernd Sturmfels

Efficient index structures for fast approximate nearest neighbor queries are required in many applications such as recommendation systems. In high-dimensional spaces, many conventional methods suffer from excessive usage of memory and slow…

We describe an algorithm that, given any full-rank matrix A having fewer rows than columns, can rapidly compute the orthogonal projection of any vector onto the null space of A, as well as the orthogonal projection onto the row space of A,…

Numerical Analysis · Computer Science 2011-05-26 Vladimir Rokhlin , Mark Tygert

In the numerical treatment of large-scale Sylvester and Lyapunov equations, projection methods require solving a reduced problem to check convergence. As the approximation space expands, this solution takes an increasing portion of the…

Numerical Analysis · Mathematics 2017-02-03 Davide Palitta , Valeria Simoncini