English
Related papers

Related papers: PETRELS: Parallel Subspace Estimation and Tracking…

200 papers

In this paper the problem of forecasting high dimensional time series is considered. Such time series can be modeled as matrices where each column denotes a measurement. In addition, when missing values are present, low rank matrix…

Machine Learning · Computer Science 2017-12-27 San Gultekin , John Paisley

Low-rank tensor representation (LRTR) has emerged as a powerful tool for multi-dimensional data processing. However, classical LRTR-based methods face two critical limitations: (1) they typically assume that the holistic data is low-rank,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Zhizhou Wang , Jianli Wang , Ruijing Zheng , Zhenyu Wu

We consider the problem of reconstructing rank-one matrices from random linear measurements, a task that appears in a variety of problems in signal processing, statistics, and machine learning. In this paper, we focus on the Alternating…

Machine Learning · Computer Science 2022-04-26 Kiryung Lee , Dominik Stöger

Recursive Bayesian inference, in which posterior beliefs are updated in light of accumulating data, is a tool for implementing Bayesian models in applications with streaming and/or very large data sets. As the posterior of one iteration…

Methodology · Statistics 2025-08-05 Henry R. Scharf

Dimension reduction is often the first step in statistical modeling or prediction of multivariate spatial data. However, most existing dimension reduction techniques do not account for the spatial correlation between observations and do not…

Methodology · Statistics 2025-05-27 Si Cheng , Magali N. Blanco , Timothy V. Larson , Lianne Sheppard , Adam Szpiro , Ali Shojaie

Distributed adaptive signal processing has attracted much attention in the recent decade owing to its effectiveness in many decentralized real-time applications in networked systems. Because many natural signals are highly sparse with most…

Optimization and Control · Mathematics 2017-11-22 Xuanyu Cao , K. J. Ray Liu

Detecting tiny objects in a high-resolution video is challenging because the visual information is little and unreliable. Specifically, the challenge includes very low resolution of the objects, MPEG artifacts due to compression and a large…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Ryota Yoshihashi , Rei Kawakami , Shaodi You , Tu Tuan Trinh , Makoto Iida , Takeshi Naemura

Subspace tracking is a fundamental problem in signal processing, where the goal is to estimate and track the underlying subspace that spans a sequence of data streams over time. In high-dimensional settings, data samples are often corrupted…

Several problems in machine learning, statistics, and other fields rely on computing eigenvectors. For large scale problems, the computation of these eigenvectors is typically performed via iterative schemes such as subspace iteration or…

Numerical Analysis · Mathematics 2020-11-03 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

Matrix completion constantly receives tremendous attention from many research fields. It is commonly applied for recommender systems such as movie ratings, computer vision such as image reconstruction or completion, multi-task learning such…

Machine Learning · Computer Science 2019-10-08 Abdallah Chehade , Zunya Shi

Many data-rich industries are interested in the efficient discovery and modelling of structures underlying large data sets, as it allows for the fast triage and dimension reduction of large volumes of data embedded in high dimensional…

Algebraic Topology · Mathematics 2019-09-30 Yossi Bokor , Daniel Grixti-Cheng , Markus Hegland , Stephen Roberts , Katharine Turner

Data characterized by high dimensionality and sparsity are commonly used to describe real-world node interactions. Low-rank representation (LR) can map high-dimensional sparse (HDS) data to low-dimensional feature spaces and infer node…

Machine Learning · Computer Science 2024-08-30 Qicong Hu , Hao Wu

Our perceptions are guided both by the bottom-up information entering our eyes, as well as our top-down expectations of what we will see. Although bottom-up visual processing has been extensively studied, comparatively little is known about…

Computer Vision and Pattern Recognition · Computer Science 2014-11-20 Michelle R. Greene , Abraham P. Botros , Diane M. Beck , Li Fei-Fei

A non-parametric low-resolution face recognition model for resource-constrained environments with limited networking and computing is proposed in this work. Such environments often demand a small model capable of being effectively trained…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Mozhdeh Rouhsedaghat , Yifan Wang , Shuowen Hu , Suya You , C. -C. Jay Kuo

We address the numerical solution of minimal norm residuals of {\it nonlinear} equations in finite dimensions. We take inspiration from the problem of finding a sparse vector solution by using greedy algorithms based on iterative residual…

Numerical Analysis · Mathematics 2015-04-28 Juliane Sigl

This paper is devoted to the performance analysis of the detectors proposed in the companion paper where a comprehensive design framework is presented for the adaptive detection of subspace signals. The framework addresses four variations…

Signal Processing · Electrical Eng. & Systems 2022-11-23 Pia Addabbo , Danilo Orlando , Giuseppe Ricci , Louis L. Scharf

The last decade has witnessed an explosion in the development of models, theory and computational algorithms for "big data" analysis. In particular, distributed computing has served as a natural and dominating paradigm for statistical…

Machine Learning · Statistics 2018-11-02 Bayan Saparbayeva , Michael Minyi Zhang , Lizhen Lin

We present a novel kernel-based machine learning algorithm for identifying the low-dimensional geometry of the effective dynamics of high-dimensional multiscale stochastic systems. Recently, the authors developed a mathematical framework…

Dynamical Systems · Mathematics 2020-02-04 Andreas Bittracher , Stefan Klus , Boumediene Hamzi , Péter Koltai , Christof Schütte

Given a linear regression setting, Iterative Least Trimmed Squares (ILTS) involves alternating between (a) selecting the subset of samples with lowest current loss, and (b) re-fitting the linear model only on that subset. Both steps are…

Machine Learning · Computer Science 2019-11-13 Yanyao Shen , Sujay Sanghavi

For many modern applications in science and engineering, data are collected in a streaming fashion carrying time-varying information, and practitioners need to process them with a limited amount of memory and computational resources in a…

Machine Learning · Statistics 2018-06-13 Laura Balzano , Yuejie Chi , Yue M. Lu