English
Related papers

Related papers: Computationally and Memory-Efficient Robust Predic…

200 papers

The scalability of statistical estimators is of increasing importance in modern applications. One approach to implementing scalable algorithms is to compress data into a low dimensional latent space using dimension reduction methods. In…

Machine Learning · Statistics 2015-04-14 Gregory Darnell , Stoyan Georgiev , Sayan Mukherjee , Barbara E Engelhardt

Energy prediction in buildings plays a crucial role in effective energy management. Precise predictions are essential for achieving optimal energy consumption and distribution within the grid. This paper introduces a Long Short-Term Memory…

Machine Learning · Computer Science 2024-02-07 Aditya Mishra , Haroon R. Lone , Aayush Mishra

In this paper we analyze approximate methods for undertaking a principal components analysis (PCA) on large data sets. PCA is a classical dimension reduction method that involves the projection of the data onto the subspace spanned by the…

Machine Learning · Statistics 2017-08-16 Darren Homrighausen , Daniel J. McDonald

Principal Components Analysis (PCA) is one of the most widely used dimension reduction techniques. Robust PCA (RPCA) refers to the problem of PCA when the data may be corrupted by outliers. Recent work by Cand{\`e}s, Wright, Li, and Ma…

Information Theory · Computer Science 2018-08-14 Namrata Vaswani , Praneeth Narayanamurthy

Robust principal component analysis (RPCA) can recover low-rank matrices when they are corrupted by sparse noises. In practice, many matrices are, however, of high-rank and hence cannot be recovered by RPCA. We propose a novel method called…

Machine Learning · Computer Science 2019-04-19 Jicong Fan , Tommy W. S. Chow

Long short-term memory (LSTM) is a robust recurrent neural network architecture for learning spatiotemporal sequential data. However, it requires significant computational power for learning and implementing from both software and hardware…

Machine Learning · Computer Science 2022-10-26 Nelly Elsayed , Zag ElSayed , Anthony S. Maida

The high dimensionality and complexity of neuroimaging data necessitate large datasets to develop robust and high-performing deep learning models. However, the neuroimaging field is notably hampered by the scarcity of such datasets. In this…

Machine Learning · Computer Science 2023-12-15 Yutong Gao , Charles A. Ellis , Vince D. Calhoun , Robyn L. Miller

In the current context of data explosion, online techniques that do not require storing all data in memory are indispensable to routinely perform tasks like principal component analysis (PCA). Recursive algorithms that update the PCA with…

Machine Learning · Statistics 2015-11-13 Hervé Cardot , David Degras

Spatiotemporal data mining (STDM) has a wide range of applications in various complex physical systems (CPS), i.e., transportation, manufacturing, healthcare, etc. Among all the proposed methods, the Convolutional Long Short-Term Memory…

Machine Learning · Computer Science 2025-11-19 Junfeng Wu , Hadjer Benmeziane , Kaoutar El Maghraoui , Liu Liu , Yinan Wang

PCA is one of the most widely used dimension reduction techniques. A related easier problem is "subspace learning" or "subspace estimation". Given relatively clean data, both are easily solved via singular value decomposition (SVD). The…

Information Theory · Computer Science 2020-06-25 Namrata Vaswani , Thierry Bouwmans , Sajid Javed , Praneeth Narayanamurthy

Robust principal component analysis (RPCA) is a powerful method for learning low-rank feature representation of various visual data. However, for certain types as well as significant amount of error corruption, it fails to yield…

Computer Vision and Pattern Recognition · Computer Science 2018-01-24 Niannan Xue , Jiankang Deng , Shiyang Cheng , Yannis Panagakis , Stefanos Zafeiriou

In this paper, we propose a novel robust Principal Component Analysis (PCA) for high-dimensional data in the presence of various heterogeneities, especially the heavy-tailedness and outliers. A transformation motivated by the characteristic…

Methodology · Statistics 2022-04-05 Lingyu He , Yanrong Yang , Bo Zhang

Continual learning needs to overcome catastrophic forgetting of the past. Memory replay of representative old training samples has been shown as an effective solution, and achieves the state-of-the-art (SOTA) performance. However, existing…

Machine Learning · Computer Science 2022-03-10 Liyuan Wang , Xingxing Zhang , Kuo Yang , Longhui Yu , Chongxuan Li , Lanqing Hong , Shifeng Zhang , Zhenguo Li , Yi Zhong , Jun Zhu

Model Predictive Control (MPC) is a state-of-the-art (SOTA) control technique which requires solving hard constrained optimization problems iteratively. For uncertain dynamics, analytical model based robust MPC imposes additional…

Robotics · Computer Science 2023-02-27 Sourav Sanyal , Kaushik Roy

Tensor, also known as multi-dimensional array, arises from many applications in signal processing, manufacturing processes, healthcare, among others. As one of the most popular methods in tensor literature, Robust tensor principal component…

Machine Learning · Statistics 2025-12-18 Bo Shen , Yutong Zhang , Zhenyu , Kong

Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the…

Information Theory · Computer Science 2022-04-04 Zezhong Zhang , Guangxu Zhu , Rui Wang , Vincent K. N. Lau , Kaibin Huang

Probabilistic principal component analysis (PPCA) seeks a low dimensional representation of a data set in the presence of independent spherical Gaussian noise, Sigma = (sigma^2)*I. The maximum likelihood solution for the model is an…

Machine Learning · Statistics 2011-06-23 Alfredo A. Kalaitzis , Neil D. Lawrence

Principal Component Analysis is a novel way of of dimensionality reduction. This problem essentially boils down to finding the top k eigen vectors of the data covariance matrix. A considerable amount of literature is found on algorithms…

Machine Learning · Computer Science 2019-01-08 Jian Vora

Many of the challenges facing today's reinforcement learning (RL) algorithms, such as robustness, generalization, transfer, and computational efficiency are closely related to compression. Prior work has convincingly argued why minimizing…

Machine Learning · Computer Science 2021-09-08 Benjamin Eysenbach , Ruslan Salakhutdinov , Sergey Levine

As a widely used method in machine learning, principal component analysis (PCA) shows excellent properties for dimensionality reduction. It is a serious problem that PCA is sensitive to outliers, which has been improved by numerous Robust…

Machine Learning · Computer Science 2020-11-24 Shenglan Liu , Yang Yu