English
Related papers

Related papers: Robust Cloud Suppression and Anomaly Detection in …

200 papers

Principal Component Analysis (PCA) is a workhorse of modern data science. While PCA assumes the data conforms to Euclidean geometry, for specific data types, such as hierarchical and cyclic data structures, other spaces are more…

Machine Learning · Statistics 2024-07-11 Puoya Tabaghi , Michael Khanzadeh , Yusu Wang , Sivash Mirarab

Detecting anomalies in time series data is a challenging task with broad relevance in many applications. Existing methods work effectively only under idealized conditions, typically focusing on point anomalies or assuming a constant…

Methodology · Statistics 2025-09-01 Yiyin Zhang , Florian Pein , Idris Eckley

Linear dimensionality reduction methods are commonly used to extract low-dimensional structure from high-dimensional data. However, popular methods disregard temporal structure, rendering them prone to extracting noise rather than…

Information Theory · Computer Science 2021-06-10 David G. Clark , Jesse A. Livezey , Kristofer E. Bouchard

One main challenge in time series anomaly detection (TSAD) is the lack of labelled data in many real-life scenarios. Most of the existing anomaly detection methods focus on learning the normal behaviour of unlabelled time series in an…

Machine Learning · Computer Science 2024-09-04 Zahra Zamanzadeh Darban , Geoffrey I. Webb , Shirui Pan , Charu C. Aggarwal , Mahsa Salehi

Robust principal component analysis (RPCA) is a critical tool in modern machine learning, which detects outliers in the task of low-rank matrix reconstruction. In this paper, we propose a scalable and learnable non-convex approach for…

Machine Learning · Computer Science 2023-02-28 HanQin Cai , Jialin Liu , Wotao Yin

The problem of recovering a low-rank matrix from a set of observations corrupted with gross sparse error is known as the robust principal component analysis (RPCA) and has many applications in computer vision, image processing and web data…

Optimization and Control · Mathematics 2013-09-27 Necdet Serhat Aybat , Donald Goldfarb , Shiqian Ma

In climate studies, detecting spatial patterns that largely deviate from the sample mean still remains a statistical challenge. Although a Principal Component Analysis (PCA), or equivalently a Empirical Orthogonal Functions (EOF)…

Statistics Theory · Mathematics 2020-01-29 Alberto Bernacchia , Philippe Naveau

Spatiotemporal chaotic systems are difficult to characterize in a model-free manner because of their high dimensionality, strong nonlinearity, and sensitivity to initial conditions. Coupled map lattices, as a representative class of…

Chaotic Dynamics · Physics 2026-04-15 Xiaoqi Lei , Zixiang Yan , Jian Gao , Yueheng Lan , Jinghua Xiao

This paper addresses the challenge of spectral-spatial feature extraction for hyperspectral image classification by introducing a novel tensor-based framework. The proposed approach incorporates circular convolution into a tensor structure…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuemei Ren , Liang Liao , Stephen John Maybank , Yanning Zhang , Xin Liu

Topological Data Analysis (TDA) allows us to extract powerful topological and higher-order information on the global shape of a data set or point cloud. Tools like Persistent Homology or the Euler Transform give a single complex description…

Algebraic Topology · Mathematics 2025-11-04 Vincent P. Grande , Michael T. Schaub

Tropical cyclones (TCs), driven by heat exchange between the air and sea, pose a substantial risk to many communities around the world. Accurate characterization of the subsurface ocean thermal response to TC passage is crucial for accurate…

Applications · Statistics 2024-03-18 Addison J. Hu , Mikael Kuusela , Ann B. Lee , Donata Giglio , Kimberly M. Wood

Anomaly detection in spatiotemporal data is a challenging problem encountered in a variety of applications including hyperspectral imaging, video surveillance and urban traffic monitoring. In the case of urban traffic data, anomalies refer…

Signal Processing · Electrical Eng. & Systems 2021-03-02 Seyyid Emre Sofuoglu , Selin Aviyente

This paper presents a novel method for real-time nighttime cloud detection, tracking, and prediction using all-sky cameras, aimed at enhancing the efficiency of ground-based robotic telescopes. Ground-based telescopes are vulnerable to…

Instrumentation and Methods for Astrophysics · Physics 2025-07-30 Sebastian Buntin , Chris M. Copperwheat , Helen E. Jermak

Change detection and irregular object extraction in 3D point clouds is a challenging task that is of high importance not only for autonomous navigation but also for updating existing digital twin models of various industrial environments.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Nikolaos Stathoulopoulos , Anton Koval , George Nikolakopoulos

Clouds frequently cover the Earth's surface and pose an omnipresent challenge to optical Earth observation methods. The vast majority of remote sensing approaches either selectively choose single cloud-free observations or employ a…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Marc Rußwurm , Marco Körner

We study the tensor robust principal component analysis (TRPCA) problem, a tensorial extension of matrix robust principal component analysis (RPCA), that aims to split the given tensor into an underlying low-rank component and a sparse…

Numerical Analysis · Mathematics 2024-01-30 HanQin Cai , Zehan Chao , Longxiu Huang , Deanna Needell

In this paper, we propose a novel robust Principal Component Analysis (PCA) for high-dimensional data in the presence of various heterogeneities, especially the heavy-tailedness and outliers. A transformation motivated by the characteristic…

Methodology · Statistics 2022-04-05 Lingyu He , Yanrong Yang , Bo Zhang

Modern distributed cyber-physical systems (CPSs) encounter a large variety of physical faults and cyber anomalies and in many cases, they are vulnerable to catastrophic fault propagation scenarios due to strong connectivity among the…

Machine Learning · Computer Science 2016-05-23 Chao Liu , Sambuddha Ghosal , Zhanhong Jiang , Soumik Sarkar

The last decades have not only been characterized by an explosive growth of data, but also an increasing appreciation of data as a valuable resource. Their value comes with the ability to extract meaningful patterns that are of economic,…

Machine Learning · Statistics 2020-02-27 Jonas I. Liechti , Sebastian Bonhoeffer

Data challenges are emerging as powerful tools with which to answer fundamental astronomical questions. Time-domain astronomy lends itself to data challenges, particularly in the era of classification and anomaly detection. With improved…

Instrumentation and Methods for Astrophysics · Physics 2019-09-25 Renée Hložek