English
Related papers

Related papers: Online Anomaly Detection with Sparse Gaussian Proc…

200 papers

We propose a similarity measure for sparsely sampled time course data in the form of a log-likelihood ratio of Gaussian processes (GP). The proposed GP similarity is similar to a Bayes factor and provides enhanced robustness to noise in…

Machine Learning · Computer Science 2021-02-25 Zijing Liu , Mauricio Barahona

Anomaly detection in multivariate time series is a central challenge in industrial monitoring, as failures frequently arise from complex temporal dynamics and cross-sensor interactions. While recent deep learning models, including graph…

Machine Learning · Computer Science 2026-04-21 Pooyan Khosravinia , João Gama , Bruno Veloso

We introduce a new scalable approximation for Gaussian processes with provable guarantees which hold simultaneously over its entire parameter space. Our approximation is obtained from an improved sample complexity analysis for sparse…

Machine Learning · Computer Science 2020-11-18 Quang Minh Hoang , Trong Nghia Hoang , Hai Pham , David P. Woodruff

Many inferential tasks involve fitting models to observed data and predicting outcomes at new covariate values, requiring interpolation or extrapolation. Conventional methods select a single best-fitting model, discarding fits that were…

Methodology · Statistics 2026-01-01 Soonhong Cho , Doeun Kim , Chad Hazlett

In this work, a Gaussian process regression(GPR) model incorporated with given physical information in partial differential equations(PDEs) is developed: physics-assisted Gaussian processes(PAGP). The targets of this model can be divided…

Machine Learning · Statistics 2022-04-07 Jiahao Zhang , Shiqi Zhang , Guang Lin

Gaussian graphical models are widely used to represent correlations among entities but remain vulnerable to data corruption. In this work, we introduce a modified trimmed-inner-product algorithm to robustly estimate the covariance in an…

Machine Learning · Computer Science 2023-09-19 Tong Yao , Shreyas Sundaram

The increasing connectivity of data and cyber-physical systems has resulted in a growing number of cyber-attacks. Real-time detection of such attacks, through the identification of anomalous activity, is required so that mitigation and…

Machine Learning · Statistics 2021-04-23 Raisa Dzhamtyrova , Carsten Maple

Anomaly detection plays in many fields of research, along with the strongly related task of outlier detection, a very important role. Especially within the context of the automated analysis of video material recorded by surveillance…

Computer Vision and Pattern Recognition · Computer Science 2019-08-09 Thomas Golda , Nils Murzyn , Chengchao Qu , Kristian Kroschel

This paper studies a sparse signal recovery task in time-varying (time-adaptive) environments. The contribution of the paper to sparsity-aware online learning is threefold; first, a Generalized Thresholding (GT) operator, which relates to…

Information Theory · Computer Science 2012-12-03 Konstantinos Slavakis , Yannis Kopsinis , Sergios Theodoridis , Stephen McLaughlin

The increased demand for online prediction and the growing availability of large data sets drives the need for computationally efficient models. While exact Gaussian process regression shows various favorable theoretical properties…

Machine Learning · Computer Science 2021-08-02 Armin Lederer , Alejandro Jose Ordonez Conejo , Korbinian Maier , Wenxin Xiao , Jonas Umlauft , Sandra Hirche

Deep Gaussian Processes (DGPs) are multi-layer, flexible extensions of Gaussian processes but their training remains challenging. Sparse approximations simplify the training but often require optimization over a large number of inducing…

Machine Learning · Statistics 2021-07-20 Ayush Jain , P. K. Srijith , Mohammad Emtiyaz Khan

Terrain analysis is critical for the practical ap- plication of ground mobile robots in real-world tasks, espe- cially in outdoor unstructured environments. In this paper, we propose a novel spatial-temporal traversability assessment…

Robotics · Computer Science 2025-10-21 Zhenyu Hou , Senming Tan , Zhihao Zhang , Long Xu , Mengke Zhang , Zhaoqi He , Chao Xu , Fei Gao , Yanjun Cao

Safety is a top priority for civil aviation. New anomaly detection methods, primarily clustering methods, have been developed to monitor pilot operations and detect any risks from such flight data. However, all existing anomaly detection…

Machine Learning · Computer Science 2021-10-07 Weizun Zhao , Lishuai Li , Sameer Alam , Yanjun Wang

Stochastic Gradient Descent (SGD) is one of the most widely used techniques for online optimization in machine learning. In this work, we accelerate SGD by adaptively learning how to sample the most useful training examples at each time…

Machine Learning · Computer Science 2016-03-16 Guillaume Bouchard , Théo Trouillon , Julien Perez , Adrien Gaidon

One of the key challenges in revenue management is unconstraining demand data. Existing state of the art single-class unconstraining methods make restrictive assumptions about the form of the underlying demand and can perform poorly when…

Applications · Statistics 2017-11-30 Ilan Price , Jaroslav Fowkes , Daniel Hopman

Intelligent real-world systems critically depend on expressive information about their system state and changing operation conditions, e.g., due to variation in temperature, location, wear, or aging. To provide this information, online…

Systems and Control · Electrical Eng. & Systems 2024-09-17 Jan-Hendrik Ewering , Björn Volkmann , Simon F. G. Ehlers , Thomas Seel , Michael Meindl

Stochastic gradient descent (SGD) and its variants have established themselves as the go-to algorithms for large-scale machine learning problems with independent samples due to their generalization performance and intrinsic computational…

Machine Learning · Statistics 2025-08-25 Hao Chen , Lili Zheng , Raed Al Kontar , Garvesh Raskutti

Gaussian Processes (GPs) are a powerful tool for probabilistic modeling, but their performance is often constrained in complex, large-scale real-world domains due to the limited expressivity of classical kernels. Quantum computing offers…

Multiagent Systems · Computer Science 2026-05-13 Meet Gandhi , George P. Kontoudis

In this tutorial we explain the inference procedures developed for the sparse Gaussian process (GP) regression and Gaussian process latent variable model (GPLVM). Due to page limit the derivation given in Titsias (2009) and Titsias &…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk

Unpredictable and complex aerodynamic effects pose significant challenges to achieving precise flight control, such as the downwash effect from upper vehicles to lower ones. Conventional methods often struggle to accurately model these…

Robotics · Computer Science 2024-09-30 Yuan Gao , Yinyi Lai , Jun Wang , Yini Fang