English
Related papers

Related papers: Kernel Random Projection Depth for Outlier Detecti…

200 papers

We present a novel mathematical optimization framework for outlier detection in multimodal datasets, extending Support Vector Data Description approaches. We provide a primal formulation, in the shape of a Mixed Integer Second Order Cone…

Optimization and Control · Mathematics 2025-07-16 Víctor Blanco , Inmaculada Espejo , Raúl Páez , Antonio M. Rodríguez-Chía

Statistical analysis of functional data is challenging due to their complex patterns, for which functional depth provides an effective means of reflecting their ordering structure. In this work, we investigate practical aspects of the…

Methodology · Statistics 2026-02-27 Filip Bočinec , Stanislav Nagy , Hyemin Yeon

Recent advances in visual tracking showed that deep Convolutional Neural Networks (CNN) trained for image classification can be strong feature extractors for discriminative trackers. However, due to the drastic difference between image…

Computer Vision and Pattern Recognition · Computer Science 2017-05-31 Jimmy Ren , Zhiyang Yu , Jianbo Liu , Rui Zhang , Wenxiu Sun , Jiahao Pang , Xiaohao Chen , Qiong Yan

The problem of establishing out-of-sample bounds for the values of an unkonwn ground-truth function is considered. Kernels and their associated Hilbert spaces are the main formalism employed herein along with an observational model where…

Machine Learning · Computer Science 2022-09-13 Paul Scharnhorst , Emilio T. Maddalena , Yuning Jiang , Colin N. Jones

Current neural networks-based object detection approaches processing LiDAR point clouds are generally trained from one kind of LiDAR sensors. However, their performances decrease when they are tested with data coming from a different LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Ruddy Théodose , Dieumet Denis , Thierry Chateau , Vincent Frémont , Paul Checchin

Kernel methods are one of the cornerstones of learning-based control, modern system identification, surrogate modelling, and related fields. A key advantage of this class of learning and function approximation methods is the availability of…

Numerical Analysis · Mathematics 2026-05-20 Tizian Wenzel , Abdullah Tokmak , Christian Fiedler

Anomaly detection underpins critical applications from network security and intrusion detection to fraud prevention, where recognizing aberrant patterns rapidly is indispensable. Progress in this area is routinely impeded by two obstacles:…

Machine Learning · Computer Science 2025-09-09 Jiaju Miao , Wei Zhu

We propose a neural network for unsupervised anomaly detection with a novel robust subspace recovery layer (RSR layer). This layer seeks to extract the underlying subspace from a latent representation of the given data and removes outliers…

Machine Learning · Computer Science 2022-01-19 Chieh-Hsin Lai , Dongmian Zou , Gilad Lerman

Notions of depth in regression have been introduced and studied in the literature. The most famous example is Regression Depth (RD), which is a direct extension of location depth to regression. The projection regression depth (PRD) is the…

Computation · Statistics 2021-01-19 Yijun Zuo

Novelty detection is a fundamental task of machine learning which aims to detect abnormal ($\textit{i.e.}$ out-of-distribution (OOD)) samples. Since diffusion models have recently emerged as the de facto standard generative framework with…

Machine Learning · Computer Science 2023-12-06 Sungik Choi , Hankook Lee , Honglak Lee , Moontae Lee

Responding to the challenge of detecting unusual radar targets in a well identified environment, innovative anomaly and novelty detection methods keep emerging in the literature. This work aims at presenting a benchmark gathering common and…

Signal Processing · Electrical Eng. & Systems 2021-06-22 Martin Bauw , Santiago Velasco-Forero , Jesus Angulo , Claude Adnet , Olivier Airiau

Recent methods for learning a linear subspace from data corrupted by outliers are based on convex $\ell_1$ and nuclear norm optimization and require the dimension of the subspace and the number of outliers to be sufficiently small. In sharp…

Machine Learning · Computer Science 2018-12-27 Zhihui Zhu , Yifan Wang , Daniel P. Robinson , Daniel Q. Naiman , Rene Vidal , Manolis C. Tsakiris

Kernel methods, particularly kernel ridge regression (KRR), are time-proven, powerful nonparametric regression techniques known for their rich capacity, analytical simplicity, and computational tractability. The analysis of their predictive…

Statistics Theory · Mathematics 2025-09-23 Xin Bing , Xin He , Chao Wang

We introduce the concept of compressed convolution, a technique to convolve a given data set with a large number of non-orthogonal kernels. In typical applications our technique drastically reduces the effective number of computations. The…

Instrumentation and Methods for Astrophysics · Physics 2014-01-08 F. Elsner , B. D. Wandelt

Depth measures have gained popularity in the statistical literature for defining level sets in complex data structures like multivariate data, functional data, and graphs. Despite their versatility, integrating depth measures into…

The empirical success of deep convolutional networks on tasks involving high-dimensional data such as images or audio suggests that they can efficiently approximate certain functions that are well-suited for such tasks. In this paper, we…

Machine Learning · Statistics 2022-03-22 Alberto Bietti

Random convolution kernel transform (Rocket) is a fast, efficient, and novel approach for time series feature extraction using a large number of independent randomly initialized 1-D convolution kernels of different configurations. The…

Machine Learning · Computer Science 2022-09-21 Hojjat Salehinejad , Yang Wang , Yuanhao Yu , Tang Jin , Shahrokh Valaee

Deploying object detection on microcontrollers (MCUs) enables intelligent edge devices but current models cannot learn new object categories after deployment. Existing continual learning methods require storing raw images far exceeding MCU…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Bibin Wilson

Learning a latent embedding to understand the underlying nature of data distribution is often formulated in Euclidean spaces with zero curvature. However, the success of the geometry constraints, posed in the embedding space, indicates that…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Jie Hong , Pengfei Fang , Weihao Li , Junlin Han , Lars Petersson , Mehrtash Harandi

We obtain upper bounds for the estimation error of Kernel Ridge Regression (KRR) for all non-negative regularization parameters, offering a geometric perspective on various phenomena in KRR. As applications: 1. We address the multiple…

Statistics Theory · Mathematics 2024-10-10 Georgios Gavrilopoulos , Guillaume Lecué , Zong Shang