English
Related papers

Related papers: Normalizing self-supervised learning for provably …

200 papers

Self-supervised learning (SSL) aims to eliminate one of the major bottlenecks in representation learning - the need for human annotations. As a result, SSL holds the promise to learn representations from data in-the-wild, i.e., without the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Senthil Purushwalkam , Pedro Morgado , Abhinav Gupta

Sequential sensor data is generated in a wide variety of practical applications. A fundamental challenge involves learning effective classifiers for such sequential data. While deep learning has led to impressive performance gains in recent…

Machine Learning · Computer Science 2020-10-07 Nauman Ahad , Mark A. Davenport

Scene change detection (SCD), a crucial perception task, identifies changes by comparing scenes captured at different times. SCD is challenging due to noisy changes in illumination, seasonal variations, and perspective differences across a…

Computer Vision and Pattern Recognition · Computer Science 2022-08-12 Vijaya Raghavan T. Ramkumar , Elahe Arani , Bahram Zonooz

The goal of supervised representation learning is to construct effective data representations for prediction. Among all the characteristics of an ideal nonparametric representation of high-dimensional complex data, sufficiency, low…

Machine Learning · Computer Science 2022-09-02 Jian Huang , Yuling Jiao , Xu Liao , Jin Liu , Zhou Yu

Convolutional Neural Network (CNN) techniques have proven to be very useful in image-based anomaly detection applications. CNN can be used as deep features extractor where other anomaly detection techniques are applied on these features.…

Machine Learning · Computer Science 2022-08-15 Sulaiman Aburakhia , Tareq Tayeh , Ryan Myers , Abdallah Shami

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

Signal Processing · Electrical Eng. & Systems 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

Recent studies have shown that aggregating convolutional features of a pre-trained Convolutional Neural Network (CNN) can obtain impressive performance for a variety of visual tasks. The symmetric Positive Definite (SPD) matrix becomes a…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Zhi Gao , Yuwei Wu , Xingyuan Bu , Yunde Jia

Recently, self-supervised representation learning gives further development in multimedia technology. Most existing self-supervised learning methods are applicable to packaged data. However, when it comes to streamed data, they are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Zhiwei Lin , Yongtao Wang , Hongxiang Lin

Anomaly detection methods require high-quality features. In recent years, the anomaly detection community has attempted to obtain better features using advances in deep self-supervised feature learning. Surprisingly, a very promising…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Tal Reiss , Niv Cohen , Liron Bergman , Yedid Hoshen

Anomaly detection seeks to identify unusual phenomena, a central task in science and industry. The task is inherently unsupervised as anomalies are unexpected and unknown during training. Recent advances in self-supervised representation…

Machine Learning · Computer Science 2022-10-20 Tal Reiss , Niv Cohen , Eliahu Horwitz , Ron Abutbul , Yedid Hoshen

Although supervised deep normal estimators have recently shown impressive results on synthetic benchmarks, their performance deteriorates significantly in real-world scenarios due to the domain gap between synthetic and real data. Building…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jie Zhang , Minghui Nie , Changqing Zou , Jian Liu , Ligang Liu , Junjie Cao

Change-point detection (CPD) in high-dimensional, large-volume time series is challenging for statistical consistency, scalability, and interpretability. We introduce TimePred, a self-supervised framework that reduces multivariate CPD to…

Machine Learning · Computer Science 2025-12-19 Simon Leszek

Change detection in dynamic networks is an important problem in many areas, such as fraud detection, cyber intrusion detection and health care monitoring. It is a challenging problem because it involves a time sequence of graphs, each of…

Machine Learning · Computer Science 2019-10-08 Isuru Udayangani Hewapathirana , Dominic Lee , Elena Moltchanova , Jeanette McLeod

Two dimensional (2D) peak finding is a common practice in data analysis for physics experiments, which is typically achieved by computing the local derivatives. However, this method is inherently unstable when the local landscape is…

Data Analysis, Statistics and Probability · Physics 2020-04-22 Han Peng , Xiang Gao , Yu He , Yiwei Li , Yuchen Ji , Chuhang Liu , Sandy A. Ekahana , Ding Pei , Zhongkai Liu , Zhixun Shen , Yulin Chen

Change-point detection studies the problem of detecting the changes in the underlying distribution of the data stream as soon as possible after the change happens. Modern large-scale, high-dimensional, and complex streaming data call for…

Statistics Theory · Mathematics 2023-06-05 Haoyun Wang , Yao Xie

Visual defect assessment is a form of anomaly detection. This is very relevant in finding faults such as cracks and markings in various surface inspection tasks like pavement and automotive parts. The task involves detection of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Manpreet Singh Minhas , John Zelek

Classic Network Intrusion Detection Systems (NIDS) often rely on manual feature engineering to extract meaningful patterns from network traffic data. However, this approach requires domain expertise and runs counter to the widely adopted…

Machine Learning · Computer Science 2026-05-05 Muhammad Usman Butt , Andreas Hotho , Daniel Schlör

Many real-world time series, such as in health, have changepoints where the system's structure or parameters change. Since changepoints can indicate critical events such as onset of illness, it is highly important to detect them. However,…

Machine Learning · Computer Science 2019-05-17 Zahra Ebrahimzadeh , Min Zheng , Selcuk Karakas , Samantha Kleinberg

Self-supervised learning in computer vision aims to leverage the inherent structure and relationships within data to learn meaningful representations without explicit human annotation, enabling a holistic understanding of visual scenes.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Prakash Chandra Chhipa , Johan Rodahl Holmgren , Kanjar De , Rajkumar Saini , Marcus Liwicki

Change Point Detection (CPD) is a critical task in time series analysis, aiming to identify moments when the underlying data-generating process shifts. Traditional CPD methods often rely on unsupervised techniques, which lack adaptability…

Machine Learning · Computer Science 2026-01-29 Stefano Bertolasi , Diego Carrera , Diego Stucchi , Pasqualina Fragneto , Luigi Amedeo Bianchi