English
Related papers

Related papers: Self-Supervised Losses for One-Class Textual Anoma…

200 papers

Growth in system complexity increases the need for automated log analysis techniques, such as Log-based Anomaly Detection (LAD). While deep learning (DL) methods have been widely used for LAD, traditional machine learning (ML) techniques…

Software Engineering · Computer Science 2025-06-24 Shan Ali , Chaima Boufaied , Domenico Bianculli , Paula Branco , Lionel Briand

Advanced Persistent Threats (APTs) present a considerable challenge to cybersecurity due to their stealthy, long-duration nature. Traditional supervised learning methods typically require large amounts of labeled data, which is often scarce…

Cryptography and Security · Computer Science 2025-09-08 Sidahmed Benabderrahmane , Talal Rahwan

Learning good representations without supervision is still an open issue in machine learning, and is particularly challenging for speech signals, which are often characterized by long sequences with a complex hierarchical structure. Some…

Machine Learning · Computer Science 2019-04-09 Santiago Pascual , Mirco Ravanelli , Joan Serrà , Antonio Bonafonte , Yoshua Bengio

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Speech evaluation measures a learners oral proficiency using automatic models. Corpora for training such models often pose sparsity challenges given that there often is limited scored data from teachers, in addition to the score…

Artificial Intelligence · Computer Science 2024-09-24 Huayun Zhang , Jeremy H. M. Wong , Geyu Lin , Nancy F. Chen

As LLMs grow in capability, the task of supervising LLMs becomes more challenging. Supervision failures can occur if LLMs are sensitive to factors that supervisors are unaware of. We investigate Mechanistic Anomaly Detection (MAD) as a…

Machine Learning · Computer Science 2025-04-15 David O. Johnston , Arkajyoti Chakraborty , Nora Belrose

Self-supervised methods have emerged as a promising avenue for representation learning in the recent years since they alleviate the need for labeled datasets, which are scarce and expensive to acquire. Contrastive methods are a popular…

Sound · Computer Science 2022-09-07 Elio Quinton

Deep active learning in the presence of outlier examples poses a realistic yet challenging scenario. Acquiring unlabeled data for annotation requires a delicate balance between avoiding outliers to conserve the annotation budget and…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Vladan Stojnić , Zakaria Laskar , Giorgos Tolias

Deep anomaly detection is a difficult task since, in high dimensions, it is hard to completely characterize a notion of "differentness" when given only examples of normality. In this paper we propose a novel approach to deep anomaly…

Machine Learning · Computer Science 2020-10-07 Lucas Deecke , Lukas Ruff , Robert A. Vandermeulen , Hakan Bilen

Self-supervision can dramatically cut back the amount of manually-labelled data required to train deep neural networks. While self-supervision has usually been considered for tasks such as image classification, in this paper we aim at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 David Novotny , Samuel Albanie , Diane Larlus , Andrea Vedaldi

Several techniques for multivariate time series anomaly detection have been proposed recently, but a systematic comparison on a common set of datasets and metrics is lacking. This paper presents a systematic and comprehensive evaluation of…

Machine Learning · Computer Science 2021-09-24 Astha Garg , Wenyu Zhang , Jules Samaran , Savitha Ramasamy , Chuan-Sheng Foo

Surrogate task based methods have recently shown great promise for unsupervised image anomaly detection. However, there is no guarantee that the surrogate tasks share the consistent optimization direction with anomaly detection. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Fei Ye , Huangjie Zheng , Chaoqin Huang , Ya Zhang

Exfiltration of data via email is a serious cybersecurity threat for many organizations. Detecting data exfiltration (anomaly) patterns typically requires labeling, most often done by a human annotator, to reduce the high number of false…

Machine Learning · Computer Science 2023-07-19 Jaturong Kongmanee , Mark Chignell , Khilan Jerath , Abhay Raman

Semi-supervised learning (SSL) methods assume that labeled data, unlabeled data and test data are from the same distribution. Open-set semi-supervised learning (Open-set SSL) considers a more practical scenario, where unlabeled data and…

Machine Learning · Computer Science 2024-04-16 Yang Yu , Danruo Deng , Furui Liu , Yueming Jin , Qi Dou , Guangyong Chen , Pheng-Ann Heng

Self-supervised learning, which learns by constructing artificial labels given only the input signals, has recently gained considerable attention for learning representations with unlabeled datasets, i.e., learning without any…

Machine Learning · Computer Science 2020-06-30 Hankook Lee , Sung Ju Hwang , Jinwoo Shin

The modern industrial environment is equipping myriads of smart manufacturing machines where the state of each device can be monitored continuously. Such monitoring can help identify possible future failures and develop a cost-effective…

Machine Learning · Computer Science 2023-01-24 William Marfo , Deepak K. Tosh , Shirley V. Moore

Our work focuses on unsupervised and generative methods that address the following goals: (a) learning unsupervised generative representations that discover latent factors controlling image semantic attributes, (b) studying how this ability…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 William Paul , I-Jeng Wang , Fady Alajaji , Philippe Burlina

Sophisticated automatic incident detection (AID) technology plays a key role in contemporary transportation systems. Though many papers were devoted to study incident classification algorithms, few study investigated how to enhance feature…

Machine Learning · Computer Science 2016-11-18 Jimmy SJ. Ren , Wei Wang , Jiawei Wang , Stephen Liao

Semi-supervised anomaly detection aims to detect anomalies from normal samples using a model that is trained on normal data. With recent advancements in deep learning, researchers have designed efficient deep anomaly detection methods.…

Machine Learning · Computer Science 2024-01-23 Hadi Hojjati , Narges Armanfard

This paper proposes an approach for anomalous sound detection that incorporates outlier exposure and inlier modeling within a unified framework by multitask learning. While outlier exposure-based methods can extract features efficiently, it…

Sound · Computer Science 2023-09-15 Yucong Zhang , Hongbin Suo , Yulong Wan , Ming Li