English
Related papers

Related papers: Attention-Based Self-Supervised Feature Learning f…

200 papers

Today, machine learning is applied in almost any field. In machine learning, where there are numerous methods, classification is one of the most basic and crucial ones. Various problems can be solved by classification. The feature selection…

Machine Learning · Computer Science 2022-07-01 Ahmet Tuğrul Bayrak

Inspired by the human cognitive system, attention is a mechanism that imitates the human cognitive awareness about specific information, amplifying critical details to focus more on the essential aspects of data. Deep learning has employed…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Mohammed Hassanin , Saeed Anwar , Ibrahim Radwan , Fahad S Khan , Ajmal Mian

Growth in system complexity increases the need for automated log analysis techniques, such as Log-based Anomaly Detection (LAD). While deep learning (DL) methods have been widely used for LAD, traditional machine learning (ML) techniques…

Software Engineering · Computer Science 2025-06-24 Shan Ali , Chaima Boufaied , Domenico Bianculli , Paula Branco , Lionel Briand

Models play an essential role in the design process of cyber-physical systems. They form the basis for simulation and analysis and help in identifying design problems as early as possible. However, the construction of models that comprise…

Anomaly detection has a wide range of real-world applications, such as bank fraud detection and cyber intrusion detection. In the past decade, a variety of anomaly detection models have been developed, which lead to big progress towards…

Machine Learning · Computer Science 2022-02-17 Shuhan Yuan , Xintao Wu

To address semi-supervised learning from both labeled and unlabeled data, we present a novel meta-learning scheme. We particularly consider that labeled and unlabeled data share disjoint ground truth label sets, which can be seen tasks like…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Yun-Chun Chen , Chao-Te Chou , Yu-Chiang Frank Wang

This paper describes the use of neural networks to enhance simulations for subsequent training of anomaly-detection systems. Simulations can provide edge conditions for anomaly detection which may be sparse or non-existent in real-world…

Neural and Evolutionary Computing · Computer Science 2020-11-06 Philip Feldman

Computer network defence is a complicated task that has necessitated a high degree of human involvement. However, with recent advancements in machine learning, fully autonomous network defence is becoming increasingly plausible. This paper…

Cryptography and Security · Computer Science 2023-06-16 Myles Foley , Mia Wang , Zoe M , Chris Hicks , Vasilios Mavroudis

Nowadays, Machine Learning and Deep Learning methods have become the state-of-the-art approach to solve data classification tasks. In order to use those methods, it is necessary to acquire and label a considerable amount of data; however,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Adrián Inés , César Domínguez , Jónathan Heras , Gadea Mata , Julio Rubio

Anomaly detection is a fundamental yet challenging problem in machine learning due to the lack of label information. In this work, we propose a novel and powerful framework, dubbed as SLA$^2$P, for unsupervised anomaly detection. After…

Machine Learning · Computer Science 2021-11-29 Yizhou Wang , Can Qin , Rongzhe Wei , Yi Xu , Yue Bai , Yun Fu

Anomaly detection is important in many real-life applications. Recently, self-supervised learning has greatly helped deep anomaly detection by recognizing several geometric transformations. However these methods lack finer features, usually…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Loic Jezequel , Ngoc-Son Vu , Jean Beaudet , Aymeric Histace

Self-supervised learning has significantly improved the performance of many NLP tasks. However, how can self-supervised learning discover useful representations, and why is it better than traditional approaches such as probabilistic models…

Computation and Language · Computer Science 2023-03-01 Zeping Luo , Shiyou Wu , Cindy Weng , Mo Zhou , Rong Ge

Confidence-aware learning is proven as an effective solution to prevent networks becoming overconfident. We present a confidence-aware camouflaged object detection framework using dynamic supervision to produce both accurate camouflage map…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Jiawei Liu , Jing Zhang , Nick Barnes

Artificial Intelligence has gained a lot of traction in the recent years, with machine learning notably starting to see more applications across a varied range of fields. One specific machine learning application that is of interest to us…

Software Engineering · Computer Science 2023-05-10 Teodor Rares Begu

In the research area of anomaly detection, novel and promising methods are frequently developed. However, most existing studies exclusively focus on the detection task only and ignore the interpretability of the underlying models as well as…

Machine Learning · Computer Science 2023-01-16 Cheng Feng , Pingge Hu

Despite their irresistible success, deep learning algorithms still heavily rely on annotated data. On the other hand, unsupervised settings pose many challenges, especially about determining the right inductive bias in diverse scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Beril Besbinar , Pascal Frossard

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to…

Insider threats, as one type of the most challenging threats in cyberspace, usually cause significant loss to organizations. While the problem of insider threat detection has been studied for a long time in both security and data mining…

Cryptography and Security · Computer Science 2020-05-27 Shuhan Yuan , Xintao Wu

Self-supervision allows learning meaningful representations of natural images, which usually contain one central object. How well does it transfer to multi-entity scenes? We discuss key aspects of learning structured object-centric…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Federico Baldassarre , Hossein Azizpour

Self-supervised learning (SSL) has become the de facto training paradigm of large models where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Hypothesizing that SSL models would learn more generic,…

Machine Learning · Computer Science 2024-01-04 Sofia Yfantidou , Dimitris Spathis , Marios Constantinides , Athena Vakali , Daniele Quercia , Fahim Kawsar