English
Related papers

Related papers: Self-Supervised Transformer-based Contrastive Lear…

200 papers

Contrastive learning has moved the state of the art for many tasks in computer vision and information retrieval in recent years. This poster is the first work that applies supervised contrastive learning to the task of product matching in…

Machine Learning · Computer Science 2022-05-03 Ralph Peeters , Christian Bizer

Transformers trained with self-supervised learning using self-distillation loss (DINO) have been shown to produce attention maps that highlight salient foreground objects. In this paper, we demonstrate a graph-based approach that uses the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Yangtao Wang , Xi Shen , Shell Hu , Yuan Yuan , James Crowley , Dominique Vaufreydaz

The integration of machine learning (ML) algorithms into Internet of Things (IoT) applications has introduced significant advantages alongside vulnerabilities to adversarial attacks, especially within IoT-based intrusion detection systems…

Cryptography and Security · Computer Science 2026-03-25 Islam Debicha , Tayeb Kenaza , Ishak Charfi , Salah Mosbah , Mehdi Sehaki , Jean-Michel Dricot

Instance-level contrastive learning techniques, which rely on data augmentation and a contrastive loss function, have found great success in the domain of visual representation learning. They are not suitable for exploiting the rich…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Martine Toering , Ioannis Gatopoulos , Maarten Stol , Vincent Tao Hu

Face deepfake detection has seen impressive results recently. Nearly all existing deep learning techniques for face deepfake detection are fully supervised and require labels during training. In this paper, we design a novel deepfake…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Sheldon Fung , Xuequan Lu , Chao Zhang , Chang-Tsun Li

As cyberattacks become increasingly sophisticated, advanced Network Intrusion Detection Systems (NIDS) are critical for modern network security. Traditional signature-based NIDS are inadequate against zero-day and evolving attacks. In…

Cryptography and Security · Computer Science 2025-02-24 Benyamin Tafreshian , Shengzhi Zhang

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aritra Ghosh , Andrew Lan

Recently,the detection transformer has gained substantial attention for its inherent minimal post-processing requirement.However,this paradigm relies on abundant training data,yet in the context of the cross-domain adaptation,insufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Ziru Zeng , Yue Ding , Hongtao Lu

Learning discriminative image representations plays a vital role in long-tailed image classification because it can ease the classifier learning in imbalanced cases. Given the promising performance contrastive learning has shown recently in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-29 Peng Wang , Kai Han , Xiu-Shen Wei , Lei Zhang , Lei Wang

Machine learning-based intrusion detection requires complex models to capture patterns in high-dimensional, noisy, and class-imbalanced raw network traffic, yet deploying such models remains impractical on resource-constrained devices with…

Contrastive learning applied to self-supervised representation learning has seen a resurgence in recent years, leading to state of the art performance in the unsupervised training of deep image models. Modern batch contrastive approaches…

Machine Learning · Computer Science 2021-03-12 Prannay Khosla , Piotr Teterwak , Chen Wang , Aaron Sarna , Yonglong Tian , Phillip Isola , Aaron Maschinot , Ce Liu , Dilip Krishnan

Network-based intrusion detection system (NIDS) monitors network traffic for malicious activities, forming the frontline defense against increasing attacks over information infrastructures. Although promising, our quantitative analysis…

Cryptography and Security · Computer Science 2025-05-08 Chenyang Qiu , Yingsheng Geng , Junrui Lu , Kaida Chen , Shitong Zhu , Ya Su , Guoshun Nan , Can Zhang , Junsong Fu , Qimei Cui , Xiaofeng Tao

Smart grid is an alternative solution of the conventional power grid which harnesses the power of the information technology to save the energy and meet today's environment requirements. Due to the inherent vulnerabilities in the…

Cryptography and Security · Computer Science 2020-01-06 Zakaria El Mrabet , Mehdi Ezzari , Hassan Elghazi , Badr Abou El Majd

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

Machine Learning · Computer Science 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Data Distribution Service (DDS) is an innovative approach towards communication in ICS/IoT infrastructure and robotics. Being based on the cross-platform and cross-language API to be applicable in any computerised device, it offers the…

Machine Learning · Computer Science 2021-06-15 Stanislav Abaimov

Navigation through uncontrolled intersections is one of the key challenges for autonomous vehicles. Identifying the subtle differences in hidden traits of other drivers can bring significant benefits when navigating in such environments. We…

Robotics · Computer Science 2022-03-02 Shuijing Liu , Peixin Chang , Haonan Chen , Neeloy Chakraborty , Katherine Driggs-Campbell

Advanced graph neural networks have shown great potentials in graph classification tasks recently. Different from node classification where node embeddings aggregated from local neighbors can be directly used to learn node labels, graph…

Machine Learning · Computer Science 2022-03-16 Hao Jia , Junzhong Ji , Minglong Lei

Anomaly detection is to identify samples that do not conform to the distribution of the normal data. Due to the unavailability of anomalous data, training a supervised deep neural network is a cumbersome task. As such, unsupervised methods…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , John Taylor Jewell , Yalda Mohsenzadeh

As the communication industry has connected distant corners of the globe using advances in network technology, intruders or attackers have also increased attacks on networking infrastructure commensurately. System administrators can attempt…

Cryptography and Security · Computer Science 2012-11-21 Monowar H. Bhuyan , D. K. Bhattacharyya , J. K. Kalita

Network Intrusion Detection Systems (NIDS) play a crucial role in safeguarding network infrastructure against cyberattacks. As the prevalence and sophistication of these attacks increase, machine learning and deep neural network approaches…

Cryptography and Security · Computer Science 2025-08-06 Mabin Umman Varghese , Zahra Taghiyarrenani