English
Related papers

Related papers: Using Multiple Self-Supervised Tasks Improves Mode…

200 papers

As the adoption of machine learning models increases, ensuring robust models against adversarial attacks is increasingly important. With unsupervised machine learning gaining more attention, ensuring it is robust against attacks is vital.…

Machine Learning · Computer Science 2023-06-02 Mathias Lundteigen Mohus , Jinyue Li

Deep neural networks have demonstrated high accuracy in image classification tasks. However, they were shown to be weak against adversarial examples: a small perturbation in the image which changes the classification output dramatically. In…

Machine Learning · Computer Science 2018-11-06 David Vigouroux , Sylvain Picard

Single-image super-resolution aims to generate a high-resolution version of a low-resolution image, which serves as an essential component in many computer vision applications. This paper investigates the robustness of deep learning-based…

Computer Vision and Pattern Recognition · Computer Science 2019-10-03 Jun-Ho Choi , Huan Zhang , Jun-Hyuk Kim , Cho-Jui Hsieh , Jong-Seok Lee

Deep neural networks are proven to be vulnerable to fine-designed adversarial examples, and adversarial defense algorithms draw more and more attention nowadays. Pre-processing based defense is a major strategy, as well as learning robust…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Decheng Liu , Tao Chen , Chunlei Peng , Nannan Wang , Ruimin Hu , Xinbo Gao

Self-supervised learning (SSL) has advanced significantly in visual representation learning, yet comprehensive evaluations of its adversarial robustness remain limited. In this study, we evaluate the adversarial robustness of seven…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Ömer Veysel Çağatan , Ömer Faruk Tal , M. Emre Gürsoy

Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Silvia Bucci , Antonio D'Innocente , Yujun Liao , Fabio Maria Carlucci , Barbara Caputo , Tatiana Tommasi

Endowing robots with the human ability to learn a growing set of skills over the course of a lifetime as opposed to mastering single tasks is an open problem in robot learning. While multi-task learning approaches have been proposed to…

Robotics · Computer Science 2023-09-19 Muhammad Burhan Hafez , Stefan Wermter

Super-resolution reconstruction is aimed at generating images of high spatial resolution from low-resolution observations. State-of-the-art super-resolution techniques underpinned with deep learning allow for obtaining results of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Maciej Zyrek , Michal Kawulok

State-of-the-art deep neural networks (DNNs) have been proved to have excellent performance on unsupervised domain adaption (UDA). However, recent work shows that DNNs perform poorly when being attacked by adversarial samples, where these…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Liyuan Zhang , Yuhang Zhou , Lei Zhang

As the range of tasks performed by a general vision system expands, executing multiple tasks accurately and efficiently in a single network has become an important and still open problem. Recent computer vision approaches address this…

Machine Learning · Computer Science 2020-11-02 Hila Levi , Shimon Ullman

Recent methods in self-supervised learning have demonstrated that masking-based pretext tasks extend beyond NLP, serving as useful pretraining objectives in computer vision. However, existing approaches apply random or ad hoc masking…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Dylan Sam , Min Bai , Tristan McKinney , Li Erran Li

Self-supervised learning in computer vision aims to leverage the inherent structure and relationships within data to learn meaningful representations without explicit human annotation, enabling a holistic understanding of visual scenes.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Prakash Chandra Chhipa , Johan Rodahl Holmgren , Kanjar De , Rajkumar Saini , Marcus Liwicki

Self-supervised feature representations have been shown to be useful for supervised classification, few-shot learning, and adversarial robustness. We show that features obtained using self-supervised learning are comparable to, or better…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Isabela Albuquerque , Nikhil Naik , Junnan Li , Nitish Keskar , Richard Socher

Deep networks consume a large amount of memory by their nature. A natural question arises can we reduce that memory requirement whilst maintaining performance. In particular, in this work we address the problem of memory efficient learning…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Eunwoo Kim , Chanho Ahn , Philip H. S. Torr , Songhwai Oh

Deep Neural Networks are vulnerable to adversarial examples, i.e., carefully crafted input samples that can cause models to make incorrect predictions with high confidence. To mitigate these vulnerabilities, adversarial training and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Francesco Villani , Igor Maljkovic , Dario Lazzaro , Angelo Sotgiu , Antonio Emanuele Cinà , Fabio Roli

While current approaches for neural network training often aim at improving performance, less focus is put on training methods aiming at robustness towards varying noise conditions or directed attacks by adversarial examples. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Marvin Klingner , Andreas Bär , Tim Fingscheidt

Deep neural networks (DNNs) have accomplished impressive success in various applications, including autonomous driving perception tasks, in recent years. On the other hand, current deep neural networks are easily fooled by adversarial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Ibrahim Sobh , Ahmed Hamed , Varun Ravi Kumar , Senthil Yogamani

As a subset of unsupervised representation learning, self-supervised representation learning adopts self-defined signals as supervision and uses the learned representation for downstream tasks, such as object detection and image captioning.…

Machine Learning · Computer Science 2021-03-24 Yao-Hung Hubert Tsai , Yue Wu , Ruslan Salakhutdinov , Louis-Philippe Morency

In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes. However, its…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Vladan Stojnić , Vladimir Risojević

Self-supervised learning of convolutional neural networks can harness large amounts of cheap unlabeled data to train powerful feature representations. As surrogate task, we jointly address ordering of visual data in the spatial and temporal…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Uta Büchler , Biagio Brattoli , Björn Ommer