English
Related papers

Related papers: Improving Domain Generalization in Self-supervised…

200 papers

Recent studies demonstrate that deep networks, even robustified by the state-of-the-art adversarial training (AT), still suffer from large robust generalization gaps, in addition to the much more expensive training costs than standard…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Tianlong Chen , Zhenyu Zhang , Pengjun Wang , Santosh Balachandra , Haoyu Ma , Zehao Wang , Zhangyang Wang

Recent advancements in artificial intelligence, particularly deep neural networks, have pushed the boundaries of what is achievable in complex tasks. Traditional methods for training neural networks in classification problems often rely on…

Machine Learning · Computer Science 2024-09-10 Jaouad Dabounou

Despite the recent advancement in speech emotion recognition (SER) within a single corpus setting, the performance of these SER systems degrades significantly for cross-corpus and cross-language scenarios. The key reason is the lack of…

Sound · Computer Science 2022-04-20 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Björn Schuller

We present a novel unsupervised learning framework for single view depth estimation using monocular videos. It is well known in 3D vision that enlarging the baseline can increase the depth estimation accuracy, and jointly optimizing a set…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Lipu Zhou , Jiamin Ye , Montiel Abello , Shengze Wang , Michael Kaess

Deep neural networks can be easily fooled into making incorrect predictions through corruption of the input by adversarial perturbations: human-imperceptible artificial noise. So far adversarial training has been the most successful defense…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Lin Li , Michael Spratling

Self-supervised learning is the key to unlocking generic computer vision systems. By eliminating the reliance on ground-truth annotations, it allows scaling to much larger data quantities. Unfortunately, self-supervised monocular depth…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Jaime Spencer , Chris Russell , Simon Hadfield , Richard Bowden

Despite being highly over-parametrized, and having the ability to fully interpolate the training data, deep networks are known to generalize well to unseen data. It is now understood that part of the reason for this is that the training…

Machine Learning · Computer Science 2023-02-21 Danil Akhtiamov , Babak Hassibi

Deep neural networks achieve stellar generalisation on a variety of problems, despite often being large enough to easily fit all their training data. Here we study the generalisation dynamics of two-layer neural networks in a…

Machine Learning · Statistics 2019-06-21 Sebastian Goldt , Madhu S. Advani , Andrew M. Saxe , Florent Krzakala , Lenka Zdeborová

Semi-supervised domain adaptation (SSDA) is quite a challenging problem requiring methods to overcome both 1) overfitting towards poorly annotated data and 2) distribution shift across domains. Unfortunately, a simple combination of domain…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Can Qin , Lichen Wang , Qianqian Ma , Yu Yin , Huan Wang , Yun Fu

Adversarial training is the most effective defense against adversarial attacks. The effectiveness of the adversarial attacks has been on the design of its loss function and regularization term. The most widely used loss function in…

Machine Learning · Computer Science 2025-10-08 Zhenyu Liu , Varun Ojha

As adversarial attacks continue to evolve, defense models face the risk of recurrent vulnerabilities, underscoring the importance of continuous adversarial training (CAT). Existing CAT approaches typically balance decision boundaries by…

Cryptography and Security · Computer Science 2025-09-29 Wenxuan Wang , Chenglei Wang , Xuelin Qian

While monocular depth estimation (MDE) is an important problem in computer vision, it is difficult due to the ambiguity that results from the compression of a 3D scene into only 2 dimensions. It is common practice in the field to treat it…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Dylan Auty , Krystian Mikolajczyk

Self-supervised monocular depth estimation (SS-MDE) has the potential to scale to vast quantities of data. Unfortunately, existing approaches limit themselves to the automotive domain, resulting in models incapable of generalizing to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Jaime Spencer , Chris Russell , Simon Hadfield , Richard Bowden

Despite the rapid progress of neural networks, they remain highly vulnerable to adversarial examples, for which adversarial training (AT) is currently the most effective defense. While AT has been extensively studied, its practical…

Machine Learning · Computer Science 2025-10-16 Yisen Wang , Yichuan Mo , Hongjun Wang , Junyi Li , Zhouchen Lin

It is known that Deep Neural networks (DNNs) are vulnerable to adversarial attacks, and the adversarial robustness of DNNs could be improved by adding adversarial noises to training data (e.g., the standard adversarial training (SAT)).…

Image and Video Processing · Electrical Eng. & Systems 2022-06-23 Linhai Ma , Liang Liang

Deep convolutional neural networks have considerably improved state-of-the-art results for semantic segmentation. Nevertheless, even modern architectures lack the ability to generalize well to a test dataset that originates from a different…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Robert A. Marsden , Alexander Bartler , Mario Döbler , Bin Yang

Many successful methods to learn dynamical systems from data have recently been introduced. However, ensuring that the inferred dynamics preserve known constraints, such as conservation laws or restrictions on the allowed system states,…

Machine Learning · Computer Science 2024-02-16 Alistair White , Niki Kilbertus , Maximilian Gelbrecht , Niklas Boers

Domain Generalization (DG) aims to train models that can generalize to unseen testing domains by leveraging data from multiple training domains. However, traditional DG methods rely on the availability of multiple diverse training domains,…

Machine Learning · Computer Science 2025-03-11 Hao Yan , Marzi Heidari , Yuhong Guo

Adversarial training (AT) aims to improve the robustness of deep learning models by mixing clean data and adversarial examples (AEs). Most existing AT approaches can be grouped into restricted and unrestricted approaches. Restricted AT…

Machine Learning · Computer Science 2020-04-14 Haidong Xie , Xueshuang Xiang , Naijin Liu , Bin Dong

Adversarial attacks pose significant challenges for vision models in critical fields like healthcare, where reliability is essential. Although adversarial training has been well studied in natural images, its application to biomedical and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Hashmat Shadab Malik , Shahina Kunhimon , Muzammal Naseer , Fahad Shahbaz Khan , Salman Khan