English
Related papers

Related papers: Improving Domain Generalization in Self-supervised…

200 papers

Many previous proposals for adversarial training of deep neural nets have included di- rectly modifying the gradient, training on a mix of original and adversarial examples, using contractive penalties, and approximately optimizing…

Machine Learning · Computer Science 2016-08-01 Alexander G. Ororbia , C. Lee Giles , Daniel Kifer

This paper focuses on self-supervised monocular depth estimation in dynamic scenes trained on monocular videos. Existing methods jointly estimate pixel-wise depth and motion, relying mainly on an image reconstruction loss. Dynamic regions1…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Hoang Chuong Nguyen , Tianyu Wang , Jose M. Alvarez , Miaomiao Liu

Image denoising is a critical task in various scientific fields such as medical imaging and material characterization, where the accurate recovery of underlying structures from noisy data is essential. Although supervised denoising…

Image and Video Processing · Electrical Eng. & Systems 2025-02-12 Jianxin Xie , Wonhee Ko , Rui-Xing Zhang , Bing Yao

Adversarial training yields robust models against a specific threat model, e.g., $L_\infty$ adversarial examples. Typically robustness does not generalize to previously unseen threat models, e.g., other $L_p$ norms, or larger perturbations.…

Machine Learning · Computer Science 2020-07-01 David Stutz , Matthias Hein , Bernt Schiele

Robust training methods typically defend against specific attack types, such as Lp attacks with fixed budgets, and rarely account for the fact that defenders may encounter new attacks over time. A natural solution is to adapt the defended…

Machine Learning · Computer Science 2025-02-07 Sihui Dai , Christian Cianfarani , Arjun Bhagoji , Vikash Sehwag , Prateek Mittal

Iris presentation attack detection (PAD) has achieved great success under intra-domain settings but easily degrades on unseen domains. Conventional domain generalization methods mitigate the gap by learning domain-invariant features.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Yachun Li , Jingjing Wang , Yuhui Chen , Di Xie , Shiliang Pu

Existing methods for scale-invariant monocular depth estimation (SI MDE) often struggle due to the complexity of the task, and limited and non-diverse datasets, hindering generalizability in real-world scenarios. This is while…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 S. Mahdi H. Miangoleh , Mahesh Reddy , Yağız Aksoy

Adversarial training (AT) is a prominent technique employed by deep learning models to defend against adversarial attacks, and to some extent, enhance model robustness. However, there are three main drawbacks of the existing AT-based…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 X. Peng , D. Zhou , G. Sun , J. Shi , L. Wu

We propose MaskingDepth, a novel semi-supervised learning framework for monocular depth estimation to mitigate the reliance on large ground-truth depth quantities. MaskingDepth is designed to enforce consistency between the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Jongbeom Baek , Gyeongnyeon Kim , Seonghoon Park , Honggyu An , Matteo Poggi , Seungryong Kim

Enhancing model robustness under new and even adversarial environments is a crucial milestone toward building trustworthy machine learning systems. Current robust training methods such as adversarial training explicitly uses an "attack"…

Machine Learning · Computer Science 2020-12-23 Minhao Cheng , Pin-Yu Chen , Sijia Liu , Shiyu Chang , Cho-Jui Hsieh , Payel Das

We propose a novel data-dependent structured gradient regularizer to increase the robustness of neural networks vis-a-vis adversarial perturbations. Our regularizer can be derived as a controlled approximation from first principles,…

Machine Learning · Statistics 2018-05-23 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

To mitigate the susceptibility of neural networks to adversarial attacks, adversarial training has emerged as a prevalent and effective defense strategy. Intrinsically, this countermeasure incurs a trade-off, as it sacrifices the model's…

Machine Learning · Computer Science 2024-09-19 Hanyi Hu , Qiao Han , Kui Chen , Yao Yang

Recent works have shown that self-supervised learning can achieve remarkable robustness when integrated with adversarial training (AT). However, the robustness gap between supervised AT (sup-AT) and self-supervised AT (self-AT) remains…

Machine Learning · Computer Science 2023-03-06 Rundong Luo , Yifei Wang , Yisen Wang

Adversarial discriminative domain adaptation (ADDA) is an efficient framework for unsupervised domain adaptation in image classification, where the source and target domains are assumed to have the same classes, but no labels are available…

Computer Vision and Pattern Recognition · Computer Science 2019-11-12 Aaron Chadha , Yiannis Andreopoulos

Monocular depth estimation (MDE) is a challenging task in computer vision, often hindered by the cost and scarcity of high-quality labeled datasets. We tackle this challenge using auxiliary datasets from related vision tasks for an…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Alessio Quercia , Erenus Yildiz , Zhuo Cao , Kai Krajsek , Abigail Morrison , Ira Assent , Hanno Scharr

As one of the central tasks in machine learning, regression finds lots of applications in different fields. An existing common practice for solving regression problems is the mean square error (MSE) minimization approach or its regularized…

Machine Learning · Statistics 2022-11-24 Jirong Yi , Qiaosheng Zhang , Zhen Chen , Qiao Liu , Wei Shao , Yusen He , Yaohua Wang

Deep learning has emerged as a leading approach for Automatic Modulation Classification (AMC), demonstrating superior performance over traditional methods. However, vulnerability to adversarial attacks and susceptibility to data…

Machine Learning · Computer Science 2025-11-04 Ali Owfi , Amirmohammad Bamdad , Tolunay Seyfi , Fatemeh Afghah

Self-training based on pseudo-labels has emerged as a dominant approach for addressing conditional distribution shifts in unsupervised domain adaptation (UDA) for semantic segmentation problems. A notable drawback, however, is that this…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Rajshekhar Das , Jonathan Francis , Sanket Vaibhav Mehta , Jean Oh , Emma Strubell , Jose Moura

Applying single image Monocular Depth Estimation (MDE) models to video sequences introduces significant temporal instability and flickering artifacts. We propose a novel approach that adapts any state-of-the-art image-based (depth)…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Ivan Sobko , Hayko Riemenschneider , Markus Gross , Christopher Schroers

Adversarial training enhances neural network robustness but suffers from a tendency to overfit and increased generalization errors on clean data. This work introduces CLAT, an innovative approach that mitigates adversarial overfitting by…

Machine Learning · Computer Science 2024-12-25 Bhavna Gopal , Huanrui Yang , Jingyang Zhang , Mark Horton , Yiran Chen