中文
相关论文

相关论文: PEER pressure: Model-to-Model Regularization for S…

200 篇论文

Source-free domain adaptation (SFDA) aims to adapt a well-trained source model to an unlabelled target domain without accessing the source dataset, making it applicable in a variety of real-world scenarios. Existing SFDA methods ONLY assess…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Longxiang Tang , Kai Li , Chunming He , Yulun Zhang , Xiu Li

Data augmentation is a ubiquitous technique for increasing the size of labeled training sets by leveraging task-specific data transformations that preserve class labels. While it is often easy for domain experts to specify individual…

Dynamic data selection aims to accelerate training with lossless performance. However, reducing training data inherently limits data diversity, potentially hindering generalization. While data augmentation is widely used to enhance…

机器学习 · 计算机科学 2025-05-13 Suorong Yang , Peng Ye , Furao Shen , Dongzhan Zhou

Over-parameterized neural network models often lead to significant performance discrepancies between training and test sets, a phenomenon known as overfitting. To address this, researchers have proposed numerous regularization techniques…

机器学习 · 计算机科学 2025-01-27 RuiZhe Jiang , Haotian Lei

Generalization of neural networks is crucial for deploying them safely in the real world. Common training strategies to improve generalization involve the use of data augmentations, ensembling and model averaging. In this work, we first…

机器学习 · 计算机科学 2023-06-13 Samyak Jain , Sravanti Addepalli , Pawan Sahu , Priyam Dey , R. Venkatesh Babu

Dataset augmentation, the practice of applying a wide array of domain-specific transformations to synthetically expand a training set, is a standard tool in supervised learning. While effective in tasks such as visual recognition, the set…

机器学习 · 统计学 2017-02-21 Terrance DeVries , Graham W. Taylor

Though data augmentation has become a standard component of deep neural network training, the underlying mechanism behind the effectiveness of these techniques remains poorly understood. In practice, augmentation policies are often chosen…

机器学习 · 计算机科学 2020-06-08 Raphael Gontijo-Lopes , Sylvia J. Smullin , Ekin D. Cubuk , Ethan Dyer

Deep neural networks have shown remarkable performance in image classification. However, their performance significantly deteriorates with corrupted input data. Domain generalization methods have been proposed to train robust models against…

计算机视觉与模式识别 · 计算机科学 2024-01-22 Ingyun Lee , Wooju Lee , Hyun Myung

Single Domain Generalization (SDG) aims to develop models capable of generalizing to unseen target domains using only one source domain, a task complicated by substantial domain shifts and limited data diversity. Existing SDG approaches…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Zuyu Zhang , Ning Chen , Yongshan Liu , Qinghua Zhang , Xu Zhang

While deep learning through empirical risk minimization (ERM) has succeeded at achieving human-level performance at a variety of complex tasks, ERM is not robust to distribution shifts or adversarial attacks. Synthetic data augmentation…

Data augmentation is a technique to improve the generalization ability of machine learning methods by increasing the size of the dataset. However, since every augmentation method is not equally effective for every dataset, you need to…

机器学习 · 计算机科学 2022-05-31 Daisuke Oba , Shinnosuke Matsuo , Brian Kenji Iwana

With the increasing utilization of deep learning in outdoor settings, its robustness needs to be enhanced to preserve accuracy in the face of distribution shifts, such as compression artifacts. Data augmentation is a widely used technique…

计算机视觉与模式识别 · 计算机科学 2023-10-03 Shohei Enomoto , Monikka Roslianna Busto , Takeharu Eda

In order to reduce overfitting, neural networks are typically trained with data augmentation, the practice of artificially generating additional training data via label-preserving transformations of existing training examples. While these…

计算机视觉与模式识别 · 计算机科学 2019-01-23 Cecilia Summers , Michael J. Dinneen

Single-source domain generalization (SDG) in medical image segmentation is a challenging yet essential task as domain shifts are quite common among clinical image datasets. Previous attempts most conduct global-only/random augmentation.…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Zixian Su , Kai Yao , Xi Yang , Qiufeng Wang , Jie Sun , Kaizhu Huang

Despite significant advances in deep learning, models often struggle to generalize well to new, unseen domains, especially when training data is limited. To address this challenge, we propose a novel approach for distribution-aware latent…

计算机视觉与模式识别 · 计算机科学 2023-08-29 Ran Liu , Sahil Khose , Jingyun Xiao , Lakshmi Sathidevi , Keerthan Ramnath , Zsolt Kira , Eva L. Dyer

In search of robust and generalizable machine learning models, Domain Generalization (DG) has gained significant traction during the past few years. The goal in DG is to produce models which continue to perform well when presented with data…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Aristotelis Ballas , Christos Diou

Data augmentation is an essential technique in natural language processing (NLP) for enriching training datasets by generating diverse samples. This process is crucial for improving the robustness and generalization capabilities of NLP…

计算与语言 · 计算机科学 2025-10-16 Zaitian Wang , Jinghan Zhang , Xinhao Zhang , Kunpeng Liu , Pengfei Wang , Yuanchun Zhou

There have been growing concerns regarding the out-of-domain generalization ability of natural language processing (NLP) models, particularly in question-answering (QA) tasks. Current synthesized data augmentation methods for QA are…

计算与语言 · 计算机科学 2023-05-19 Yingjie Niu , Linyi Yang , Ruihai Dong , Yue Zhang

Fine-tuning pretrained models is a common practice in domain generalization (DG) tasks. However, fine-tuning is usually computationally expensive due to the ever-growing size of pretrained models. More importantly, it may cause over-fitting…

计算机视觉与模式识别 · 计算机科学 2022-03-10 Ziyue Li , Kan Ren , Xinyang Jiang , Bo Li , Haipeng Zhang , Dongsheng Li

Open-set single-source domain generalization aims to use a single-source domain to learn a robust model that can be generalized to unknown target domains with both domain shifts and label shifts. The scarcity of the source domain and the…

计算机视觉与模式识别 · 计算机科学 2024-11-06 Pengkun Jiao , Na Zhao , Jingjing Chen , Yu-Gang Jiang