中文
相关论文

相关论文: PEER pressure: Model-to-Model Regularization for S…

200 篇论文

As a recent noticeable topic, domain generalization (DG) aims to first learn a generic model on multiple source domains and then directly generalize to an arbitrary unseen target domain without any additional adaption. In previous DG…

计算机视觉与模式识别 · 计算机科学 2022-02-17 Yue Wang , Lei Qi , Yinghuan Shi , Yang Gao

Data augmentation is a widely used trick when training deep neural networks: in addition to the original data, properly transformed data are also added to the training set. However, to the best of our knowledge, a clear mathematical…

机器学习 · 统计学 2020-11-10 Shuxiao Chen , Edgar Dobriban , Jane H Lee

Data augmentation is a widely adopted technique utilized to improve the robustness of automatic speech recognition (ASR). Employing a fixed data augmentation strategy for all training data is a common practice. However, it is important to…

声音 · 计算机科学 2024-12-03 Hongxuan Lu , Biao Li

Varying data augmentation policies and regularization over the course of optimization has led to performance improvements over using fixed values. We show that population based training is a useful tool to continuously search those…

计算与语言 · 计算机科学 2020-10-09 Daniel Haziza , Jérémy Rapin , Gabriel Synnaeve

Despite being very powerful in standard learning settings, deep learning models can be extremely brittle when deployed in scenarios different from those on which they were trained. Domain generalization methods investigate this problem and…

计算机视觉与模式识别 · 计算机科学 2021-01-28 Francesco Cappio Borlino , Antonio D'Innocente , Tatiana Tommasi

We address the Unsupervised Domain Adaptation (UDA) problem in image classification from a new perspective. In contrast to most existing works which either align the data distributions or learn domain-invariant features, we directly learn a…

计算机视觉与模式识别 · 计算机科学 2020-12-03 Qian Wang , Fanlin Meng , Toby P. Breckon

Fine-tuning diffusion models via online reinforcement learning (RL) has shown great potential for enhancing text-to-image alignment. However, since precisely specifying a ground-truth objective for visual tasks remains challenging, the…

机器学习 · 计算机科学 2026-01-01 Haoran He , Yuxiao Ye , Jie Liu , Jiajun Liang , Zhiyong Wang , Ziyang Yuan , Xintao Wang , Hangyu Mao , Pengfei Wan , Ling Pan

Deep neural networks have become popular in many supervised learning tasks, but they may suffer from overfitting when the training dataset is limited. To mitigate this, many researchers use data augmentation, which is a widely used and…

机器学习 · 计算机科学 2022-05-27 Jianhan Wu , Shijing Si , Jianzong Wang , Jing Xiao

Acoustic environments affect acoustic characteristics of sound to be recognized by physically interacting with sound wave propagation. Thus, training acoustic models for audio and speech tasks requires regularization on various acoustic…

音频与语音处理 · 电气工程与系统科学 2022-02-08 Hyeonuk Nam , Seong-Hu Kim , Yong-Hwa Park

Deep Neural Networks are well known for efficiently fitting training data, yet experiencing poor generalization capabilities whenever some kind of bias dominates over the actual task labels, resulting in models learning "shortcuts". In…

机器学习 · 计算机科学 2024-08-12 Pietro Morerio , Ruggero Ragonesi , Vittorio Murino

Single domain generalization aims to enhance the ability of the model to generalize to unknown domains when trained on a single source domain. However, the limited diversity in the training data hampers the learning of domain-invariant…

计算机视觉与模式识别 · 计算机科学 2024-06-10 Dongjia Zhao , Lei Qi , Xiao Shi , Yinghuan Shi , Xin Geng

The distribution shifts between training and test data typically undermine the performance of models. In recent years, lots of work pays attention to domain generalization (DG) where distribution shifts exist, and target data are unseen.…

机器学习 · 计算机科学 2024-01-05 Wang Lu , Jindong Wang , Yidong Wang , Xing Xie

Dataset Distillation (DD), a newly emerging field, aims at generating much smaller but efficient synthetic training datasets from large ones. Existing DD methods based on gradient matching achieve leading performance; however, they are…

机器学习 · 计算机科学 2023-04-18 Lei Zhang , Jie Zhang , Bowen Lei , Subhabrata Mukherjee , Xiang Pan , Bo Zhao , Caiwen Ding , Yao Li , Dongkuan Xu

Domain generalization (DG) tends to alleviate the poor generalization capability of deep neural networks by learning model with multiple source domains. A classical solution to DG is domain augmentation, the common belief of which is that…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Fangrui Lv , Jian Liang , Shuang Li , Jinming Zhang , Di Liu

Graph Contrastive Learning (GCL) has demonstrated remarkable effectiveness in learning representations on graphs in recent years. To generate ideal augmentation views, the augmentation generation methods should preserve essential…

机器学习 · 计算机科学 2024-09-06 Kaiqi Yang , Haoyu Han , Wei Jin , Hui Liu

Few-shot named entity recognition (NER) has shown remarkable progress in identifying entities in low-resource domains. However, few-shot NER methods still struggle with out-of-domain (OOD) examples due to their reliance on manual labeling…

信息检索 · 计算机科学 2023-10-17 Zihan Wang , Ziqi Zhao , Zhumin Chen , Pengjie Ren , Maarten de Rijke , Zhaochun Ren

Due to the scarcity of publicly available diarization data, the model performance can be improved by training a single model with data from different domains. In this work, we propose to incorporate domain information to train a single…

声音 · 计算机科学 2023-12-13 Ivan Fung , Lahiru Samarakoon , Samuel J. Broughton

State-of-the-art stereo matching (SM) models trained on synthetic data often fail to generalize to real data domains due to domain differences, such as color, illumination, contrast, and texture. To address this challenge, we leverage data…

计算机视觉与模式识别 · 计算机科学 2025-08-05 Shuangli Du , Jing Wang , Minghua Zhao , Zhenyu Xu , Jie Li

Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for domain…

机器学习 · 计算机科学 2022-06-17 Wenyu Zhang , Mohamed Ragab , Chuan-Sheng Foo

Domain generalization is the problem of machine learning when the training data and the test data come from different data domains. We present a simple theoretical model of learning to generalize across domains in which there is a…

机器学习 · 计算机科学 2020-02-14 Vikas K. Garg , Adam Kalai , Katrina Ligett , Zhiwei Steven Wu