中文
相关论文

相关论文: PLACE dropout: A Progressive Layer-wise and Channe…

200 篇论文

Deep neural networks are learning models with a very high capacity and therefore prone to over-fitting. Many regularization techniques such as Dropout, DropConnect, and weight decay all attempt to solve the problem of over-fitting by…

机器学习 · 计算机科学 2016-12-06 Armen Aghajanyan

Dropout is a powerful and widely used technique to regularize the training of deep neural networks. In this paper, we introduce a simple regularization strategy upon dropout in model training, namely R-Drop, which forces the output…

机器学习 · 计算机科学 2021-11-01 Xiaobo Liang , Lijun Wu , Juntao Li , Yue Wang , Qi Meng , Tao Qin , Wei Chen , Min Zhang , Tie-Yan Liu

Frequency-domain channel extrapolation is effective in reducing pilot overhead for massive multiple-input multiple-output (MIMO) systems. Recently, Deep learning (DL) based channel extrapolator has become a promising candidate for modeling…

信号处理 · 电气工程与系统科学 2025-05-21 Haoyu Wang , Zhi Sun , Shuangfeng Han , Xiaoyun Wang , Zhaocheng Wang

Clustering-based approach has proved effective in dealing with unsupervised domain adaptive person re-identification (ReID) tasks. However, existing works along this approach still suffer from noisy pseudo labels and the unreliable…

计算机视觉与模式识别 · 计算机科学 2022-01-26 Chunren Tang , Dingyu Xue , Dongyue Chen

Domain generalization (DG) is proposed to deal with the issue of domain shift, which occurs when statistical differences exist between source and target domains. However, most current methods do not account for a common realistic scenario…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Xiran Wang , Jian Zhang , Lei Qi , Yinghuan Shi

Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to…

计算机视觉与模式识别 · 计算机科学 2020-03-16 Kaiyang Zhou , Yongxin Yang , Timothy Hospedales , Tao Xiang

Diabetic Retinopathy (DR) constitutes 5% of global blindness cases. While numerous deep learning approaches have sought to enhance traditional DR grading methods, they often falter when confronted with new out-of-distribution data thereby…

图像与视频处理 · 电气工程与系统科学 2024-11-06 Sharon Chokuwa , Muhammad Haris Khan

In this paper we propose a sequential learning framework for Domain Generalization (DG), the problem of training a model that is robust to domain shift by design. Various DG approaches have been proposed with different motivating…

计算机视觉与模式识别 · 计算机科学 2020-04-06 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy Hospedales

Large neural networks are often overparameterised and prone to overfitting, Dropout is a widely used regularization technique to combat overfitting and improve model generalization. However, unstructured Dropout is not always effective for…

机器学习 · 计算机科学 2022-10-07 Yiren Zhao , Oluwatomisin Dada , Xitong Gao , Robert D Mullins

Improving model's generalizability against domain shifts is crucial, especially for safety-critical applications such as autonomous driving. Real-world domain styles can vary substantially due to environment changes and sensor noises, but…

计算机视觉与模式识别 · 计算机科学 2022-11-10 Qi Fan , Mattia Segu , Yu-Wing Tai , Fisher Yu , Chi-Keung Tang , Bernt Schiele , Dengxin Dai

Most deep architectures for image classification--even those that are trained to classify a large number of diverse categories--learn shared image representations with a single model. Intuitively, however, categories that are more similar…

计算机视觉与模式识别 · 计算机科学 2018-03-20 Calvin Murdock , Zhen Li , Howard Zhou , Tom Duerig

Regularization techniques help prevent overfitting and therefore improve the ability of convolutional neural networks (CNNs) to generalize. One reason for overfitting is the complex co-adaptations among different parts of the network, which…

计算机视觉与模式识别 · 计算机科学 2024-09-30 Rinor Cakaj , Jens Mehnert , Bin Yang

Domain generalization is a technique aimed at enabling models to maintain high accuracy when applied to new environments or datasets (unseen domains) that differ from the datasets used in training. Generally, the accuracy of models trained…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Reiji Saito , Kazuhiro Hotta

Adversarial training has been proven to be a powerful regularization method to improve the generalization of models. However, current adversarial training methods only attack the original input sample or the embedding vectors, and their…

机器学习 · 计算机科学 2021-08-31 Shiwen Ni , Jiawen Li , Hung-Yu Kao

Although recent advances in machine learning have shown its success to learn from independent and identically distributed (IID) data, it is vulnerable to out-of-distribution (OOD) data in an open world. Domain generalization (DG) deals with…

机器学习 · 计算机科学 2024-05-14 Thai-Hoang Pham , Xueru Zhang , Ping Zhang

Different techniques have emerged in the deep learning scenario, such as Convolutional Neural Networks, Deep Belief Networks, and Long Short-Term Memory Networks, to cite a few. In lockstep, regularization methods, which aim to prevent…

机器学习 · 计算机科学 2020-07-28 Claudio Filipi Goncalves do Santos , Danilo Colombo , Mateus Roder , João Paulo Papa

Domain adaption (DA) and domain generalization (DG) are two closely related methods which are both concerned with the task of assigning labels to an unlabeled data set. The only dissimilarity between these approaches is that DA can access…

计算机视觉与模式识别 · 计算机科学 2018-12-27 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

Machine learning models that can generalize to unseen domains are essential when applied in real-world scenarios involving strong domain shifts. We address the challenging domain generalization (DG) problem, where a model trained on a set…

机器学习 · 计算机科学 2022-10-04 Ahmed Frikha , Denis Krompaß , Volker Tresp

Point-cloud-based 3D object detection suffers from performance degradation when encountering data with novel domain gaps. To tackle it, the single-domain generalization (SDG) aims to generalize the detection model trained in a limited…

计算机视觉与模式识别 · 计算机科学 2024-02-29 Shuangzhi Li , Lei Ma , Xingyu Li

Domain adaptation (DA) and domain generalization (DG) have emerged as a solution to the domain shift problem where the distribution of the source and target data is different. The task of DG is more challenging than DA as the target data is…

计算机视觉与模式识别 · 计算机科学 2019-12-02 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan