English
Related papers

Related papers: ALOFT: A Lightweight MLP-like Architecture with Dy…

200 papers

Regularization techniques help prevent overfitting and therefore improve the ability of convolutional neural networks (CNNs) to generalize. One reason for overfitting is the complex co-adaptations among different parts of the network, which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-30 Rinor Cakaj , Jens Mehnert , Bin Yang

Computer vision has flourished in recent years thanks to Deep Learning advancements, fast and scalable hardware solutions and large availability of structured image data. Convolutional Neural Networks trained on supervised tasks with…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Antono D'Innocente

Multi-source unsupervised domain adaptation aims to leverage labeled data from multiple source domains for training a machine learning model to generalize well on a target domain without labels. Source domain selection plays a crucial role…

Machine Learning · Computer Science 2024-11-12 Yao Ma , Samuel Louvan , Zhunxuan Wang

Recent years have witnessed the great success of Graph Neural Networks (GNNs) in handling graph-related tasks. However, MLPs remain the primary workhorse for practical industrial applications due to their desirable inference efficiency and…

Machine Learning · Computer Science 2023-06-06 Lirong Wu , Haitao Lin , Yufei Huang , Tianyu Fan , Stan Z. Li

We consider the problem of test-time domain generalization, where a model is trained on several source domains and adjusted on target domains never seen during training. Different from the common methods that fine-tune the model or adjust…

Machine Learning · Computer Science 2025-02-19 Sameer Ambekar , Zehao Xiao , Xiantong Zhen , Cees G. M. Snoek

In this paper we propose a sequential learning framework for Domain Generalization (DG), the problem of training a model that is robust to domain shift by design. Various DG approaches have been proposed with different motivating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Da Li , Yongxin Yang , Yi-Zhe Song , Timothy Hospedales

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e.,…

Machine Learning · Computer Science 2026-02-03 Jewon Yeom , Kyubyung Chae , Hyunggyu Lim , Yoonna Oh , Dongyoon Yang , Taesup Kim

In semi-supervised domain adaptation (SSDA), the model aims to leverage partially labeled target domain data along with a large amount of labeled source domain data to enhance its generalization capability for the target domain. A key…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Houcheng Su , Mengzhu Wang , Jiao Li , Nan Yin , Liang Yang , Li Shen

Cross-domain crowd counting (CDCC) is a hot topic due to its importance in public safety. The purpose of CDCC is to alleviate the domain shift between the source and target domain. Recently, typical methods attempt to extract…

Computer Vision and Pattern Recognition · Computer Science 2021-01-15 Qi Wang , Tao Han , Junyu Gao , Yuan Yuan

The benefit of localized features within the regular domain has given rise to the use of Convolutional Neural Networks (CNNs) in machine learning, with great proficiency in the image classification. The use of CNNs becomes problematic…

Computer Vision and Pattern Recognition · Computer Science 2016-09-29 Michael Edwards , Xianghua Xie

A central problem in unsupervised domain adaptation is determining what to transfer from labeled source domains to an unlabeled target domain. To handle high-dimensional observations (e.g., images), a line of approaches use deep learning to…

Machine Learning · Computer Science 2026-04-28 Ignavier Ng , Yan Li , Zijian Li , Yujia Zheng , Guangyi Chen , Kun Zhang

Learning generic and robust feature representations with data from multiple domains for the same problem is of great value, especially for the problems that have multiple datasets but none of them are large enough to provide abundant data…

Computer Vision and Pattern Recognition · Computer Science 2016-04-27 Tong Xiao , Hongsheng Li , Wanli Ouyang , Xiaogang Wang

Graph Neural Networks (GNNs) are emerging as powerful tools for nonlinear Model Order Reduction (MOR) of time-dependent parameterized Partial Differential Equations (PDEs). However, existing methodologies struggle to combine geometric…

Machine Learning · Computer Science 2026-01-19 Lorenzo Tomada , Federico Pichi , Gianluigi Rozza

Domain generalization (DG) is the challenging and topical problem of learning models that generalize to novel testing domains with different statistics than a set of known training domains. The simple approach of aggregating data from all…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Da Li , Jianshu Zhang , Yongxin Yang , Cong Liu , Yi-Zhe Song , Timothy M. Hospedales

Current medical image segmentation approaches have limitations in deeply exploring multi-scale information and effectively combining local detail textures with global contextual semantic information. This results in over-segmentation,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Zhenkun Lu , Chaoyin She , Wei Wang , Qinghua Huang

Pre-trained neural language models bring significant improvement for various NLP tasks, by fine-tuning the models on task-specific training sets. During fine-tuning, the parameters are initialized from pre-trained models directly, which…

Computation and Language · Computer Science 2020-09-17 Chengyu Wang , Minghui Qiu , Jun Huang , Xiaofeng He

Recently, neural fields, also known as coordinate-based MLPs, have achieved impressive results in representing low-dimensional data. Unlike CNN, MLPs are globally connected and lack local control; adjusting a local region leads to global…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Yixin Zhuang

Image recognition and generation have long been developed independently of each other. With the recent trend towards general-purpose representation learning, the development of general representations for both recognition and generation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Changyao Tian , Chenxin Tao , Jifeng Dai , Hao Li , Ziheng Li , Lewei Lu , Xiaogang Wang , Hongsheng Li , Gao Huang , Xizhou Zhu

Frequency-domain channel extrapolation is effective in reducing pilot overhead for massive multiple-input multiple-output (MIMO) systems. Recently, Deep learning (DL) based channel extrapolator has become a promising candidate for modeling…

Signal Processing · Electrical Eng. & Systems 2025-05-21 Haoyu Wang , Zhi Sun , Shuangfeng Han , Xiaoyun Wang , Zhaocheng Wang

Domain adaption (DA) and domain generalization (DG) are two closely related methods which are both concerned with the task of assigning labels to an unlabeled data set. The only dissimilarity between these approaches is that DA can access…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan