English
Related papers

Related papers: Boosting Binary Masks for Multi-Domain Learning th…

200 papers

We present a low-rank transformation approach to compensate for face variations due to changes in visual domains, such as pose and illumination. The key idea is to learn discriminative linear transformations for face images using matrix…

Computer Vision and Pattern Recognition · Computer Science 2013-08-02 Qiang Qiu , Guillermo Sapiro , Ching-Hui Chen

The self-supervised objective of masking-and-predicting has led to promising performance gains on a variety of downstream tasks. However, while most approaches randomly mask tokens, there is strong intuition that deciding what to mask can…

Multi-task learning aims to improve generalization performance of multiple prediction tasks by appropriately sharing relevant information across them. In the context of deep neural networks, this idea is often realized by hand-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Yongxi Lu , Abhishek Kumar , Shuangfei Zhai , Yu Cheng , Tara Javidi , Rogerio Feris

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Prompt tuning and adapter tuning have shown great potential in transferring pre-trained vision-language models (VLMs) to various downstream tasks. In this work, we design a new type of tuning method, termed as regularized mask tuning, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Kecheng Zheng , Wei Wu , Ruili Feng , Kai Zhu , Jiawei Liu , Deli Zhao , Zheng-Jun Zha , Wei Chen , Yujun Shen

We propose a simple but effective multi-source domain generalization technique based on deep neural networks by incorporating optimized normalization layers that are specific to individual domains. Our approach employs multiple…

Machine Learning · Computer Science 2020-07-22 Seonguk Seo , Yumin Suh , Dongwan Kim , Geeho Kim , Jongwoo Han , Bohyung Han

In this paper, we consider domain-invariant deep learning by explicitly modeling domain shifts with only a small amount of domain-specific parameters in a Convolutional Neural Network (CNN). By exploiting the observation that a…

Machine Learning · Computer Science 2020-09-30 Ze Wang , Xiuyuan Cheng , Guillermo Sapiro , Qiang Qiu

Hard parameter sharing in multi-domain learning (MDL) allows domains to share some of the model parameters to reduce storage cost while improving prediction accuracy. One common sharing practice is to share the bottom layers of a deep…

Machine Learning · Computer Science 2022-03-22 Lijun Zhang , Qizheng Yang , Xiao Liu , Hui Guan

The past year has witnessed a rapid development of masked image modeling (MIM). MIM is mostly built upon the vision transformers, which suggests that self-supervised visual representations can be done by masking input image parts while…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yunjie Tian , Lingxi Xie , Jiemin Fang , Mengnan Shi , Junran Peng , Xiaopeng Zhang , Jianbin Jiao , Qi Tian , Qixiang Ye

We present a novel and unified deep learning framework which is capable of learning domain-invariant representation from data across multiple domains. Realized by adversarial training with additional ability to exploit domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Alexander H. Liu , Yen-Cheng Liu , Yu-Ying Yeh , Yu-Chiang Frank Wang

The incorporation of prior knowledge into learning is essential in achieving good performance based on small noisy samples. Such knowledge is often incorporated through the availability of related data arising from domains and tasks similar…

Machine Learning · Statistics 2026-02-24 Baruch Epstein , Ron Meir , Tomer Michaeli

Supervised learning algorithms trained on medical images will often fail to generalize across changes in acquisition parameters. Recent work in domain adaptation addresses this challenge and successfully leverages labeled data in a source…

In this paper, we consider domain-adaptive imitation learning with visual observation, where an agent in a target domain learns to perform a task by observing expert demonstrations in a source domain. Domain adaptive imitation learning…

Machine Learning · Computer Science 2023-12-04 Sungho Choi , Seungyul Han , Woojun Kim , Jongseong Chae , Whiyoung Jung , Youngchul Sung

Multi-task learning aims to acquire a set of functions, either regressors or classifiers, that perform well for diverse tasks. At its core, the idea behind multi-task learning is to exploit the intrinsic similarity across data sources to…

Machine Learning · Computer Science 2022-10-28 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Training CNNs from scratch on new domains typically demands large numbers of labeled images and computations, which is not suitable for low-power hardware. One way to reduce these requirements is to modularize the CNN architecture and…

Machine Learning · Computer Science 2021-10-22 Himanshu Pradeep Aswani , Abhiraj Sunil Kanse , Shubhang Bhatnagar , Amit Sethi

Domain generalization aims to develop models that are robust to distribution shifts. Existing methods focus on learning invariance across domains to enhance model robustness, and data augmentation has been widely used to learn invariant…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Yingnan Liu , Yingtian Zou , Rui Qiao , Fusheng Liu , Mong Li Lee , Wynne Hsu

This paper proposes a joint multi-task learning algorithm to better predict attributes in images using deep convolutional neural networks (CNN). We consider learning binary semantic attributes through a multi-task CNN model, where each CNN…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Abrar H. Abdulnabi , Gang Wang , Jiwen Lu , Kui Jia

Augmentation-based self-supervised learning methods have shown remarkable success in self-supervised visual representation learning, excelling in learning invariant features but often neglecting equivariant ones. This limitation reduces the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Qin Wang , Kai Krajsek , Hanno Scharr

Domain adaptation for semantic image segmentation is very necessary since manually labeling large datasets with pixel-level labels is expensive and time consuming. Existing domain adaptation techniques either work on limited datasets, or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Yunsheng Li , Lu Yuan , Nuno Vasconcelos

Binary representation is desirable for its memory efficiency, computation speed and robustness. In this paper, we propose adjustable bounded rectifiers to learn binary representations for deep neural networks. While hard constraining…

Machine Learning · Computer Science 2015-11-20 Zhirong Wu , Dahua Lin , Xiaoou Tang