English
Related papers

Related papers: Robust Internal Representations for Domain General…

200 papers

Continual learning is an important problem for achieving human-level intelligence in real-world applications as an agent must continuously accumulate knowledge in response to streaming data/tasks. In this work, we consider a general and yet…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jiangwei Xie , Shipeng Yan , Xuming He

Investigation of machine learning algorithms robust to changes between the training and test distributions is an active area of research. In this paper we explore a special type of dataset shift which we call class-dependent domain shift.…

Machine Learning · Computer Science 2020-07-13 Tigran Galstyan , Hrant Khachatrian , Greg Ver Steeg , Aram Galstyan

Domain generalization aims to apply knowledge gained from multiple labeled source domains to unseen target domains. The main difficulty comes from the dataset bias: training data and test data have different distributions, and the training…

Machine Learning · Computer Science 2018-07-24 Ya Li , Mingming Gong , Xinmei Tian , Tongliang Liu , Dacheng Tao

Deep Learning shows very good performance when trained on large labeled data sets. The problem of training a deep net on a few or one sample per class requires a different learning approach which can generalize to unseen classes using only…

Machine Learning · Computer Science 2018-08-23 Jinchao Liu , Stuart J. Gibson , Margarita Osadchy

Continual learning aims to improve the ability of modern learning systems to deal with non-stationary distributions, typically by attempting to learn a series of tasks sequentially. Prior art in the field has largely considered supervised…

Machine Learning · Computer Science 2019-11-01 Dushyant Rao , Francesco Visin , Andrei A. Rusu , Yee Whye Teh , Razvan Pascanu , Raia Hadsell

The need to address the scarcity of task-specific annotated data has resulted in concerted efforts in recent years for specific settings such as zero-shot learning (ZSL) and domain generalization (DG), to separately address the issues of…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Shivam Chandhok , Sanath Narayan , Hisham Cholakkal , Rao Muhammad Anwer , Vineeth N Balasubramanian , Fahad Shahbaz Khan , Ling Shao

Pretrained encoders for mathematical texts have achieved significant improvements on various tasks such as formula classification and information retrieval. Yet they remain limited in representing and capturing student strategies for entire…

Computers and Society · Computer Science 2026-04-13 Siddhartha Pradhan , Ethan Prihar , Erin Ottmar

In this paper, we study transfer learning for the PI and NLI problems, aiming to propose a general framework, which can effectively and efficiently adapt the shared knowledge learned from a resource-rich source domain to a resource- poor…

Computation and Language · Computer Science 2017-11-27 Jianfei Yu , Minghui Qiu , Jing Jiang , Jun Huang , Shuangyong Song , Wei Chu , Haiqing Chen

Learning systems often expand their ambient features or latent representations over time, embedding earlier representations into larger spaces with limited new latent structure. We study transfer learning for structured matrix estimation…

Machine Learning · Computer Science 2026-01-30 Jinhang Chai , Xuyuan Liu , Elynn Chen , Yujun Yan

Domain generalization (DG) is a branch of transfer learning that aims to train the learning models on several seen domains and subsequently apply these pre-trained models to other unseen (unknown but related) domains. To deal with…

Machine Learning · Computer Science 2022-10-28 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

The data-driven approach to robot control has been gathering pace rapidly, yet generalization to unseen task domains remains a critical challenge. We argue that the key to generalization is representations that are (i) rich enough to…

Robotics · Computer Science 2023-12-05 Bo Ai , Zhanxin Wu , David Hsu

Domain generalization (DG) strives to address distribution shifts across diverse environments to enhance model's generalizability. Current DG approaches are confined to acquiring robust representations with continuous features, specifically…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Shaocong Long , Qianyu Zhou , Xikun Jiang , Chenhao Ying , Lizhuang Ma , Yuan Luo

Understanding how information propagates in real-life complex networks yields a better understanding of dynamic processes such as misinformation or epidemic spreading. The recently introduced branch of machine learning methods for learning…

Social and Information Networks · Computer Science 2023-02-21 Sebastian Mežnar , Nada Lavrač , Blaž Škrlj

This work proposes a robust Partial Domain Adaptation (PDA) framework that mitigates the negative transfer problem by incorporating a robust target-supervision strategy. It leverages ensemble learning and includes diverse, complementary…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Sandipan Choudhuri , Suli Adeniye , Arunabha Sen

Representation learning with small labeled data have emerged in many problems, since the success of deep neural networks often relies on the availability of a huge amount of labeled data that is expensive to collect. To address it, many…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Guo-Jun Qi , Jiebo Luo

Unsupervised domain adaptation is effective in leveraging the rich information from the source domain to the unsupervised target domain. Though deep learning and adversarial strategy make an important breakthrough in the adaptability of…

Machine Learning · Computer Science 2020-03-02 You-Wei Luo , Chuan-Xian Ren , Pengfei Ge , Ke-Kun Huang , Yu-Feng Yu

When machine learning models are deployed on a test distribution different from the training distribution, they can perform poorly, but overestimate their performance. In this work, we aim to better estimate a model's performance under…

Machine Learning · Computer Science 2020-07-08 Ching-Yao Chuang , Antonio Torralba , Stefanie Jegelka

Deep reinforcement learning has recently seen huge success across multiple areas in the robotics domain. Owing to the limitations of gathering real-world data, i.e., sample inefficiency and the cost of collecting it, simulation environments…

Machine Learning · Computer Science 2021-07-09 Wenshuai Zhao , Jorge Peña Queralta , Tomi Westerlund

In this paper, a unified approach is presented to transfer learning that addresses several source and target domain label-space and annotation assumptions with a single model. It is particularly effective in handling a challenging case,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Xiaobin Chang , Yongxin Yang , Tao Xiang , Timothy M. Hospedales

In this paper, we work on a sound recognition system that continually incorporates new sound classes. Our main goal is to develop a framework where the model can be updated without relying on labeled data. For this purpose, we propose…

Audio and Speech Processing · Electrical Eng. & Systems 2023-01-11 Zhepei Wang , Cem Subakan , Xilin Jiang , Junkai Wu , Efthymios Tzinis , Mirco Ravanelli , Paris Smaragdis