English
Related papers

Related papers: Domain-Agnostic Neural Architecture for Class Incr…

200 papers

In Multi-Source Domain Adaptation (MSDA), models are trained on samples from multiple source domains and used for inference on a different, target, domain. Mainstream domain adaptation approaches learn a joint representation of source and…

Machine Learning · Computer Science 2020-10-21 Ohad Amosy , Gal Chechik

Although neural machine translation (NMT) models perform well in the general domain, it remains rather challenging to control their generation behavior to satisfy the requirement of different users. Given the expensive training cost and the…

Computation and Language · Computer Science 2024-03-22 Yuzhuang Xu , Shuo Wang , Peng Li , Xuebo Liu , Xiaolong Wang , Weidong Liu , Yang Liu

With the growing adoption of Large Language Model (LLM) agents in persistent, real-world roles, they naturally encounter continuous streams of tasks and inevitable failures. A key limitation, however, is their inability to systematically…

Computation and Language · Computer Science 2026-01-19 Xuanbo Su , Yingfang Zhang , Hao Luo , Xiaoteng Liu , Leo Huang

Current methods for developing foundation models in medical image segmentation rely on two primary assumptions: a fixed set of classes and the immediate availability of a substantial and diverse training dataset. However, this can be…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Xiaoyang Chen , Hao Zheng , Yifang Xie , Yuncong Ma , Tengfei Li

Neural networks have demonstrated significant accuracy across various domains, yet their vulnerability to subtle input alterations remains a persistent challenge. Conventional methods like data augmentation, while effective to some extent,…

Machine Learning · Computer Science 2023-11-20 Shashank Kotyan , Danilo Vasconcellos Vargas

Continual learning is an important problem for achieving human-level intelligence in real-world applications as an agent must continuously accumulate knowledge in response to streaming data/tasks. In this work, we consider a general and yet…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Jiangwei Xie , Shipeng Yan , Xuming He

Despite its flexibility to learn diverse inductive biases in machine learning programs, meta learning (i.e., learning to learn) has long been recognized to suffer from poor scalability due to its tremendous compute/memory costs, training…

Machine Learning · Computer Science 2023-10-24 Sang Keun Choe , Sanket Vaibhav Mehta , Hwijeen Ahn , Willie Neiswanger , Pengtao Xie , Emma Strubell , Eric Xing

In many real-world settings, regulations and economic incentives permit the sharing of models but not data across institutional boundaries. In such scenarios, practitioners might hope to adapt models to new domains, without losing…

Machine Learning · Computer Science 2025-08-29 Yewon Byun , Sanket Vaibhav Mehta , Saurabh Garg , Emma Strubell , Michael Oberst , Bryan Wilder , Zachary C. Lipton

Prior Unsupervised Domain Adaptation (UDA) methods often aim to train a domain-invariant feature extractor, which may hinder the model from learning sufficiently discriminative features. To tackle this, a line of works based on prompt…

Machine Learning · Computer Science 2025-04-02 Hoang Phan , Lam Tran , Quyen Tran , Trung Le

Adaptation of a classifier to new domains is one of the challenging problems in machine learning. This has been addressed using many deep and non-deep learning based methods. Among the methodologies used, that of adversarial learning is…

Machine Learning · Computer Science 2021-07-12 Vinod K Kurmi , Venkatesh K Subramanian , Vinay P. Namboodiri

Practical real world datasets with plentiful categories introduce new challenges for unsupervised domain adaptation like small inter-class discriminability, that existing approaches relying on domain invariance alone cannot handle…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Tarun Kalluri , Astuti Sharma , Manmohan Chandraker

Most existing studies on unsupervised domain adaptation (UDA) assume that each domain's training samples come with domain labels (e.g., painting, photo). Samples from each domain are assumed to follow the same distribution and the domain…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Zhongying Deng , Kaiyang Zhou , Da Li , Junjun He , Yi-Zhe Song , Tao Xiang

Adapting model parameters to incoming streams of data is a crucial factor to deep learning scalability. Interestingly, prior continual learning strategies in online settings inadvertently anchor their updated parameters to a local parameter…

Machine Learning · Computer Science 2022-09-30 Siddhartha Datta , Nigel Shadbolt

Recent advances in deep domain adaptation reveal that adversarial learning can be embedded into deep networks to learn transferable features that reduce distribution discrepancy between the source and target domains. Existing domain…

Computer Vision and Pattern Recognition · Computer Science 2018-09-10 Zhongyi Pei , Zhangjie Cao , Mingsheng Long , Jianmin Wang

With the wide proliferation of Deep Neural Networks in high-stake applications, there is a growing demand for explainability behind their decision-making process. Concept learning models attempt to learn high-level 'concepts' - abstract…

Machine Learning · Computer Science 2024-05-07 Sanchit Sinha , Guangzhi Xiong , Aidong Zhang

Current Domain Adaptation (DA) methods based on deep architectures assume that the source samples arise from a single distribution. However, in practice, most datasets can be regarded as mixtures of multiple domains. In these cases…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Massimiliano Mancini , Lorenzo Porzi , Samuel Rota Bulò , Barbara Caputo , Elisa Ricci

Continual multimodal instruction tuning is crucial for adapting Multimodal Large Language Models (MLLMs) to evolving tasks. However, most existing methods adopt a fixed architecture, struggling with adapting to new tasks due to static model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Chendi Ge , Xin Wang , Zeyang Zhang , Hong Chen , Jiapei Fan , Longtao Huang , Hui Xue , Wenwu Zhu

In practice, domain shifts are likely to occur between training and test data, necessitating domain adaptation (DA) to adjust the pre-trained source model to the target domain. Recently, universal domain adaptation (UniDA) has gained…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Pascal Schlachter , Simon Wagner , Bin Yang

The ability to learn continuously from an incoming data stream without catastrophic forgetting is critical for designing intelligent systems. Many existing approaches to continual learning rely on stochastic gradient descent and its…

Machine Learning · Computer Science 2021-03-16 Sandeep Madireddy , Angel Yanguas-Gil , Prasanna Balaprakash

Extending a fully post-trained language model with new domain capabilities is fundamentally limited by monolithic training paradigms: retraining from scratch is expensive and scales poorly, while continued training often degrades existing…

Machine Learning · Computer Science 2026-04-21 Jacob Morrison , Sanjay Adhikesaven , Akshita Bhagia , Matei Zaharia , Noah A. Smith , Sewon Min