English
Related papers

Related papers: Multi-Domain Learning by Meta-Learning: Taking Opt…

200 papers

Recent work has suggested that a good embedding is all we need to solve many few-shot learning benchmarks. Furthermore, other work has strongly suggested that Model Agnostic Meta-Learning (MAML) also works via this same method - by learning…

Machine Learning · Computer Science 2021-12-28 Brando Miranda , Yu-Xiong Wang , Sanmi Koyejo

The optimal solution to an optimization problem depends on the problem's objective function, constraints, and size. While deep neural networks (DNNs) have proven effective in solving optimization problems, changes in the problem's size,…

Machine Learning · Computer Science 2025-02-17 Nikos A. Mitsiou , Pavlos S. Bouzinis , Panagiotis G. Sarigiannidis , George K. Karagiannidis

We develop new algorithms for simultaneous learning of multiple tasks (e.g., image classification, depth estimation), and for adapting to unseen task/domain distributions within those high-level tasks (e.g., different environments). First,…

Machine Learning · Computer Science 2020-06-16 Kiran Lekkala , Laurent Itti

Deep metric learning (DML) aims to learn a discriminative high-dimensional embedding space for downstream tasks like classification, clustering, and retrieval. Prior literature predominantly focuses on pair-based and proxy-based methods to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Xiruo Jiang , Yazhou Yao , Xili Dai , Fumin Shen , Xian-Sheng Hua , Heng-Tao Shen

Multi-modality (MM) semi-supervised learning (SSL) based medical image segmentation has recently gained increasing attention for its ability to utilize MM data and reduce reliance on labeled images. However, current methods face several…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yingyu Chen , Ziyuan Yang , Ming Yan , Zhongzhou Zhang , Hui Yu , Yan Liu , Yi Zhang

Brain lesion segmentation from multi-modal MRI often assumes fixed modality sets or predefined pathologies, making existing models difficult to adapt across cohorts and imaging protocols. Continual learning (CL) offers a natural solution…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Yousef Sadegheih , Dorit Merhof , Pratibha Kumari

Lesion segmentation in medical imaging has been an important topic in clinical research. Researchers have proposed various detection and segmentation algorithms to address this task. Recently, deep learning-based approaches have…

Image and Video Processing · Electrical Eng. & Systems 2021-11-16 Dong Yang , Andriy Myronenko , Xiaosong Wang , Ziyue Xu , Holger R. Roth , Daguang Xu

We study multigrade deep learning (MGDL) as a principled framework for structured error refinement in deep neural networks. While the approximation power of neural networks is now relatively well understood, training very deep architectures…

Machine Learning · Computer Science 2026-04-03 Shijun Zhang , Zuowei Shen , Yuesheng Xu

Deep neural networks (DNNs) typically employ an end-to-end (E2E) training paradigm which presents several challenges, including high GPU memory consumption, inefficiency, and difficulties in model parallelization during training. Recent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yuming Zhang , Shouxin Zhang , Peizhe Wang , Feiyu Zhu , Dongzhi Guan , Junhao Su , Jiabin Liu , Changpeng Cai

The performance of deep neural networks improves with more annotated data. The problem is that the budget for annotation is limited. One solution to this is active learning, where a model asks human to annotate data that it perceived as…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Donggeun Yoo , In So Kweon

Deep learning has shown remarkable progress in medical image semantic segmentation, yet its success heavily depends on large-scale expert annotations and consistent data distributions. In practice, annotations are scarce, and images are…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Ba-Thinh Lam , Thanh-Huy Nguyen , Hoang-Thien Nguyen , Quang-Khai Bui-Tran , Nguyen Lan Vi Vu , Phat K. Huynh , Ulas Bagci , Min Xu

Deep learning models perform best when tested on target (test) data domains whose distribution is similar to the set of source (train) domains. However, model generalization can be hindered when there is significant difference in the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-19 Pulkit Khandelwal , Paul Yushkevich

Multi-task learning (MTL) is an inductive transfer mechanism designed to leverage useful information from multiple tasks to improve generalization performance compared to single-task learning. It has been extensively explored in traditional…

Machine Learning · Computer Science 2025-01-13 Varun Kumar , Somdatta Goswami , Katiana Kontolati , Michael D. Shields , George Em Karniadakis

Using single-task deep learning methods to reconstruct Magnetic Resonance Imaging (MRI) data acquired with different imaging sequences is inherently challenging. The trained deep learning model typically lacks generalizability, and the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-23 Wanyu Bian , Albert Jang , Fang Liu

Modeling high-dimensional, nonlinear dynamic structural systems under natural hazards presents formidable computational challenges, especially when simultaneously accounting for uncertainties in external loads and structural parameters.…

Machine Learning · Computer Science 2026-03-13 Haimiti Atila , Seymour M. J. Spence

Drawing inspiration from gradient-based meta-learning methods with infinitely small gradient steps, we introduce Continuous-Time Meta-Learning (COMLN), a meta-learning algorithm where adaptation follows the dynamics of a gradient vector…

Machine Learning · Computer Science 2022-03-04 Tristan Deleu , David Kanaa , Leo Feng , Giancarlo Kerg , Yoshua Bengio , Guillaume Lajoie , Pierre-Luc Bacon

Deep learning approaches have achieved great success in the field of Natural Language Processing (NLP). However, directly training deep neural models often suffer from overfitting and data scarcity problems that are pervasive in NLP tasks.…

Artificial Intelligence · Computer Science 2024-04-30 Shijie Chen , Yu Zhang , Qiang Yang

In this paper, we propose a machine learning (ML) method to learn how to solve a generic constrained continuous optimization problem. To the best of our knowledge, the generic methods that learn to optimize, focus on unconstrained…

Machine Learning · Computer Science 2021-01-05 Seyedrazieh Bayati , Faramarz Jabbarvaziri

Automated segmentation of multiple sclerosis (MS) lesions using multicontrast magnetic resonance (MR) images improves efficiency and reproducibility compared to manual delineation, with deep learning (DL) methods achieving state-of-the-art…

Deep learning (DL)-based models have demonstrated good performance in medical image segmentation. However, the models trained on a known dataset often fail when performed on an unseen dataset collected from different centers, vendors and…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Lei Li , Veronika A. Zimmer , Wangbin Ding , Fuping Wu , Liqin Huang , Julia A. Schnabel , Xiahai Zhuang