English
Related papers

Related papers: Multi-Site Class-Incremental Learning with Weighte…

200 papers

The goal of meta-learning is to train a model on a variety of learning tasks, such that it can adapt to new problems within only a few iterations. Here we propose a principled information-theoretic model that optimally partitions the…

Machine Learning · Statistics 2020-09-10 Heinke Hihn , Daniel A. Braun

In recent years, deep learning-based methods have been successfully applied to the image distortion restoration tasks. However, scenarios that assume a single distortion only may not be suitable for many real-world applications. To deal…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Sijin Kim , Namhyuk Ahn , Kyung-Ah Sohn

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

Collaboration between different data centers is often challenged by heterogeneity across sites. To account for the heterogeneity, the state-of-the-art method is to re-weight the covariate distributions in each site to match the distribution…

Machine Learning · Statistics 2024-04-25 Tianyu Guo , Sai Praneeth Karimireddy , Michael I. Jordan

Supervised training of neural networks requires large, diverse and well annotated data sets. In the medical field, this is often difficult to achieve due to constraints in time, expert knowledge and prevalence of an event. Artificial data…

Image and Video Processing · Electrical Eng. & Systems 2021-10-01 Andreas Wachter , Werner Nahm

In this paper, a progressive learning algorithm for multi-label classification to learn new labels while retaining the knowledge of previous labels is designed. New output neurons corresponding to new labels are added and the neural network…

Machine Learning · Computer Science 2016-09-26 Mihika Dave , Sahil Tapiawala , Meng Joo Er , Rajasekar Venkatesan

Modern computer vision applications suffer from catastrophic forgetting when incrementally learning new concepts over time. The most successful approaches to alleviate this forgetting require extensive replay of previously seen data, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 James Smith , Yen-Chang Hsu , Jonathan Balloch , Yilin Shen , Hongxia Jin , Zsolt Kira

Artificial intelligence (AI) systems accelerate medical workflows and improve diagnostic accuracy in healthcare, serving as second-opinion systems. However, the unpredictability of AI errors poses a significant challenge, particularly in…

Existing architectures for imitation learning using image-to-action policy networks perform poorly when presented with an input image containing multiple instances of the object of interest, especially when the number of expert…

Robotics · Computer Science 2021-01-05 Sagar Gubbi Venkatesh , Raviteja Upadrashta , Shishir Kolathaya , Bharadwaj Amrutur

Explainability of neural network prediction is essential to understand feature importance and gain interpretable insight into neural network performance. However, explanations of neural network outcomes are mostly limited to visualization,…

Machine Learning · Computer Science 2023-07-13 Arnab Neelim Mazumder , Niall Lyons , Ashutosh Pandey , Avik Santra , Tinoosh Mohsenin

In many real-world settings, regulations and economic incentives permit the sharing of models but not data across institutional boundaries. In such scenarios, practitioners might hope to adapt models to new domains, without losing…

Machine Learning · Computer Science 2025-08-29 Yewon Byun , Sanket Vaibhav Mehta , Saurabh Garg , Emma Strubell , Michael Oberst , Bryan Wilder , Zachary C. Lipton

Annotating a large number of training images is very time-consuming. In this background, this paper focuses on learning from easy-to-acquire web data and utilizes the learned model for fine-grained image classification in labeled datasets.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-24 Xiaoxiao Sun , Liang Zheng , Yu-Kun Lai , Jufeng Yang

It seems as though progressively more people are in the race to upload content, data, and information online; and hospitals haven't neglected this trend either. Hospitals are now at the forefront for multi-site medical data sharing to…

Machine Learning · Computer Science 2022-02-23 Yoo Jeong Ha , Gusang Lee , Minjae Yoo , Soyi Jung , Seehwan Yoo , Joongheon Kim

As image-based deep learning becomes pervasive on every device, from cell phones to smart watches, there is a growing need to develop methods that continually learn from data while minimizing memory footprint and power consumption. While…

Machine Learning · Computer Science 2021-03-24 Dongsub Shim , Zheda Mai , Jihwan Jeong , Scott Sanner , Hyunwoo Kim , Jongseong Jang

Few-shot class-incremental learning (FSCIL) aims to design machine learning algorithms that can continually learn new concepts from a few data points, without forgetting knowledge of old classes. The difficulty lies in that limited data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Chi Zhang , Nan Song , Guosheng Lin , Yun Zheng , Pan Pan , Yinghui Xu

Conventional transfer learning leverages weights of pre-trained networks, but mandates the need for similar neural architectures. Alternatively, knowledge distillation can transfer knowledge between heterogeneous networks but often requires…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Shuhang Wang , Vivek Kumar Singh , Alex Benjamin , Mercy Asiedu , Elham Yousef Kalafi , Eugene Cheah , Viksit Kumar , Anthony Samir

For early breast cancer detection, regular screening with mammography imaging is recommended. Routinary examinations result in datasets with a predominant amount of negative samples. A potential solution to such class-imbalance is joining…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Amelia Jiménez-Sánchez , Mickael Tardy , Miguel A. González Ballester , Diana Mateus , Gemma Piella

Multi-task learns multiple tasks, while sharing knowledge and computation among them. However, it suffers from catastrophic forgetting of previous knowledge when learned incrementally without access to the old data. Most existing object…

Computer Vision and Pattern Recognition · Computer Science 2020-11-20 Xialei Liu , Hao Yang , Avinash Ravichandran , Rahul Bhotika , Stefano Soatto

In most works on deep incremental learning research, it is assumed that novel samples are pre-identified for neural network retraining. However, practical deep classifiers often misidentify these samples, leading to erroneous predictions.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Jiawen Xu , Claas Grohnfeldt , Odej Kao

Knowledge distillation has been used to transfer knowledge learned by a sophisticated model (teacher) to a simpler model (student). This technique is widely used to compress model complexity. However, in most applications the compressed…

Machine Learning · Computer Science 2020-11-24 Hadi Pouransari , Mojan Javaheripi , Vinay Sharma , Oncel Tuzel