English
Related papers

Related papers: Memory Classifiers: Two-stage Classification for R…

200 papers

Deep neural networks have shown remarkable performance when trained on independent and identically distributed data from a fixed set of classes. However, in real-world scenarios, it can be desirable to train models on a continuous stream of…

Machine Learning · Computer Science 2023-09-04 Nicolas Michel , Giovanni Chierchia , Romain Negrel , Jean-François Bercher , Toshihiko Yamasaki

Uncertainty quantification for deep learning is a challenging open problem. Bayesian statistics offer a mathematically grounded framework to reason about uncertainties; however, approximate posteriors for modern neural networks still…

Machine Learning · Statistics 2020-01-23 Nicolas Brosse , Carlos Riquelme , Alice Martin , Sylvain Gelly , Éric Moulines

Robustness of neural networks has recently attracted a great amount of interest. The many investigations in this area lack a precise common foundation of robustness concepts. Therefore, in this paper, we propose a rigorous and flexible…

Machine Learning · Computer Science 2021-06-01 Alessandro Tibo , Manfred Jaeger , Kim G. Larsen

The performance of deep segmentation models often degrades due to distribution shifts in image intensities between the training and test data sets. This is particularly pronounced in multi-centre studies involving data acquired using…

Image and Video Processing · Electrical Eng. & Systems 2021-08-03 Zhendong Liu , Van Manh , Xin Yang , Xiaoqiong Huang , Karim Lekadir , Víctor Campello , Nishant Ravikumar , Alejandro F Frangi , Dong Ni

Machine learning algorithms are known to be susceptible to data poisoning attacks, where an adversary manipulates the training data to degrade performance of the resulting classifier. In this work, we present a unifying view of randomized…

Machine Learning · Computer Science 2021-02-24 Elan Rosenfeld , Ezra Winston , Pradeep Ravikumar , J. Zico Kolter

Current deep learning classifiers, carry out supervised learning and store class discriminatory information in a set of shared network weights. These weights cannot be easily altered to incrementally learn additional classes, since the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Penny Johnston , Keiller Nogueira , Kevin Swingler

Artificial intelligence has made remarkable progress in handling complex tasks, thanks to advances in hardware acceleration and machine learning algorithms. However, to acquire more accurate outcomes and solve more complex issues,…

Machine Learning · Computer Science 2023-09-12 Mohammad Dehghani , Zahra Yazdanparast

We propose an algorithm for incremental learning of classifiers. The proposed method enables an ensemble of classifiers to learn incrementally by accommodating new training data. We use an effective mechanism to overcome the…

Machine Learning · Computer Science 2019-02-11 Shivang Agarwal , C. Ravindranath Chowdary , Shripriya Maheshwari

Image classification has been one of the most popular tasks in Deep Learning, seeing an abundance of impressive implementations each year. However, there is a lot of criticism tied to promoting complex architectures that continuously push…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Maria Lymperaiou , Konstantinos Thomas , Giorgos Stamou

In this work we evaluate the impact of digitally altered images on the performance of artificial neural networks. We explore factors that negatively affect the ability of an image classification model to produce consistent and accurate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Jason Stock , Andy Dolan , Tom Cavey

Investigation of machine learning algorithms robust to changes between the training and test distributions is an active area of research. In this paper we explore a special type of dataset shift which we call class-dependent domain shift.…

Machine Learning · Computer Science 2020-07-13 Tigran Galstyan , Hrant Khachatrian , Greg Ver Steeg , Aram Galstyan

Deep neural networks may perform poorly when training datasets are heavily class-imbalanced. Recently, two-stage methods decouple representation learning and classifier learning to improve performance. But there is still the vital issue of…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Zhisheng Zhong , Jiequan Cui , Shu Liu , Jiaya Jia

Data augmentation is a key practice in machine learning for improving generalization performance. However, finding the best data augmentation hyperparameters requires domain knowledge or a computationally demanding search. We address this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Saypraseuth Mounsaveng , Issam Laradji , Ismail Ben Ayed , David Vazquez , Marco Pedersoli

Humans can learn concepts or recognize items from just a handful of examples, while machines require many more samples to perform the same task. In this paper, we build a computational model to investigate the possibility of this kind of…

Artificial Intelligence · Computer Science 2016-11-09 Wen-Chieh Fang , Yi-ting Chiang

Meta learning aims at learning how to solve tasks, and thus it allows to estimate models that can be quickly adapted to new scenarios. This work explores distributionally robust minimization in meta learning for system identification.…

Machine Learning · Computer Science 2025-06-24 Matteo Rufolo , Dario Piga , Marco Forgione

In this paper, we present a novel two-stage metric learning algorithm. We first map each learning instance to a probability distribution by computing its similarities to a set of fixed anchor points. Then, we define the distance in the…

Machine Learning · Computer Science 2014-05-16 Jun Wang , Ke Sun , Fei Sha , Stephane Marchand-Maillet , Alexandros Kalousis

Data imbalance between common and rare diseases during model training often causes intelligent diagnosis systems to have biased predictions towards common diseases. The state-of-the-art approaches apply a two-stage learning framework to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Chenghua Zeng , Huijuan Lu , Kanghao Chen , Ruixuan Wang , Wei-Shi Zheng

Classifiers and other statistics-based machine learning (ML) techniques generalize, or learn, based on various statistical properties of the training data. The assumption underlying statistical ML resulting in theoretical or empirical…

Machine Learning · Computer Science 2021-11-11 Samuel Ackerman , Orna Raz , Marcel Zalmanovici , Aviad Zlotnick

Deep neural networks have achieved impressive results in many image classification tasks. However, since their performance is usually measured in controlled settings, it is important to ensure that their decisions remain correct when…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Apostolos Modas

Plasticity and stability are needed in class-incremental learning in order to learn from new data while preserving past knowledge. Due to catastrophic forgetting, finding a compromise between these two properties is particularly challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Grégoire Petit , Adrian Popescu , Eden Belouadah , David Picard , Bertrand Delezoide