English
Related papers

Related papers: Problem-dependent attention and effort in neural n…

200 papers

Ensembles of neural networks are known to be much more robust and accurate than individual networks. However, training multiple deep networks for model averaging is computationally expensive. In this paper, we propose a method to obtain the…

Machine Learning · Computer Science 2017-04-04 Gao Huang , Yixuan Li , Geoff Pleiss , Zhuang Liu , John E. Hopcroft , Kilian Q. Weinberger

The use of Attention Layers has become a trend since the popularization of the Transformer-based models, being the key element for many state-of-the-art models that have been developed through recent years. However, one of the biggest…

Machine Learning · Computer Science 2023-02-14 Giovanni Araujo Bacochina , Rodrigo Clemente Thom de Souza

This article demonstrates a new conceptor network based classifier in classifying images. Mathematical descriptions and analysis are presented. Various tests are experimented using three benchmark datasets: MNIST, CIFAR-10 and CIFAR-100.…

Computer Vision and Pattern Recognition · Computer Science 2015-06-15 Yuhuang Hu , M. S. Ishwarya , Chu Kiong Loo

Recent models for image processing are using the Convolutional neural network (CNN) which requires a pixel per pixel analysis of the input image. This method works well. However, it is time-consuming if we have large images. To increase the…

Machine Learning · Computer Science 2019-12-10 Mohamed Karim Belaid

Class imbalance is a common problem in the case of real-world object detection and classification tasks. Data of some classes is abundant making them an over-represented majority, and data of other classes is scarce, making them an…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Salman H. Khan , Munawar Hayat , Mohammed Bennamoun , Ferdous Sohel , Roberto Togneri

Training neural networks (NNs) using combinatorial optimization solvers has gained attention in recent years. In low-data settings, state-of-the-art mixed integer linear programming solvers can train exactly a NN, avoiding intensive…

Optimization and Control · Mathematics 2024-09-12 Ambrogio Maria Bernardelli , Stefano Gualandi , Hoong Chuin Lau , Simone Milanesi , Neil Yorke-Smith

An ensemble method that fuses the output decision vectors of multiple feedforward-designed convolutional neural networks (FF-CNNs) to solve the image classification problem is proposed in this work. To enhance the performance of the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Yueru Chen , Yijing Yang , Wei Wang , C. -C. Jay Kuo

Despite the outstanding performance of convolutional neural networks (CNNs) for many vision tasks, the required computational cost during inference is problematic when resources are limited. In this context, we propose Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Adria Ruiz , Jakob Verbeek

In multiclass deep network classifiers, the burden of classifying samples of different classes is put on a single classifier. As the result the optimum classification accuracy is not obtained. Also training times are large due to running…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Abdul Mueed Hafiz , Mahmoud Hassaballah

This paper investigates novel classifier ensemble techniques for uncertainty calibration applied to various deep neural networks for image classification. We evaluate both accuracy and calibration metrics, focusing on Expected Calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Michael Schulze , Nikolas Ebert , Laurenz Reichardt , Oliver Wasenmüller

In the deep-learning community new algorithms are published at an incredible pace. Therefore, solving an image classification problem for new datasets becomes a challenging task, as it requires to re-evaluate published algorithms and their…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Florian Scheidegger , Roxana Istrate , Giovanni Mariani , Luca Benini , Costas Bekas , Cristiano Malossi

Recently published methods enable training of bitwise neural networks which allow reduced representation of down to a single bit per weight. We present a method that exploits ensemble decisions based on multiple stochastically sampled…

Neural and Evolutionary Computing · Computer Science 2016-11-22 Sebastian Vogel , Christoph Schorn , Andre Guntoro , Gerd Ascheid

Network pruning is one of the most dominant methods for reducing the heavy inference cost of deep neural networks. Existing methods often iteratively prune networks to attain high compression ratio without incurring significant loss in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-17 Duong H. Le , Trung-Nhan Vo , Nam Thoai

Single-pixel cameras are an effective solution for imaging outside the visible spectrum, where traditional CMOS/CCD cameras have challenges. When combined with machine learning, they can analyze images quickly enough for practical…

Quantum Physics · Physics 2026-02-25 Sofya Manko , Dmitry Frolovtsev

Several real-world classification problems are example-dependent cost-sensitive in nature, where the costs due to misclassification vary between examples and not only within classes. However, standard classification methods do not take…

Machine Learning · Computer Science 2015-05-19 Alejandro Correa Bahnsen , Djamila Aouada , Bjorn Ottersten

Real-time CNN-based object detection models for applications like surveillance can achieve high accuracy but are computationally expensive. Recent works have shown 10 to 100x reduction in computation cost for inference by using…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Kentaro Yoshioka , Edward Lee , Simon Wong , Mark Horowitz

Deep neural networks have been remarkable successful in various AI tasks but often cast high computation and energy cost for energy-constrained applications such as mobile sensing. We address this problem by proposing a novel framework that…

Machine Learning · Computer Science 2017-10-11 Jiaqi Guan , Yang Liu , Qiang Liu , Jian Peng

Automated data augmentation has shown superior performance in image recognition. Existing works search for dataset-level augmentation policies without considering individual sample variations, which are likely to be sub-optimal. On the…

Machine Learning · Computer Science 2020-12-23 Fengwei Zhou , Jiawei Li , Chuanlong Xie , Fei Chen , Lanqing Hong , Rui Sun , Zhenguo Li

Ensembling is a popular and effective method for improving machine learning (ML) models. It proves its value not only in classical ML but also for deep learning. Ensembles enhance the quality and trustworthiness of ML solutions, and allow…

Machine Learning · Computer Science 2022-06-28 Polina Proscura , Alexey Zaytsev

Background: Breast cancer has the highest prevalence in women globally. The classification and diagnosis of breast cancer and its histopathological images have always been a hot spot of clinical concern. In Computer-Aided Diagnosis (CAD),…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Yuchao Zheng , Chen Li , Xiaomin Zhou , Haoyuan Chen , Hao Xu , Yixin Li , Haiqing Zhang , Xiaoyan Li , Hongzan Sun , Xinyu Huang , Marcin Grzegorzek