English
Related papers

Related papers: Comparative Analysis of Lightweight Deep Learning …

200 papers

Due to their black-box and data-hungry nature, deep learning techniques are not yet widely adopted for real-world applications in critical domains, like healthcare and justice. This paper presents Memory Wrap, a plug-and-play extension to…

Machine Learning · Computer Science 2023-10-30 Biagio La Rosa , Roberto Capobianco , Daniele Nardi

Training deep neural networks from few examples is a highly challenging and key problem for many computer vision tasks. In this context, we are targeting knowledge transfer from a set with abundant data to other sets with few available…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Yann Lifchitz , Yannis Avrithis , Sylvaine Picard , Andrei Bursuc

Convolutional Neural Networks (CNN) have revolutionized perception for color images, and their application to sonar images has also obtained good results. But in general CNNs are difficult to train without a large dataset, need manual…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Matias Valdenegro-Toro

In this paper we address the memory demands that come with the processing of 3-dimensional, high-resolution, multi-channeled medical images in deep learning. We exploit memory-efficient backpropagation techniques, to reduce the memory…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Stefano B. Blumberg , Ryutaro Tanno , Iasonas Kokkinos , Daniel C. Alexander

In the context of medical imaging and machine learning, one of the most pressing challenges is the effective adaptation of pre-trained models to specialized medical contexts. Despite the availability of advanced pre-trained models, their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Ana Davila , Jacinto Colan , Yasuhisa Hasegawa

In this paper, we propose a new method called ProfWeight for transferring information from a pre-trained deep neural network that has a high test accuracy to a simpler interpretable model or a very shallow network of low complexity and a…

Machine Learning · Computer Science 2018-11-20 Amit Dhurandhar , Karthikeyan Shanmugam , Ronny Luss , Peder Olsen

In the paper of ExquisiteNetV1, the ability of classification of ExquisiteNetV1 is worse than DenseNet. In this article, we propose a faster and better model ExquisiteNetV2. We conduct many experiments to evaluate its performance. We test…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shi-Yao Zhou , Chung-Yen Su

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Deep neural networks have become ubiquitous for applications related to visual recognition and language understanding tasks. However, it is often prohibitive to use typical neural networks on devices like mobile phones or smart watches…

Machine Learning · Computer Science 2017-08-10 Sujith Ravi

Memory is increasingly often the bottleneck when training neural network models. Despite this, techniques to lower the overall memory requirements of training have been less widely studied compared to the extensive literature on reducing…

Machine Learning · Computer Science 2022-04-12 Nimit S. Sohoni , Christopher R. Aberger , Megan Leszczynski , Jian Zhang , Christopher Ré

The field of keypoint extraction, which is essential for vision applications like Structure from Motion (SfM) and Simultaneous Localization and Mapping (SLAM), has evolved from relying on handcrafted methods to leveraging deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Haodi Yao , Fenghua He , Ning Hao , Chen Xie

Medical image classification is a critical task in healthcare, enabling accurate and timely diagnosis. However, deploying deep learning models on resource-constrained edge devices presents significant challenges due to computational and…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Mahsa Lavaei , Zahra Abadi , Salar Beigzad , Alireza Maleki

We present a novel high frequency residual learning framework, which leads to a highly efficient multi-scale network (MSNet) architecture for mobile and embedded vision problems. The architecture utilizes two networks: a low resolution…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Bowen Cheng , Rong Xiao , Jianfeng Wang , Thomas Huang , Lei Zhang

The remarkable representational power of Vision Transformers (ViTs) remains underutilized in few-shot image classification. In this work, we introduce ViT-ProtoNet, which integrates a ViT-Small backbone into the Prototypical Network…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Abdulvahap Mutlu , Şengül Doğan , Türker Tuncer

Self-driving technology is advancing rapidly --- albeit with significant challenges and limitations. This progress is largely due to recent developments in deep learning algorithms. To date, however, there has been no systematic comparison…

Machine Learning · Computer Science 2018-10-16 Michael Teti , William Edward Hahn , Shawn Martin , Christopher Teti , Elan Barenholtz

Quantization for deep neural networks (DNN) have enabled developers to deploy models with less memory and more efficient low-power inference. However, not all DNN designs are friendly to quantization. For example, the popular Mobilenet…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Thu Dinh , Andrey Melnikov , Vasilios Daskalopoulos , Sek Chai

Few-shot learning in image classification aims to learn a classifier to classify images when only few training examples are available for each class. Recent work has achieved promising classification performance, where an image-level…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Wenbin Li , Lei Wang , Jinglin Xu , Jing Huo , Yang Gao , Jiebo Luo

Accurate classification of Acute Lymphoblastic Leukemia (ALL) from peripheral blood smear images is essential for early diagnosis and effective treatment planning. This study investigates the use of transfer learning with pretrained…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Faisal Ahmed

In recent years, deep learning methods have been successfully applied to image classification tasks. Many such deep neural networks exist today that can easily differentiate cats from dogs. One such model is the ResNeXt model that uses a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Saifuddin Hitawala

Brain tumors are one of the most common and dangerous neurological diseases which require a timely and correct diagnosis to provide the right treatment procedures. Even with the promotion of magnetic resonance imaging (MRI), the process of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Md. Srabon Chowdhury , Syeda Fahmida Tanzim , Sheekar Banerjee , Ishtiak Al Mamoon , AKM Muzahidul Islam