English
Related papers

Related papers: Comparative Analysis of Lightweight Deep Learning …

200 papers

Deep neural networks have been widely used in numerous computer vision applications, particularly in face recognition. However, deploying deep neural network face recognition on mobile devices has recently become a trend but still limited…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Chi Nhan Duong , Kha Gia Quach , Ibsa Jalata , Ngan Le , Khoa Luu

This study aims to optimize the few-shot image classification task and improve the model's feature extraction and classification performance by combining self-supervised learning with the deep network model ResNet-101. During the training…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yuyang Xiao

Hyperspectral Image (HSI) classification based on deep learning has been an attractive area in recent years. However, as a kind of data-driven algorithm, deep learning method usually requires numerous computational resources and…

Image and Video Processing · Electrical Eng. & Systems 2020-04-28 Rui Li , Chenxi Duan

While machine learning is widely used to optimize wireless networks, training a separate model for each task in communication and localization is becoming increasingly unsustainable due to the significant costs associated with training and…

Signal Processing · Electrical Eng. & Systems 2025-11-20 Mohammad Cheraghinia , Eli De Poorter , Jaron Fontaine , Kwang Soon Kim , Merouane Debbah , Adnan Shahid

Convolutional Neural Network (CNN) based Deep Learning (DL) has achieved great progress in many real-life applications. Meanwhile, due to the complex model structures against strict latency and memory restriction, the implementation of CNN…

Machine Learning · Computer Science 2019-05-29 Weicheng Li , Rui Wang , Zhongzhi Luan , Di Huang , Zidong Du , Yunji Chen , Depei Qian

Incorporating deep learning (DL) classification models into unmanned aerial vehicles (UAVs) can significantly augment search-and-rescue operations and disaster management efforts. In such critical situations, the UAV's ability to promptly…

Image and Video Processing · Electrical Eng. & Systems 2023-06-21 Gao Yu Lee , Tanmoy Dam , Md Meftahul Ferdaus , Daniel Puiu Poenar , Vu N. Duong

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

General aviation fault diagnosis and efficient maintenance are critical to flight safety; however, deploying deep learning models on resource-constrained edge devices poses dual challenges in computational capacity and interpretability.…

Artificial Intelligence · Computer Science 2026-04-03 Zhihuan Wei , Xinhang Chen , Danyang Han , Yang Hu , Jie Liu , Xuewen Miao , Guijiang Li

Large Deep Neural Networks (DNNs) are the backbone of today's artificial intelligence due to their ability to make accurate predictions when being trained on huge datasets. With advancing technologies, such as the Internet of Things,…

Machine Learning · Computer Science 2023-07-14 Mark Deutel , Philipp Woller , Christopher Mutschler , Jürgen Teich

Meta learning approaches to few-shot classification are computationally efficient at test time, requiring just a few optimization steps or single forward pass to learn a new task, but they remain highly memory-intensive to train. This…

Dense optical flow estimation plays a key role in many robotic vision tasks. In the past few years, with the advent of deep learning, we have witnessed great progress in optical flow estimation. However, current networks often consist of a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Lingtong Kong , Chunhua Shen , Jie Yang

In recent years, diffusion models have demonstrated remarkable success in high-fidelity image synthesis. However, fine-tuning these models for specialized domains, such as medical imaging, remains challenging due to limited domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Ruchir Namjoshi , Nagasai Thadishetty , Vignesh Kumar , Hemanth Venkateshwara

The impressive performance of deep learning architectures is associated with a massive increase in model complexity. Millions of parameters need to be tuned, with training and inference time scaling accordingly, together with energy…

Machine Learning · Computer Science 2023-11-10 Paolo Didier Alfano , Vito Paolo Pastore , Lorenzo Rosasco , Francesca Odone

Federated learning is a promising paradigm that allows multiple clients to collaboratively train a model without sharing the local data. However, the presence of heterogeneous devices in federated learning, such as mobile phones and IoT…

Machine Learning · Computer Science 2025-09-03 Kai Zhang , Yutong Dai , Hongyi Wang , Eric Xing , Xun Chen , Lichao Sun

Deep neural networks (DNNs) have shown to provide superb performance in many real life applications, but their large computation cost and storage requirement have prevented them from being deployed to many edge and internet-of-things (IoT)…

Neural and Evolutionary Computing · Computer Science 2021-12-22 Minghai Qin , Tianyun Zhang , Fei Sun , Yen-Kuang Chen , Makan Fardad , Yanzhi Wang , Yuan Xie

The rapid scaling of large language models (LLMs) has unveiled critical limitations in current hardware architectures, including constraints in memory capacity, computational efficiency, and interconnection bandwidth. DeepSeek-V3, trained…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-24 Chenggang Zhao , Chengqi Deng , Chong Ruan , Damai Dai , Huazuo Gao , Jiashi Li , Liyue Zhang , Panpan Huang , Shangyan Zhou , Shirong Ma , Wenfeng Liang , Ying He , Yuqing Wang , Yuxuan Liu , Y. X. Wei

To realize the promise of ubiquitous embedded deep network inference, it is essential to seek limits of energy and area efficiency. To this end, low-precision networks offer tremendous promise because both energy and area scale down…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Jeffrey L. McKinstry , Steven K. Esser , Rathinakumar Appuswamy , Deepika Bablani , John V. Arthur , Izzet B. Yildiz , Dharmendra S. Modha

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

Medical image analysis frequently encounters data scarcity challenges. Transfer learning has been effective in addressing this issue while conserving computational resources. The recent advent of foundational models like the DINOv2, which…

Image and Video Processing · Electrical Eng. & Systems 2024-02-14 Yuning Huang , Jingchen Zou , Lanxi Meng , Xin Yue , Qing Zhao , Jianqiang Li , Changwei Song , Gabriel Jimenez , Shaowu Li , Guanghui Fu

Although large-scale labeled data are essential for deep convolutional neural networks (ConvNets) to learn high-level semantic visual representations, it is time-consuming and impractical to collect and annotate large-scale datasets. A…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Huili Huang , M. Mahdi Roozbahani