English
Related papers

Related papers: LB-CNN: An Open Source Framework for Fast Training…

200 papers

Image super-resolution (SR) in resource-constrained scenarios demands lightweight models balancing performance and latency. Convolutional neural networks (CNNs) offer low latency but lack non-local feature capture, while Transformers excel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Quanwei Hu , Yinggan Tang , Xuguang Zhang

Convolutional neural network (CNN) is a class of artificial neural networks widely used in computer vision tasks. Most CNNs achieve excellent performance by stacking certain types of basic units. In addition to increasing the depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Junyi An , Fengshan Liu , Jian Zhao , Furao Shen

This paper aims to accelerate the test-time computation of convolutional neural networks (CNNs), especially very deep CNNs that have substantially impacted the computer vision community. Unlike previous methods that are designed for…

Computer Vision and Pattern Recognition · Computer Science 2015-11-19 Xiangyu Zhang , Jianhua Zou , Kaiming He , Jian Sun

In this paper, we propose a novel Convolutional Neural Network (CNN) architecture for learning multi-scale feature representations with good tradeoffs between speed and accuracy. This is achieved by using a multi-branch network, which has…

Computer Vision and Pattern Recognition · Computer Science 2019-08-01 Chun-Fu Chen , Quanfu Fan , Neil Mallinar , Tom Sercu , Rogerio Feris

The widespread use of Multi-layer perceptrons (MLPs) often relies on a fixed activation function (e.g., ReLU, Sigmoid, Tanh) for all nodes within the hidden layers. While effective in many scenarios, this uniformity may limit the networks…

Machine Learning · Computer Science 2025-04-28 Hy Nguyen , Duy Khoa Pham , Srikanth Thudumu , Hung Du , Rajesh Vasa , Kon Mouzakis

High-efficiency deep learning (DL) models are necessary not only to facilitate their use in devices with limited resources but also to improve resources required for training. Convolutional neural networks (ConvNets) typically exert severe…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Christos Kyrkou

We introduce a novel scheme to train binary convolutional neural networks (CNNs) -- CNNs with weights and activations constrained to {-1,+1} at run-time. It has been known that using binary weights and activations drastically reduce memory…

Machine Learning · Computer Science 2017-12-01 Xiaofan Lin , Cong Zhao , Wei Pan

NVIDIA cuDNN is a low-level library that provides GPU kernels frequently used in deep learning. Specifically, cuDNN implements several equivalent convolution algorithms, whose performance and memory footprint may vary considerably,…

Machine Learning · Computer Science 2018-04-16 Yosuke Oyama , Tal Ben-Nun , Torsten Hoefler , Satoshi Matsuoka

The ever-growing computational demands of increasingly complex machine learning models frequently necessitate the use of powerful cloud-based infrastructure for their training. Binary neural networks are known to be promising candidates for…

Recently ConvNets or convolutional neural networks (CNN) have come up as state-of-the-art classification and detection algorithms, achieving near-human performance in visual detection. However, ConvNet algorithms are typically very…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Bert Moons , Bert De Brabandere , Luc Van Gool , Marian Verhelst

With the good performance of deep learning algorithms in the field of computer vision (CV), the convolutional neural network (CNN) architecture has become a main backbone of the computer vision task. With the widespread use of mobile…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Rui-Yang Ju , Ting-Yu Lin , Jia-Hao Jian , Jen-Shiun Chiang

For image classification problems, various neural network models are commonly used due to their success in yielding high accuracies. Convolutional Neural Network (CNN) is one of the most frequently used deep learning methods for image…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ilkay Sikdokur , Inci Baytas , Arda Yurdakul

In the large-scale image retrieval task, the two most important requirements are the discriminability of image representations and the efficiency in computation and storage of representations. Regarding the former requirement, Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Thanh-Toan Do , Tuan Hoang , Dang-Khoa Le Tan , Huu Le , Tam V. Nguyen , Ngai-Man Cheung

Convolutional Neural Networks (CNNs) have emerged as a fundamental technology for machine learning. High performance and extreme energy efficiency are critical for deployments of CNNs in a wide range of situations, especially mobile…

Accurate material recognition is critical for safe and effective laser cutting, as misidentification can lead to poor cut quality, machine damage, or the release of hazardous fumes. Laser speckle sensing has recently emerged as a low-cost…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Mohamed Abdallah Salem , Nourhan Zein Diab

Recurrent Neural Networks (RNN) are widely used for learning sequences in applications such as EEG classification. Complex RNNs could be hardly deployed on wearable devices due to their computation and memory-intensive processing patterns.…

Signal Processing · Electrical Eng. & Systems 2020-04-21 Seyed Ahmad Mirsalari , Sima Sinaei , Mostafa E. Salehi , Masoud Daneshtalab

Being able to learn from complex data with phase information is imperative for many signal processing applications. Today' s real-valued deep neural networks (DNNs) have shown efficiency in latent information analysis but fall short when…

Machine Learning · Computer Science 2021-08-11 Hongwu Peng , Shanglin Zhou , Scott Weitze , Jiaxin Li , Sahidul Islam , Tong Geng , Ang Li , Wei Zhang , Minghu Song , Mimi Xie , Hang Liu , Caiwen Ding

This paper introduces versatile filters to construct efficient convolutional neural networks that are widely used in various visual recognition tasks. Considering the demands of efficient deep learning techniques running on cost-effective…

Computer Vision and Pattern Recognition · Computer Science 2021-09-23 Kai Han , Yunhe Wang , Chang Xu , Chunjing Xu , Enhua Wu , Dacheng Tao

The deployment of neural networks in vehicle platforms and wearable Artificial Intelligence-of-Things (AIOT) scenarios has become a research area that has attracted much attention. With the continuous evolution of deep learning technology,…

Artificial Intelligence · Computer Science 2025-01-15 Mingke Xiao , Yue Su , Liang Yu , Guanglong Qu , Yutong Jia , Yukuan Chang , Xu Zhang

We propose a lightweight CPU network based on the MKLDNN acceleration strategy, named PP-LCNet, which improves the performance of lightweight models on multiple tasks. This paper lists technologies which can improve network accuracy while…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Cheng Cui , Tingquan Gao , Shengyu Wei , Yuning Du , Ruoyu Guo , Shuilong Dong , Bin Lu , Ying Zhou , Xueying Lv , Qiwen Liu , Xiaoguang Hu , Dianhai Yu , Yanjun Ma