English
Related papers

Related papers: Efficient ConvBN Blocks for Transfer Learning and …

200 papers

Convolutional neural networks (CNNs) are becoming very successful and popular for a variety of applications. The Loki many-core processor architecture is very promising for achieving specialised hardware performance and efficiency while…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-05 Philippos Papaphilippou

In recent years deep learning algorithms have shown extremely high performance on machine learning tasks such as image classification and speech recognition. In support of such applications, various FPGA accelerator architectures have been…

Machine Learning · Computer Science 2017-05-09 Xinyu Zhang , Srinjoy Das , Ojash Neopane , Ken Kreutz-Delgado

This paper introduces EfficientNetV2, a new family of convolutional networks that have faster training speed and better parameter efficiency than previous models. To develop this family of models, we use a combination of training-aware…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Mingxing Tan , Quoc V. Le

Convolutional neural networks (CNNs) are commonly used for image classification tasks, raising the challenge of their application on data flows. During their training, adaptation is often performed by tuning the learning rate. Usual…

Machine Learning · Computer Science 2019-11-19 Zilong Zhao , Sophie Cerf , Bogdan Robu , Nicolas Marchand

In this study, we explore the use of Convolutional Neural Networks for improving train speed estimation accuracy, addressing the complex challenges of modern railway systems. We investigate three CNN architectures - single-branch 2D,…

Machine Learning · Computer Science 2025-08-26 Haitao Tian , Argyrios Zolotas , Miguel Arana-Catania

As we navigate our daily commutes, the threat posed by a distracted driver is at a large, resulting in a troubling rise in traffic accidents. Addressing this safety concern, our project harnesses the analytical power of Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Amaan Aijaz Sheikh , Imaad Zaffar Khan

In this paper, we have studied how the training of the convolutional neural networks (CNNs) can be affected by changing the position of the batch normalization (BN) layer. Three different convolutional neural networks have been chosen for…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Moein Hasani , Hassan Khotanlou

The hybrid architecture of convolution neural networks (CNN) and Transformer has been the most popular method for medical image segmentation. However, the existing networks based on the hybrid architecture suffer from two problems. First,…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Rui Sun , Tao Lei , Weichuan Zhang , Yong Wan , Yong Xia , Asoke K. Nandi

We propose a new flexible deep convolutional neural network (convnet) to perform fast visual style transfer. In contrast to existing convnets that address the same task, our architecture derives directly from the structure of the gradient…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Gilles Puy , Patrick Pérez

Inference for Deep Neural Networks is increasingly being executed locally on mobile and embedded platforms due to its advantages in latency, privacy and connectivity. Since modern System on Chips typically execute a combination of different…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Lei Xun , Long Tran-Thanh , Bashir M Al-Hashimi , Geoff V. Merrett

Normalization techniques have become a basic component in modern convolutional neural networks (ConvNets). In particular, many recent works demonstrate that promoting the orthogonality of the weights helps train deep models and improve…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Sheng Liu , Xiao Li , Yuexiang Zhai , Chong You , Zhihui Zhu , Carlos Fernandez-Granda , Qing Qu

Motion blur in scene text images severely impairs readability and hinders the reliability of computer vision tasks, including autonomous driving, document digitization, and visual information retrieval. Conventional deblurring approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Umar Rashid , Muhammad Arslan Arshad , Ghulam Ahmad , Muhammad Zeeshan Anjum , Rizwan Khan , Muhammad Akmal

The exponential growth of multivariate time series data from sensor networks in domains like industrial monitoring and smart cities requires efficient and accurate forecasting models. Current deep learning methods often fail to adequately…

Machine Learning · Computer Science 2024-11-08 Xinxing Zhou , Jiaqi Ye , Shubao Zhao , Ming Jin , Chengyi Yang , Yanlong Wen , Xiaojie Yuan

Transfer learning is widely used in computer vision (CV), natural language processing (NLP) and achieves great success. Most transfer learning systems are based on the same modality (e.g. RGB image in CV and text in NLP). However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Xiaoke Shen , Ioannis Stamos

Vision transformer has demonstrated promising performance on challenging computer vision tasks. However, directly training the vision transformers may yield unstable and sub-optimal results. Recent works propose to improve the performance…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Chengyue Gong , Dilin Wang , Meng Li , Vikas Chandra , Qiang Liu

Material classification in natural settings is a challenge due to complex interplay of geometry, reflectance properties, and illumination. Previous work on material classification relies strongly on hand-engineered features of visual…

Computer Vision and Pattern Recognition · Computer Science 2016-09-21 Patrick Wieschollek , Hendrik P. A. Lensch

We present in this paper a new architecture, named Convolutional vision Transformer (CvT), that improves Vision Transformer (ViT) in performance and efficiency by introducing convolutions into ViT to yield the best of both designs. This is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Haiping Wu , Bin Xiao , Noel Codella , Mengchen Liu , Xiyang Dai , Lu Yuan , Lei Zhang

Modern Convolutional Neural Networks (CNN) are extremely powerful on a range of computer vision tasks. However, their performance may degrade when the data is characterised by large intra-class variability caused by spatial transformations.…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Roberto Annunziata , Christos Sagonas , Jacques Calì

We study performance characteristics of convolutional neural networks (CNN) for mobile computer vision systems. CNNs have proven to be a powerful and efficient approach to implement such systems. However, the system performance depends…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jussi Hanhirova , Teemu Kämäräinen , Sipi Seppälä , Matti Siekkinen , Vesa Hirvisalo , Antti Ylä-Jääski

Convolutional Neural Networks (CNN) have revolutionized perception for color images, and their application to sonar images has also obtained good results. But in general CNNs are difficult to train without a large dataset, need manual…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Matias Valdenegro-Toro