English
Related papers

Related papers: ShiftCNN: Generalized Low-Precision Architecture f…

200 papers

Ground-to-aerial geolocalization refers to localizing a ground-level query image by matching it to a reference database of geo-tagged aerial imagery. This is very challenging due to the huge perspective differences in visual appearances and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Teng Wang , Shujuan Fan , Daikun Liu , Changyin Sun

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

Although convolutional neural network (CNN) has made great progress, large redundant parameters restrict its deployment on embedded devices, especially mobile devices. The recent compression works are focused on real-value convolutional…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Jiasong Wu , Hongshan Ren , Youyong Kong , Chunfeng Yang , Lotfi Senhadji , Huazhong Shu

Convolutional Neural Networks (CNNs) are widely used in deep learning applications, e.g. visual systems, robotics etc. However, existing software solutions are not efficient. Therefore, many hardware accelerators have been proposed…

Machine Learning · Computer Science 2021-09-08 Sasindu Wijeratne , Sandaruwan Jayaweera , Mahesh Dananjaya , Ajith Pasqual

Model pruning has become a useful technique that improves the computational efficiency of deep learning, making it possible to deploy solutions in resource-limited scenarios. A widely-used practice in relevant work assumes that a…

Machine Learning · Computer Science 2018-02-06 Jianbo Ye , Xin Lu , Zhe Lin , James Z. Wang

We present a novel method of compression of deep Convolutional Neural Networks (CNNs) by weight sharing through a new representation of convolutional filters. The proposed method reduces the number of parameters of each convolutional layer…

Machine Learning · Computer Science 2020-04-13 Yingzhen Yang , Jiahui Yu , Nebojsa Jojic , Jun Huan , Thomas S. Huang

Nowadays most research in visual recognition using Convolutional Neural Networks (CNNs) follows the "deeper model with deeper confidence" belief to gain a higher recognition accuracy. At the same time, deeper model brings heavier…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Mohammad Farhadi , Mehdi Ghasemi , Yezhou Yang

In this paper, we compress convolutional neural network (CNN) weights post-training via transform quantization. Previous CNN quantization techniques tend to ignore the joint statistics of weights and activations, producing sub-optimal CNN…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Sean I. Young , Wang Zhe , David Taubman , Bernd Girod

We present a novel class of convolutional neural networks (CNNs) for set functions, i.e., data indexed with the powerset of a finite set. The convolutions are derived as linear, shift-equivariant functions for various notions of shifts on…

Machine Learning · Computer Science 2024-06-21 Chris Wendler , Dan Alistarh , Markus Püschel

In this work we propose a HyperTransformer, a Transformer-based model for supervised and semi-supervised few-shot learning that generates weights of a convolutional neural network (CNN) directly from support samples. Since the dependence of…

Machine Learning · Computer Science 2022-07-15 Andrey Zhmoginov , Mark Sandler , Max Vladymyrov

This paper introduces an adaptive convolutional neural network (CNN) architecture capable of automating various topology optimization (TO) problems with diverse underlying physics. The proposed architecture has an encoder-decoder-type…

Computational Engineering, Finance, and Science · Computer Science 2024-04-19 Khaish Singh Chadha , Prabhat Kumar

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

This paper introduces AdaptoVision, a novel convolutional neural network (CNN) architecture designed to efficiently balance computational complexity and classification accuracy. By leveraging enhanced residual units, depth-wise separable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Md. Sanaullah Chowdhury Lameya Sabrin

Convolutional neural networks (CNN) are increasingly used in many areas of computer vision. They are particularly attractive because of their ability to "absorb" great quantities of labeled data through millions of parameters. However, as…

Machine Learning · Computer Science 2015-06-16 Wenlin Chen , James T. Wilson , Stephen Tyree , Kilian Q. Weinberger , Yixin Chen

The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for…

Machine Learning · Computer Science 2023-09-01 Clemens JS Schaefer , Siddharth Joshi , Shan Li , Raul Blazquez

We introduce a novel weighted convolution operator that enhances traditional convolutional neural networks (CNNs) by integrating a spatial density function into the convolution operator. This extension enables the network to differentially…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Simone Cammarasana , Giuseppe Patanè

How can we efficiently compress Convolutional Neural Network (CNN) while retaining their accuracy on classification tasks? Depthwise Separable Convolution (DSConv), which replaces a standard convolution with a depthwise convolution and a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Jun-Gi Jang , Chun Quan , Hyun Dong Lee , U Kang

We propose a collection of three shift-based primitives for building efficient compact CNN-based networks. These three primitives (channel shift, address shift, shortcut shift) can reduce the inference time on GPU while maintains the…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Huasong Zhong , Xianggen Liu , Yihui He , Yuchun Ma

Convolutional neural networks (CNN's) are powerful and widely used tools. However, their interpretability is far from ideal. One such shortcoming is the difficulty of deducing a network's ability to generalize to unseen data. We use…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Rickard Brüel Gabrielsson , Gunnar Carlsson

Due to the advent of modern embedded systems and mobile devices with constrained resources, there is a great demand for incredibly efficient deep neural networks for machine learning purposes. There is also a growing concern of privacy and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Priyank Kalgaonkar , Mohamed El-Sharkawy