English
Related papers

Related papers: Exploiting Kernel Sparsity and Entropy for Interpr…

200 papers

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

To equip Convolutional Neural Networks (CNNs) with explainability, it is essential to interpret how opaque models take specific decisions, understand what causes the errors, improve the architecture design, and identify unethical biases in…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Mohammad Mahdi Dehshibi , Mona Ashtari-Majlan , Gereziher Adhane , David Masip

There has been significant focus on creating neuro-symbolic models for interpretable image classification using Convolutional Neural Networks (CNNs). These methods aim to replace the CNN with a neuro-symbolic model consisting of the CNN,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Parth Padalkar , Jaeseong Lee , Shiyi Wei , Gopal Gupta

Recent advances in deep learning have made available large, powerful convolutional neural networks (CNN) with state-of-the-art performance in several real-world applications. Unfortunately, these large-sized models have millions of…

Machine Learning · Computer Science 2020-07-17 Giosuè Cataldo Marinò , Gregorio Ghidoli , Marco Frasca , Dario Malchiodi

Convolutional neural networks (CNNs) have become increasingly difficult to deploy in resource-constrained environments due to their large memory and computational requirements. Although low-rank compression methods can reduce this burden,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Sisipho Hamlomo , Marcellin Atemkeng , Habte Tadesse Likassa , Blaise Ravelo , Thierry Bouwmans , Sébastien Lalléchère , Antoine Vacavant , Ding-Geng Chen

In today's world, image processing plays a crucial role across various fields, from scientific research to industrial applications. But one particularly exciting application is image captioning. The potential impact of effective image…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Md Alif Rahman Ridoy , M Mahmud Hasan , Shovon Bhowmick

The current trend of pushing CNNs deeper with convolutions has created a pressing demand to achieve higher compression gains on CNNs where convolutions dominate the computation and parameter amount (e.g., GoogLeNet, ResNet and Wide ResNet).…

Machine Learning · Computer Science 2018-06-26 Junru Wu , Yue Wang , Zhenyu Wu , Zhangyang Wang , Ashok Veeraraghavan , Yingyan Lin

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

This paper studies the computational offloading of CNN inference in dynamic multi-access edge computing (MEC) networks. To address the uncertainties in communication time and computation resource availability, we propose a novel semantic…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Nan Li , Alexandros Iosifidis , Qi Zhang

The learning capability of a neural network improves with increasing depth at higher computational costs. Wider layers with dense kernel connectivity patterns furhter increase this cost and may hinder real-time inference. We propose feature…

Machine Learning · Computer Science 2016-11-01 Sajid Anwar , Wonyong Sung

Conventional deep convolutional neural networks (CNNs) apply convolution operators uniformly in space across all feature maps for hundreds of layers - this incurs a high computational cost for real-time applications. For many problems such…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Mengye Ren , Andrei Pokrovsky , Bin Yang , Raquel Urtasun

The high demand for computational and storage resources severely impede the deployment of deep convolutional neural networks (CNNs) in limited-resource devices. Recent CNN architectures have proposed reduced complexity versions (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Souvik Kundu , Saurav Prakash , Haleh Akrami , Peter A. Beerel , Keith M. Chugg

Channel pruning is widely accepted to accelerate modern convolutional neural networks (CNNs). The resulting pruned model benefits from its immediate deployment on general-purpose software and hardware resources. However, its large pruning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Mincheol Park , Dongjin Kim , Cheonjun Park , Yuna Park , Gyeong Eun Gong , Won Woo Ro , Suhyun Kim

We present a lossy image compression method based on deep convolutional neural networks (CNNs), which outperforms the existing BPG, WebP, JPEG2000 and JPEG as measured via multi-scale structural similarity (MS-SSIM), at the same bit rate.…

Image and Video Processing · Electrical Eng. & Systems 2018-06-06 Haojie Liu , Tong Chen , Qiu Shen , Tao Yue , Zhan Ma

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relatively high memory…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chaim Baskin , Brian Chmiel , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , Avi Mendelson

Convolutional Neural Networks (CNNs) have achieved significant breakthroughs in various fields. However, these advancements have led to a substantial increase in the complexity and size of these networks. This poses a challenge when…

Machine Learning · Computer Science 2025-09-11 Ahmed Sadaqa , Di Liu

This paper presents a novel network compression framework Kernel Quantization (KQ), targeting to efficiently convert any pre-trained full-precision convolutional neural network (CNN) model into a low-precision version without significant…

Machine Learning · Computer Science 2020-03-12 Zhongzhi Yu , Yemin Shi , Tiejun Huang , Yizhou Yu

Neural saturation in Deep Neural Networks (DNNs) has been studied extensively, but remains relatively unexplored in Convolutional Neural Networks (CNNs). Understanding and alleviating the effects of convolutional kernel saturation is…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Nidhi Gowdra , Roopak Sinha , Stephen MacDonell

Motivated by recent work on deep neural network (DNN)-based image compression methods showing potential improvements in image quality, savings in storage, and bandwidth reduction, we propose to perform image understanding tasks such as…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Robert Torfason , Fabian Mentzer , Eirikur Agustsson , Michael Tschannen , Radu Timofte , Luc Van Gool