English
Related papers

Related papers: Toward Efficient Convolutional Neural Networks Wit…

200 papers

Environmental audio tagging is a newly proposed task to predict the presence or absence of a specific audio event in a chunk. Deep neural network (DNN) based methods have been successfully adopted for predicting the audio tags in the…

Sound · Computer Science 2017-02-28 Yong Xu , Qiuqiang Kong , Qiang Huang , Wenwu Wang , Mark D. Plumbley

We present a novel deep learning architecture in which the convolution operation leverages heterogeneous kernels. The proposed HetConv (Heterogeneous Kernel-Based Convolution) reduces the computation (FLOPs) and the number of parameters as…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Pravendra Singh , Vinay Kumar Verma , Piyush Rai , Vinay P. Namboodiri

Deep neural networks have demonstrated highly competitive performance in super-resolution (SR) for natural images by learning mappings from low-resolution (LR) to high-resolution (HR) images. However, hyperspectral super-resolution remains…

Image and Video Processing · Electrical Eng. & Systems 2025-05-02 Usman Muhammad , Jorma Laaksonen , Lyudmila Mihaylova

Recently, there have been increasing demands to construct compact deep architectures to remove unnecessary redundancy and to improve the inference speed. While many recent works focus on reducing the redundancy by eliminating unneeded…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Eunwoo Kim , Chanho Ahn , Songhwai Oh

Spatial-wise dynamic convolution has become a promising approach to improving the inference efficiency of deep networks. By allocating more computation to the most informative pixels, such an adaptive inference paradigm reduces the spatial…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Yizeng Han , Zhihang Yuan , Yifan Pu , Chenhao Xue , Shiji Song , Guangyu Sun , Gao Huang

Embedding models have become essential tools in both natural language processing and computer vision, enabling efficient semantic search, recommendation, clustering, and more. However, the high memory and computational demands of…

Computation and Language · Computer Science 2024-11-26 Jiayi Chen , Chen Wu , Shaoqun Zhang , Nan Li , Liangjie Zhang , Qi Zhang

The analyses relying on 3D point clouds are an utterly complex task, often involving million of points, but also requiring computationally efficient algorithms because of many real-time applications; e.g. autonomous vehicle. However, point…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Can Chen , Luca Zanotti Fragonara , Antonios Tsourdos

Deep Convolutional Neural Networks (CNNs), such as Dense Convolutional Networks (DenseNet), have achieved great success for image representation by discovering deep hierarchical information. However, most existing networks simply stacks the…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Zhao Zhang , Zemin Tang , Yang Wang , Zheng Zhang , Choujun Zhan , Zhengjun Zha , Meng Wang

Deep learning architectures are showing great promise in various computer vision domains including image classification, object detection, event detection and action recognition. In this study, we investigate various aspects of…

Computer Vision and Pattern Recognition · Computer Science 2016-08-08 Hilal Ergun , Mustafa Sert

The Convolutional Neural Network (CNN) model, often used for image classification, requires significant training time to obtain high accuracy. To this end, distributed training is performed with the parameter server (PS) architecture using…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-18 Jay H. Park , Sunghwan Kim , Jinwon Lee , Myeongjae Jeon , Sam H. Noh

Convolutional Neural Networks (CNNs) have performed extremely well on data represented by regularly arranged grids such as images. However, directly leveraging the classic convolution kernels or parameter sharing mechanisms on sparse 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Mingtao Feng , Liang Zhang , Xuefei Lin , Syed Zulqarnain Gilani , Ajmal Mian

This paper investigates the problem of aerial vehicle recognition using a text-guided deep convolutional neural network classifier. The network receives an aerial image and a desired class, and makes a yes or no output by matching the image…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Amir Soleimani , Nasser M. Nasrabadi , Elias Griffith , Jason Ralph , Simon Maskell

In the search for novel intermetallic ternary alloys, much of the effort goes into performing a large number of ab-initio calculations covering a wide range of compositions and structures. These are essential to build a reliable convex hull…

Materials Science · Physics 2023-08-31 Hugo Rossignol , Michail Minotakis , Matteo Cobelli , Stefano Sanvito

Deep neural networks (DNN) have achieved remarkable success in various fields, including computer vision and natural language processing. However, training an effective DNN model still poses challenges. This paper aims to propose a method…

Machine Learning · Computer Science 2024-07-03 Hejie Ying , Mengmeng Song , Yaohong Tang , Shungen Xiao , Zimin Xiao

Artificial Intelligence algorithms have been steadily increasing in popularity and usage. Deep Learning, allows neural networks to be trained using huge datasets and also removes the need for human extracted features, as it automates the…

Neural and Evolutionary Computing · Computer Science 2020-05-11 Vasco Lopes , Paulo Fazendeiro

For the task of subdecimeter aerial imagery segmentation, fine-grained semantic segmentation results are usually difficult to obtain because of complex remote sensing content and optical conditions. Recently, convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Kai Yue , Lei Yang , Ruirui Li , Wei Hu , Fan Zhang , Wei Li

We demonstrate that 1x1-convolutions in 1D time-channel separable convolutions may be replaced by constant, sparse random ternary matrices with weights in $\{-1,0,+1\}$. Such layers do not perform any multiplications and do not require…

Machine Learning · Computer Science 2021-10-22 Gonçalo Mordido , Matthijs Van Keirsbilck , Alexander Keller

We introduce compositional tensor trains (CTTs) for the approximation of multivariate functions, a class of models obtained by composing low-rank functions in the tensor-train format. This format can encode standard approximation tools,…

Numerical Analysis · Mathematics 2025-12-23 Martin Eigel , Charles Miranda , Anthony Nouy , David Sommer

Convolutional Neural Networks (CNNs) have demonstrated exceptional performance in recent years. Compressing these models not only reduces storage requirements, making deployment to edge devices feasible, but also accelerates inference,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Boyao Wang , Volodymyr Kindratenko

Deep convolutional neural networks (CNNs) have recently achieved great success for single image super-resolution (SISR) task due to their powerful feature representation capabilities. The most recent deep learning based SISR methods focus…

Image and Video Processing · Electrical Eng. & Systems 2020-09-11 Rao Muhammad Umer , Gian Luca Foresti , Christian Micheloni