English
Related papers

Related papers: Depthwise Separable Convolutions for Neural Machin…

200 papers

The high demand for computational and storage resources severely impede the deployment of deep convolutional neural networks (CNNs) in limited-resource devices. Recent CNN architectures have proposed reduced complexity versions (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Souvik Kundu , Saurav Prakash , Haleh Akrami , Peter A. Beerel , Keith M. Chugg

Deep neural networks have recently achieved state of the art performance thanks to new training algorithms for rapid parameter estimation and new regularization methods to reduce overfitting. However, in practice the network architecture…

Machine Learning · Computer Science 2016-03-04 Minyoung Kim , Luca Rigazio

Atrous convolutions are employed as a method to increase the receptive field in semantic segmentation tasks. However, in previous works of semantic segmentation, it was rarely employed in the shallow layers of the model. We revisit the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Zilu Guo , Liuyang Bian , Xuan Huang , Hu Wei , Jingyu Li , Huasheng Ni

Group convolutional neural networks (G-CNNs) have been shown to increase parameter efficiency and model accuracy by incorporating geometric inductive biases. In this work, we investigate the properties of representations learned by regular…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 David M. Knigge , David W. Romero , Erik J. Bekkers

Like other applications in computer vision, medical image segmentation has been most successfully addressed using deep learning models that rely on the convolution operation as their main building block. Convolutions enjoy important…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Davood Karimi , Serge Vasylechko , Ali Gholipour

We present a novel and practical deep fully convolutional neural network architecture for semantic pixel-wise segmentation termed SegNet. This core trainable segmentation engine consists of an encoder network, a corresponding decoder…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Vijay Badrinarayanan , Alex Kendall , Roberto Cipolla

Deep convolutional neural networks (CNNs) have been shown to be very successful in a wide range of image processing applications. However, due to their increasing number of model parameters and an increasing availability of large amounts of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Axel Klawonn , Martin Lanser , Janine Weber

Convolutional neural networks (CNNs) have been widely deployed in the fields of computer vision and pattern recognition because of their high accuracy. However, large convolution operations are computing-intensive that often requires a…

Signal Processing · Electrical Eng. & Systems 2018-09-10 Lin Bai , Yiming Zhao , Xinming Huang

Deep Separable Convolutional Neural Networks (DSCNNs) have become the emerging paradigm by offering modular networks with structural sparsity in order to achieve higher accuracy with relatively lower operations and parameters. However,…

Hardware Architecture · Computer Science 2020-07-21 Mohammadreza Baharani , Ushma Sunil , Kaustubh Manohar , Steven Furgurson , Hamed Tabkhi

Deformable Parts Models and Convolutional Networks each have achieved notable performance in object detection. Yet these two approaches find their strengths in complementary areas: DPMs are well-versed in object composition, modeling…

Computer Vision and Pattern Recognition · Computer Science 2014-11-20 Li Wan , David Eigen , Rob Fergus

Neural networks based on convolutional operations have achieved remarkable results in the field of deep learning, but there are two inherent flaws in standard convolutional operations. On the one hand, the convolution operation is confined…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xin Zhang , Yingze Song , Tingting Song , Degang Yang , Yichen Ye , Jie Zhou , Liming Zhang

Depth completion aims to predict dense depth maps with sparse depth measurements from a depth sensor. Currently, Convolutional Neural Network (CNN) based models are the most popular methods applied to depth completion tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Jian Qian , Miao Sun , Ashley Lee , Jie Li , Shenglong Zhuo , Patrick Yin Chiang

Motivated by the necessity for parameter efficiency in distributed machine learning and AI-enabled edge devices, we provide a general and easy to implement method for significantly reducing the number of parameters of Convolutional Neural…

Machine Learning · Computer Science 2019-08-13 Hamed Omidvar , Vahideh Akhlaghi , Massimo Franceschetti , Rajesh K. Gupta

Recent approaches for music source separation are almost exclusively based on deep neural networks, mostly employing recurrent neural networks (RNNs). Although RNNs are in many cases superior than other types of deep neural networks for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-08 Pyry Pyykkönen , Styliannos I. Mimilakis , Konstantinos Drossos , Tuomas Virtanen

There has been exploding interest in embracing Transformer-based architectures for medical image segmentation. However, the lack of large-scale annotated medical datasets make achieving performances equivalent to those in natural images…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Saikat Roy , Gregor Koehler , Constantin Ulrich , Michael Baumgartner , Jens Petersen , Fabian Isensee , Paul F. Jaeger , Klaus Maier-Hein

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci

For the task of subdecimeter aerial imagery segmentation, fine-grained semantic segmentation results are usually difficult to obtain because of complex remote sensing content and optical conditions. Recently, convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2018-08-28 Kai Yue , Lei Yang , Ruirui Li , Wei Hu , Fan Zhang , Wei Li

Recently, deep learning methods such as the convolutional neural networks have gained prominence in the area of image denoising. This is owing to their proven ability to surpass state-of-the-art classical image denoising algorithms such as…

Image and Video Processing · Electrical Eng. & Systems 2024-09-02 Basit O. Alawode , Mudassir Masood

Dynamic convolution achieves better performance for efficient CNNs at the cost of negligible FLOPs increase. However, the performance increase can not match the significantly expanded number of parameters, which is the main bottleneck in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Shwai He , Chenbo Jiang , Daize Dong , Liang Ding

Deep Learning (DL) based Compressed Sensing (CS) has been applied for better performance of image reconstruction than traditional CS methods. However, most existing DL methods utilize the block-by-block measurement and each measurement…

Image and Video Processing · Electrical Eng. & Systems 2022-09-29 Zhifeng Wang , Zhenghui Wang , Chunyan Zeng , Yan Yu , Xiangkui Wan