English
Related papers

Related papers: Towards a General Purpose CNN for Long Range Depen…

200 papers

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

Deep neural networks (DNNs), especially deep convolutional neural networks (CNNs), have emerged as the powerful technique in various machine learning applications. However, the large model sizes of DNNs yield high demands on computation…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Siyu Liao , Zhe Li , Liang Zhao , Qinru Qiu , Yanzhi Wang , Bo Yuan

In this work we introduce a convolutional neural network (CNN) that jointly handles low-, mid-, and high-level vision tasks in a unified architecture that is trained end-to-end. Such a universal network can act like a `swiss knife' for…

Computer Vision and Pattern Recognition · Computer Science 2016-09-08 Iasonas Kokkinos

Deep neural networks (DNNs) and, in particular, convolutional neural networks (CNNs) have brought significant advances in a wide range of modern computer application problems. However, the increasing availability of large amounts of…

Machine Learning · Computer Science 2024-07-03 Axel Klawonn , Martin Lanser , Janine Weber

Models based on deep convolutional networks have dominated recent image interpretation tasks; we investigate whether models which are also recurrent, or "temporally deep", are effective for tasks involving sequences, visual and otherwise.…

Computer Vision and Pattern Recognition · Computer Science 2016-06-02 Jeff Donahue , Lisa Anne Hendricks , Marcus Rohrbach , Subhashini Venugopalan , Sergio Guadarrama , Kate Saenko , Trevor Darrell

Existing deep convolutional neural networks (CNNs) have shown their great success on image classification. CNNs mainly consist of convolutional and pooling layers, both of which are performed on local image areas without considering the…

Computer Vision and Pattern Recognition · Computer Science 2016-06-29 Zhen Zuo , Bing Shuai , Gang Wang , Xiao Liu , Xingxing Wang , Bing Wang

In the last few years, deep learning has led to very good performance on a variety of problems, such as visual recognition, speech recognition and natural language processing. Among different types of deep neural networks, convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-10-20 Jiuxiang Gu , Zhenhua Wang , Jason Kuen , Lianyang Ma , Amir Shahroudy , Bing Shuai , Ting Liu , Xingxing Wang , Li Wang , Gang Wang , Jianfei Cai , Tsuhan Chen

This paper presents a comparative study of a custom convolutional neural network (CNN) architecture against widely used pretrained and transfer learning CNN models across five real-world image datasets. The datasets span binary…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Mahmudul Hasan , Mabsur Fatin Bin Hossain

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

Deploying deep convolutional neural networks (CNNs) on resource-constrained devices presents significant challenges due to their high computational demands and rigid, static architectures. To overcome these limitations, this thesis explores…

Machine Learning · Computer Science 2025-05-20 Pooja Mangal , Sudaksh Kalra , Dolly Sapra

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

Deep convolutional neural networks (CNNs) have been shown to perform extremely well at a variety of tasks including subtasks of autonomous driving such as image segmentation and object classification. However, networks designed for these…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Yiqi Hou , Sascha Hornauer , Karl Zipser

Traditional architectures for solving computer vision problems and the degree of success they enjoyed have been heavily reliant on hand-crafted features. However, of late, deep learning techniques have offered a compelling alternative --…

Computer Vision and Pattern Recognition · Computer Science 2016-01-26 Suraj Srinivas , Ravi Kiran Sarvadevabhatla , Konda Reddy Mopuri , Nikita Prabhu , Srinivas S S Kruthiventi , R. Venkatesh Babu

A basic operation in Convolutional Neural Networks (CNNs) is spatial resizing of feature maps. This is done either by strided convolution (donwscaling) or transposed convolution (upscaling). Such operations are limited to a fixed filter…

Machine Learning · Computer Science 2020-06-22 Assaf Shocher , Ben Feinstein , Niv Haim , Michal Irani

CNNs and computational models of biological vision share some fundamental principles, which opened new avenues of research. However, fruitful cross-field research is hampered by conventional CNN architectures being based on spatially and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Nergis Tomen , Silvia L. Pintea , Jan C. van Gemert

Convolutional Neural Networks (CNNs) have shown strong promise for analyzing scientific data from many domains including particle imaging detectors. However, the challenge of choosing the appropriate network architecture (depth, kernel…

Computer Vision and Pattern Recognition · Computer Science 2020-01-13 Duc Hoang , Jesse Hamer , Gabriel N. Perdue , Steven R. Young , Jonathan Miller , Anushree Ghosh

In this paper we review the mathematical foundations of convolutional neural nets (CNNs) with the goals of: i) highlighting connections with techniques from statistics, signal processing, linear algebra, differential equations, and…

Machine Learning · Computer Science 2021-07-08 Shengli Jiang , Victor M. Zavala

When optimizing convolutional neural networks (CNN) for a specific image-based task, specialists commonly overshoot the number of convolutional layers in their designs. By implication, these CNNs are unnecessarily resource intensive to…

Machine Learning · Computer Science 2022-06-23 Mats L. Richter , Julius Schöning , Anna Wiedenroth , Ulf Krumnack

Leveraging large data sets, deep Convolutional Neural Networks (CNNs) achieve state-of-the-art recognition accuracy. Due to the substantial compute and memory operations, however, they require significant execution time. The massive…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-13 Chao Li , Yi Yang , Min Feng , Srimat Chakradhar , Huiyang Zhou

A convolutional layer in a Convolutional Neural Network (CNN) consists of many filters which apply convolution operation to the input, capture some special patterns and pass the result to the next layer. If the same patterns also occur at…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Okan Köpüklü , Maryam Babaee , Stefan Hörmann , Gerhard Rigoll