中文
相关论文

相关论文: Designing Concise ConvNets with Columnar Stages

200 篇论文

Inception and the Resnet family of Convolutional Neural Network archi-tectures have broken records in the past few years, but recent state of the art models have also incurred very high computational cost in terms of training, inference and…

计算机视觉与模式识别 · 计算机科学 2018-02-08 John Olafenwa , Moses Olafenwa

We present a logarithmic-scale efficient convolutional neural network architecture for edge devices, named WaveletNet. Our model is based on the well-known depthwise convolution, and on two new layers, which we introduce in this work: a…

机器学习 · 计算机科学 2018-11-29 Li Jing , Rumen Dangovski , Marin Soljacic

The concept of compressing deep Convolutional Neural Networks (CNNs) is essential to use limited computation, power, and memory resources on embedded devices. However, existing methods achieve this objective at the cost of a drop in…

计算机视觉与模式识别 · 计算机科学 2021-04-20 Waqar Ahmed , Andrea Zunino , Pietro Morerio , Vittorio Murino

In order to enhance the real-time performance of convolutional neural networks(CNNs), more and more researchers are focusing on improving the efficiency of CNN. Based on the analysis of some CNN architectures, such as ResNet, DenseNet,…

计算机视觉与模式识别 · 计算机科学 2018-03-16 Qiuyu Zhu , Ruixin Zhang

In this paper, we introduce Channel-wise recurrent convolutional neural networks (RecNets), a family of novel, compact neural network architectures for computer vision tasks inspired by recurrent neural networks (RNNs). RecNets build upon…

机器学习 · 计算机科学 2020-03-23 George Retsinas , Athena Elafrou , Georgios Goumas , Petros Maragos

It is a challenging task to accurately perform semantic segmentation due to the complexity of real picture scenes. Many semantic segmentation methods based on traditional deep learning insufficiently captured the semantic and appearance…

计算机视觉与模式识别 · 计算机科学 2024-03-13 Haitong Tang , Shuang He , Mengduo Yang , Xia Lu , Qin Yu , Kaiyue Liu , Hongjie Yan , Nizhuan Wang

Most modern convolutional neural networks (CNNs) used for object recognition are built using the same principles: Alternating convolution and max-pooling layers followed by a small number of fully connected layers. We re-evaluate the state…

机器学习 · 计算机科学 2015-04-14 Jost Tobias Springenberg , Alexey Dosovitskiy , Thomas Brox , Martin Riedmiller

Convolutional neural networks (CNNs) are a popular choice of model for tasks in computer vision. When CNNs are made with many layers, resulting in a deep neural network, skip connections may be added to create an easier gradient…

计算机视觉与模式识别 · 计算机科学 2024-08-16 Johnny Joyce , Jan Verschelde

We introduce an extremely computation-efficient CNN architecture named ShuffleNet, which is designed specially for mobile devices with very limited computing power (e.g., 10-150 MFLOPs). The new architecture utilizes two new operations,…

计算机视觉与模式识别 · 计算机科学 2017-12-08 Xiangyu Zhang , Xinyu Zhou , Mengxiao Lin , Jian Sun

Convolutional neural networks (CNNs) are inherently suffering from massively redundant computation (FLOPs) due to the dense connection pattern between feature maps and convolution kernels. Recent research has investigated the sparse…

计算机视觉与模式识别 · 计算机科学 2019-11-04 Dandan Li , Yuan Zhou , Shuwei Huo , Sun-Yuan Kung

Convolutional Neural Networks (CNNs) can provide accurate object classification. They can be extended to perform object detection by iterating over dense or selected proposed object regions. However, the runtime of such detectors scales as…

计算机视觉与模式识别 · 计算机科学 2014-04-08 Forrest Iandola , Matt Moskewicz , Sergey Karayev , Ross Girshick , Trevor Darrell , Kurt Keutzer

The high energy cost of processing deep convolutional neural networks impedes their ubiquitous deployment in energy-constrained platforms such as embedded systems and IoT devices. This work introduces convolutional layers with pre-defined…

计算机视觉与模式识别 · 计算机科学 2020-02-06 Souvik Kundu , Mahdi Nazemi , Massoud Pedram , Keith M. Chugg , Peter A. Beerel

This paper reveals a new appeal of the recently emerged large-kernel Convolutional Neural Networks (ConvNets): as the teacher in Knowledge Distillation (KD) for small-kernel ConvNets. While Transformers have led state-of-the-art (SOTA)…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Tianjin Huang , Lu Yin , Zhenyu Zhang , Li Shen , Meng Fang , Mykola Pechenizkiy , Zhangyang Wang , Shiwei Liu

Object detection is a challenging task in visual understanding domain, and even more so if the supervision is to be weak. Recently, few efforts to handle the task without expensive human annotations is established by promising deep neural…

计算机视觉与模式识别 · 计算机科学 2016-11-28 Ali Diba , Vivek Sharma , Ali Pazandeh , Hamed Pirsiavash , Luc Van Gool

Deep neural networks (DNNs), especially deep convolutional neural networks (CNNs), have emerged as the powerful technique in various machine learning applications. However, the large model sizes of DNNs yield high demands on computation…

计算机视觉与模式识别 · 计算机科学 2019-03-01 Siyu Liao , Zhe Li , Liang Zhao , Qinru Qiu , Yanzhi Wang , Bo Yuan

In this paper, we propose a novel approach for the optimal identification of correlated segments in noisy correlation matrices. The proposed model is known as CoSeNet (Correlation Seg-mentation Network) and is based on a four-layer…

Improving information flow in deep networks helps to ease the training difficulties and utilize parameters more efficiently. Here we propose a new convolutional neural network architecture with alternately updated clique (CliqueNet). In…

计算机视觉与模式识别 · 计算机科学 2018-04-04 Yibo Yang , Zhisheng Zhong , Tiancheng Shen , Zhouchen Lin

Convolutional Neural Networks (CNNs) have gained widespread popularity in the field of computer vision and image processing. Due to huge computational requirements of CNNs, dedicated hardware-based implementations are being explored to…

信号处理 · 电气工程与系统科学 2019-03-06 Afzal Ahmad , Muhammad Adeel Pasha

A key component to the success of deep learning is the availability of massive amounts of training data. Building and annotating large datasets for solving medical image classification problems is today a bottleneck for many applications.…

计算机视觉与模式识别 · 计算机科学 2019-02-05 Amelia Jiménez-Sánchez , Shadi Albarqouni , Diana Mateus

In the past decade, convolutional neural networks (CNNs) have shown prominence for semantic segmentation. Although CNN models have very impressive performance, the ability to capture global representation is still insufficient, which…

计算机视觉与模式识别 · 计算机科学 2023-02-22 Guoan Xu , Juncheng Li , Guangwei Gao , Huimin Lu , Jian Yang , Dong Yue