English
Related papers

Related papers: Learning $3$D-FilterMap for Deep Convolutional Neu…

200 papers

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

Deep learning methods are powerful tools but often suffer from expensive computation and limited flexibility. An alternative is to combine light-weight models with deep representations. As successful cases exist in several visual problems,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Bin Yang , Junjie Yan , Zhen Lei , Stan Z. Li

Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, it is rarely used to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Feng Jiang , Wen Tao , Shaohui Liu , Jie Ren , Xun Guo , Debin Zhao

DNN structures are continuously developing and achieving high performances in classification problems. Also, it is observed that success rates obtained with DNNs are higher than those obtained with traditional neural networks. In addition,…

Machine Learning · Computer Science 2022-01-02 Tamer Ölmez , Zümray Dokur

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper we establish some analysis for…

Machine Learning · Computer Science 2024-01-03 Jianfei Li , Han Feng , Ding-Xuan Zhou

Light-weight convolutional neural networks (CNNs) suffer performance degradation as their low computational budgets constrain both the depth (number of convolution layers) and the width (number of channels) of CNNs, resulting in limited…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yinpeng Chen , Xiyang Dai , Mengchen Liu , Dongdong Chen , Lu Yuan , Zicheng Liu

Convolutional neural networks (CNNs) demonstrate promising accuracy in a wide range of applications. Among all layers in CNNs, convolution layers are the most computation-intensive and consume the most energy. As the maturity of device and…

Hardware Architecture · Computer Science 2020-04-02 Sho Ko , Yun Joon Soh , Jishen Zhao

Convolutional Neural Networks (CNN) have been regarded as a powerful class of models for image recognition problems. Nevertheless, it is not trivial when utilizing a CNN for learning spatio-temporal video representation. A few studies have…

Computer Vision and Pattern Recognition · Computer Science 2017-11-29 Zhaofan Qiu , Ting Yao , Tao Mei

Joint image filters are used to transfer structural details from a guidance picture used as a prior to a target image, in tasks such as enhancing spatial resolution and suppressing noise. Previous methods based on convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Beomjun Kim , Jean Ponce , Bumsub Ham

Recent efforts have shown machine learning to be useful for the prediction of nonlinear fluid dynamics. Predictive accuracy is often a central motivation for employing neural networks, but the pattern recognition central to the network…

Fluid Dynamics · Physics 2022-08-23 Shizheng Wen , Michael W. Lee , Kai M. Kruger Bastos , Earl H. Dowell

Deep convolutional neural networks (CNNs) are usually over-parameterized, which cannot be easily deployed on edge devices such as mobile phones and smart cameras. Existing works used to decrease the number or size of requested convolution…

Computer Vision and Pattern Recognition · Computer Science 2019-08-07 Kai Han , Yunhe Wang , Yixing Xu , Chunjing Xu , Dacheng Tao , Chang Xu

The volume of convolutional neural network (CNN) models proposed for face recognition has been continuously growing larger to better fit large amount of training data. When training data are obtained from internet, the labels are likely to…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Xiang Wu , Ran He , Zhenan Sun , Tieniu Tan

In modern computer vision tasks, convolutional neural networks (CNNs) are indispensable for image classification tasks due to their efficiency and effectiveness. Part of their superiority compared to other architectures, comes from the fact…

Machine Learning · Computer Science 2019-06-11 Vighnesh Birodkar , Hossein Mobahi , Dilip Krishnan , Samy Bengio

Compressing convolutional neural networks (CNNs) is essential for transferring the success of CNNs to a wide variety of applications to mobile devices. In contrast to directly recognizing subtle weights or filters as redundant in a given…

Machine Learning · Statistics 2017-07-26 Yunhe Wang , Chang Xu , Jiayan Qiu , Chao Xu , Dacheng Tao

Convolutional neural networks (CNNs) are being applied to an increasing number of problems and fields due to their superior performance in classification and regression tasks. Since two of the key operations that CNNs implement are…

Machine Learning · Computer Science 2018-02-27 Fernando Gama , Geert Leus , Antonio G. Marques , Alejandro Ribeiro

Currently, many theoretical as well as practically relevant questions towards the transferability and robustness of Convolutional Neural Networks (CNNs) remain unsolved. While ongoing research efforts are engaging these problems from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Paul Gavrikov , Janis Keuper

Deep convolutional neural networks achieve remarkable visual recognition performance, at the cost of high computational complexity. In this paper, we have a new design of efficient convolutional layers based on three schemes. The 3D…

Computer Vision and Pattern Recognition · Computer Science 2017-01-25 Min Wang , Baoyuan Liu , Hassan Foroosh

State-of-the-art deep learning methods for image processing are evolving into increasingly complex meta-architectures with a growing number of modules. Among them, region-based fully convolutional networks (R-FCN) and deformable…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Stephen Morrell , Zbigniew Wojna , Can Son Khoo , Sebastien Ourselin , Juan Eugenio Iglesias

The distance-geometric graph representation adopts a unified scheme (distance) for representing the geometry of three-dimensional(3D) graphs. It is invariant to rotation and translation of the graph and it reflects pair-wise node…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Daniel T. Chang

Although group convolution operators are increasingly used in deep convolutional neural networks to improve the computational efficiency and to reduce the number of parameters, most existing methods construct their group convolution…

Machine Learning · Computer Science 2020-09-30 Qingbei Guo , Xiao-Jun Wu , Josef Kittler , Zhiquan Feng