English
Related papers

Related papers: Factorized Higher-Order CNNs with an Application t…

200 papers

In this paper, we address the issue of how to enhance the generalization performance of convolutional neural networks (CNN) in the early learning stage for image classification. This is motivated by real-time applications that require the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Xishuang Dong , Hsiang-Huang Wu , Yuzhong Yan , Lijun Qian

We propose a simple two-step approach for speeding up convolution layers within large convolutional neural networks based on tensor decomposition and discriminative fine-tuning. Given a layer, we use non-linear least squares to compute a…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Vadim Lebedev , Yaroslav Ganin , Maksim Rakhuba , Ivan Oseledets , Victor Lempitsky

We address the computational barrier of deploying advanced deep learning segmentation models in clinical settings by studying the efficacy of network compression through tensor decomposition. We propose a post-training Tucker factorization…

Image and Video Processing · Electrical Eng. & Systems 2024-04-19 Tobias Weber , Jakob Dexl , David Rügamer , Michael Ingrisch

Recent advances in sensing technologies require the design and development of pattern recognition models capable of processing spatiotemporal data efficiently. In this study, we propose a spatially and temporally aware tensor-based neural…

Most state of the art deep neural networks are overparameterized and exhibit a high computational cost. A straightforward approach to this problem is to replace convolutional kernels with its low-rank tensor approximations, whereas the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Anh-Huy Phan , Konstantin Sobolev , Konstantin Sozykin , Dmitry Ermilov , Julia Gusak , Petr Tichavsky , Valeriy Glukhov , Ivan Oseledets , Andrzej Cichocki

Deep learning has been applied to achieve significant progress in emotion recognition. Despite such substantial progress, existing approaches are still hindered by insufficient training data, and the resulting models do not generalize well…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , Son N. Tran , Rui Zeng , Clinton Fookes

Convolutional Neural Networks (CNNs) have achieved remarkable success in various computer vision tasks but rely on tremendous computational cost. To solve this problem, existing approaches either compress well-trained large-scale models or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Chen Zhang , Yinghao Xu , Yujun Shen

It is well believed that video captioning is a fundamental but challenging task in both computer vision and artificial intelligence fields. The prevalent approach is to map an input video to a variable-length output sentence in a sequence…

Computer Vision and Pattern Recognition · Computer Science 2019-05-06 Jingwen Chen , Yingwei Pan , Yehao Li , Ting Yao , Hongyang Chao , Tao Mei

Convolutional neural network (CNN) has achieved state-of-the-art performance in many different visual tasks. Learned from a large-scale training dataset, CNN features are much more discriminative and accurate than the hand-crafted features.…

Computer Vision and Pattern Recognition · Computer Science 2016-02-01 Guo-Sen Xie , Xu-Yao Zhang , Shuicheng Yan , Cheng-Lin Liu

Emotion being a subjective thing, leveraging knowledge and science behind labeled data and extracting the components that constitute it, has been a challenging problem in the industry for many years. With the evolution of deep learning in…

Computer Vision and Pattern Recognition · Computer Science 2017-06-07 Prudhvi Raj Dachapally

A popular method to reduce the training time of deep neural networks is to normalize activations at each layer. Although various normalization schemes have been proposed, they all follow a common theme: normalize across spatial dimensions…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Boyi Li , Felix Wu , Kilian Q. Weinberger , Serge Belongie

A low-rank transformation learning framework for subspace clustering and classification is here proposed. Many high-dimensional data, such as face images and motion sequences, approximately lie in a union of low-dimensional subspaces. The…

Computer Vision and Pattern Recognition · Computer Science 2014-03-11 Qiang Qiu , Guillermo Sapiro

The state-of-the-art performance for several real-world problems is currently reached by convolutional neural networks (CNN). Such learning models exploit recent results in the field of deep learning, typically leading to highly performing,…

Machine Learning · Computer Science 2021-08-31 Giosuè Cataldo Marinò , Alessandro Petrini , Dario Malchiodi , Marco Frasca

Early diagnosis of interstitial lung diseases is crucial for their treatment, but even experienced physicians find it difficult, as their clinical manifestations are similar. In order to assist with the diagnosis, computer-aided diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Stergios Christodoulidis , Marios Anthimopoulos , Lukas Ebner , Andreas Christe , Stavroula Mougiakakou

Deep learning has been widely adopted in automatic emotion recognition and has lead to significant progress in the field. However, due to insufficient annotated emotion datasets, pre-trained models are limited in their generalization…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Dung Nguyen , Sridha Sridharan , Duc Thanh Nguyen , Simon Denman , David Dean , Clinton Fookes

Deep neural networks are representation learning techniques. During training, a deep net is capable of generating a descriptive language of unprecedented size and detail in machine learning. Extracting the descriptive language coded within…

Neural and Evolutionary Computing · Computer Science 2018-01-30 Dario Garcia-Gasulla , Ferran Parés , Armand Vilalta , Jonatan Moreno , Eduard Ayguadé , Jesús Labarta , Ulises Cortés , Toyotaro Suzumura

Convolutional neural network (CNN) based methods have achieved great successes in medical image segmentation, but their capability to learn global representations is still limited due to using small effective receptive fields of convolution…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Pengfei Gu , Yejia Zhang , Chaoli Wang , Danny Z. Chen

Convolutional Neural Networks (CNNs) is one of successful method in many areas such as image classification tasks. However, the amount of memory and computational cost needed for CNNs inference obstructs them to run efficiently in mobile…

Machine Learning · Computer Science 2018-01-17 Marcella Astrid , Seung-Ik Lee , Beom-Su Seo

It is well known that multiplication operations in convolutional layers of common CNNs consume a lot of time during inference stage. In this article we present a flexible method to decrease both computational complexity of convolutional…

Machine Learning · Computer Science 2018-10-23 D. Babin , I. Mazurenko , D. Parkhomenko , A. Voloshko

Available super-resolution techniques for 3D images are either computationally inefficient prior-knowledge-based iterative techniques or deep learning methods which require a large database of known low- and high-resolution image pairs. A…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Janka Hatvani , Adrian Basarab , Jean-Yves Tourneret , Miklós Gyöngy , Denis Kouamé