English
Related papers

Related papers: Spectral Representations for Convolutional Neural …

200 papers

Complex-valued neural networks (CVNNs) are an emerging field of research in neural networks due to their potential representational properties for audio, image, and physiological signals. It is common in signal processing to transform…

Machine Learning · Computer Science 2015-11-20 Andy M. Sarroff , Victor Shepardson , Michael A. Casey

We reduce training time in convolutional networks (CNNs) with a method that, for some of the mini-batches: a) scales down the resolution of input images via downsampling, and b) reduces the forward pass operations via pooling on the…

Machine Learning · Computer Science 2019-10-16 Zissis Poulos , Ali Nouri , Andreas Moshovos

In this study, we propose the integration of competitive learning into convolutional neural networks (CNNs) to improve the representation learning and efficiency of fine-tuning. Conventional CNNs use back propagation learning, and it…

Machine Learning · Computer Science 2018-04-27 Takashi Shinozaki

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

Deep learning based on deep neural networks has been very successful in many practical applications, but it lacks enough theoretical understanding due to the network architectures and structures. In this paper we establish some analysis for…

Machine Learning · Computer Science 2024-01-03 Jianfei Li , Han Feng , Ding-Xuan Zhou

Deep networks, especially convolutional neural networks (CNNs), have been successfully applied in various areas of machine learning as well as to challenging problems in other scientific and engineering fields. This paper introduces…

Numerical Analysis · Mathematics 2020-05-04 Yingzhou Li , Xiuyuan Cheng , Jianfeng Lu

Deep learning has been widely used for hyperspectral pixel classification due to its ability of generating deep feature representation. However, how to construct an efficient and powerful network suitable for hyperspectral data is still…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Jingzhou Chen , Siyu Chen , Peilin Zhou , Yuntao Qian

Both the Dictionary Learning (DL) and Convolutional Neural Networks (CNN) are powerful image representation learning systems based on different mechanisms and principles, however whether we can seamlessly integrate them to improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-16 Zhao Zhang , Yulin Sun , Yang Wang , Zhengjun Zha , Shuicheng Yan , Meng Wang

In recent years, Convolutional Neural Networks (CNNs) have enabled ubiquitous image processing applications. As such, CNNs require fast runtime (forward propagation) to process high-resolution visual streams in real time. This is still a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jinlin Xiang , Shane Colburn , Arka Majumdar , Eli Shlizerman

Deep convolutional neural networks (CNN) have shown their promise as a universal representation for recognition. However, global CNN activations lack geometric invariance, which limits their robustness for classification and matching of…

Computer Vision and Pattern Recognition · Computer Science 2014-09-10 Yunchao Gong , Liwei Wang , Ruiqi Guo , Svetlana Lazebnik

Convolutional Neural Networks (CNNs) have demonstrated state-of-the-art performance on many visual recognition tasks. However, the combination of convolution and pooling operations only shows invariance to small local location changes in…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Xu Shen , Xinmei Tian , Shaoyan Sun , Dacheng Tao

Deep neural networks, albeit their great success on feature learning in various computer vision tasks, are usually considered as impractical for online visual tracking because they require very long training time and a large number of…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Hanxi Li , Yi Li , Fatih Porikli

This paper presents a significant improvement for the synthesis of texture images using convolutional neural networks (CNNs), making use of constraints on the Fourier spectrum of the results. More precisely, the texture synthesis is…

Computer Vision and Pattern Recognition · Computer Science 2016-05-20 Gang Liu , Yann Gousseau , Gui-Song Xia

We show how parameter redundancy in Convolutional Neural Network (CNN) filters can be effectively reduced by pruning in spectral domain. Specifically, the representation extracted via Discrete Cosine Transform (DCT) is more conducive for…

Machine Learning · Computer Science 2020-10-26 Matej Ulicny , Vladimir A. Krylov , Rozenn Dahyot

Convolutional Neural Networks (CNNs) are well established models capable of achieving state-of-the-art classification accuracy for various computer vision tasks. However, they are becoming increasingly larger, using millions of parameters,…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Nikolaos Passalis , Anastasios Tefas

Deep learning methods are powerful tools but often suffer from expensive computation and limited flexibility. An alternative is to combine light-weight models with deep representations. As successful cases exist in several visual problems,…

Computer Vision and Pattern Recognition · Computer Science 2015-09-25 Bin Yang , Junjie Yan , Zhen Lei , Stan Z. Li

Deep convolutional networks have attracted great attention in image restoration and enhancement. Generally, restoration quality has been improved by building more and more convolutional block. However, these methods mostly learn a specific…

Computer Vision and Pattern Recognition · Computer Science 2021-05-21 Yukai Shi , Jinghui Qin

In this work we describe a Convolutional Neural Network (CNN) to accurately predict the scene illumination. Taking image patches as input, the CNN works in the spatial domain without using hand-crafted features that are employed by most…

Computer Vision and Pattern Recognition · Computer Science 2015-04-20 Simone Bianco , Claudio Cusano , Raimondo Schettini

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

In this paper we introduce a novel method for segmentation that can benefit from general semantics of Convolutional Neural Network (CNN). Our segmentation proposes visually and semantically coherent image segments. We use binary encoding of…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Mahdyar Ravanbakhsh , Hossein Mousavi , Moin Nabi , Lucio Marcenaro , Carlo Regazzoni