English
Related papers

Related papers: Teaching Compositionality to CNNs

200 papers

One of the key limitations of modern deep learning approaches lies in the amount of data required to train them. Humans, by contrast, can learn to recognize novel categories from just a few examples. Instrumental to this rapid learning…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Pavel Tokmakov , Yu-Xiong Wang , Martial Hebert

In this paper we review the mathematical foundations of convolutional neural nets (CNNs) with the goals of: i) highlighting connections with techniques from statistics, signal processing, linear algebra, differential equations, and…

Machine Learning · Computer Science 2021-07-08 Shengli Jiang , Victor M. Zavala

Pre-trained convolutional neural networks (CNNs) are powerful off-the-shelf feature generators and have been shown to perform very well on a variety of tasks. Unfortunately, the generated features are high dimensional and expensive to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Saurabh Singh , Sami Abu-El-Haija , Nick Johnston , Johannes Ballé , Abhinav Shrivastava , George Toderici

Convolutional neural networks (CNNs) have achieved state-of-the-art results on many visual recognition tasks. However, current CNN models still exhibit a poor ability to be invariant to spatial transformations of images. Intuitively, with…

Computer Vision and Pattern Recognition · Computer Science 2019-12-04 Xu Shen , Xinmei Tian , Anfeng He , Shaoyan Sun , Dacheng Tao

Recent experiments in computer vision demonstrate texture bias as the primary reason for supreme results in models employing Convolutional Neural Networks (CNNs), conflicting with early works claiming that these networks identify objects…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Satyam Mohla , Anshul Nasery , Biplab Banerjee

Visual interpretability of Convolutional Neural Networks (CNNs) has gained significant popularity because of the great challenges that CNN complexity imposes to understanding their inner workings. Although many techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Alexandros Stergiou

In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge…

Machine Learning · Computer Science 2016-01-11 Alec Radford , Luke Metz , Soumith Chintala

In recent years, representation learning approaches have disrupted many multimedia computing tasks. Among those approaches, deep convolutional neural networks (CNNs) have notably reached human level expertise on some constrained image…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Lucas Pascal , Xavier Bost , Benoît Huet

Convolutional neural networks (CNNs) have enabled the state-of-the-art performance in many computer vision tasks. However, little effort has been devoted to establishing convolution in non-linear space. Existing works mainly leverage on the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Chen Wang , Jianfei Yang , Lihua Xie , Junsong Yuan

The convolutional neural network (CNN) learns the same object in different positions in images, which can improve the recognition accuracy of the model. An implication of this is that CNN may know where the object is. The usefulness of the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Nan Yang , Laicheng Zhong , Fan Huang , Dong Yuan , Wei Bao

We present an approach to utilize large amounts of web data for learning CNNs. Specifically inspired by curriculum learning, we present a two-step approach for CNN training. First, we use easy images to train an initial visual…

Computer Vision and Pattern Recognition · Computer Science 2015-10-09 Xinlei Chen , Abhinav Gupta

We describe the class of convexified convolutional neural networks (CCNNs), which capture the parameter sharing of convolutional neural networks in a convex manner. By representing the nonlinear convolutional filters as vectors in a…

Machine Learning · Computer Science 2016-09-06 Yuchen Zhang , Percy Liang , Martin J. Wainwright

Convolutional neural networks (CNNs) have been successfully applied on both discriminative and generative modeling for music-related tasks. For a particular task, the trained CNN contains information representing the decision making or the…

Sound · Computer Science 2017-06-30 S. Geng , G. Ren , M. Ogihara

Deep convolutional neural networks (CNNs) have demonstrated impressive performance on visual object classification tasks. In addition, it is a useful model for predication of neuronal responses recorded in visual system. However, there is…

Machine Learning · Statistics 2017-11-15 Qi Yan , Zhaofei Yu , Feng Chen , Jian K. Liu

Neural networks are very powerful learning systems, but they do not readily generalize from one task to the other. This is partly due to the fact that they do not learn in a compositional way, that is, by discovering skills that are shared…

Artificial Intelligence · Computer Science 2018-07-27 Adam Liška , Germán Kruszewski , Marco Baroni

This paper presents an unsupervised method to learn a neural network, namely an explainer, to interpret a pre-trained convolutional neural network (CNN), i.e., explaining knowledge representations hidden in middle conv-layers of the CNN.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Quanshi Zhang , Yu Yang , Yuchen Liu , Ying Nian Wu , Song-Chun Zhu

Convolutional Neural Networks (CNNs) have been the standard for image classification tasks for a long time, but more recently attention-based mechanisms have gained traction. This project aims to compare traditional CNNs with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Nikhil Kapila , Julian Glattki , Tejas Rathi

Convolutional Neural Networks (CNNs) are the state-of-the-art algorithms for the processing of images. However the configuration and training of these networks is a complex task requiring deep domain knowledge, experience and much trial and…

Computer Vision and Pattern Recognition · Computer Science 2021-02-11 Yaron Strauch , Jo Grundy

A Convolutional Neural Network (CNN) is sometimes confronted with objects of changing appearance ( new instances) that exceed its generalization capability. This requires the CNN to incorporate new knowledge, i.e., to learn incrementally.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Tobias Scheck , Ana Perez Grassi , Gangolf Hirtz

Convolutional Neural Networks (CNNs) have achieved impressive performance on many computer vision related tasks, such as object detection, image recognition, image retrieval, etc. These achievements benefit from the CNNs' outstanding…

Machine Learning · Computer Science 2021-11-09 Dung Truong , Scott Makeig , Arnaud Delorme