English
Related papers

Related papers: Visualized Insights into the Optimization Landscap…

200 papers

Convolutional neural networks (CNNs) have massively impacted visual recognition in 2D images, and are now ubiquitous in state-of-the-art approaches. CNNs do not easily extend, however, to data that are not represented by regular grids, such…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Nitika Verma , Edmond Boyer , Jakob Verbeek

Convolutional Neural Networks (CNNs) have achieved comparable error rates to well-trained human on ILSVRC2014 image classification task. To achieve better performance, the complexity of CNNs is continually increasing with deeper and bigger…

Computer Vision and Pattern Recognition · Computer Science 2014-12-30 Wei Yu , Kuiyuan Yang , Yalong Bai , Hongxun Yao , Yong Rui

Graph neural networks (GNNs) have demonstrated remarkable capabilities in learning from graph-structured data, often outperforming traditional Multilayer Perceptrons (MLPs) in numerous graph-based tasks. Although existing works have…

Machine Learning · Computer Science 2025-06-09 Wei Huang , Yuan Cao , Haonan Wang , Xin Cao , Taiji Suzuki

Generative Adversarial Networks (GANs) are a powerful class of generative models. Despite their successes, the most appropriate choice of a GAN network architecture is still not well understood. GAN models for image synthesis have adopted a…

Machine Learning · Computer Science 2019-05-28 Sukarna Barua , Sarah Monazam Erfani , James Bailey

Visual interpretability of Convolutional Neural Networks (CNNs) has gained significant popularity because of the great challenges that CNN complexity imposes to understanding their inner workings. Although many techniques have been proposed…

Computer Vision and Pattern Recognition · Computer Science 2021-02-01 Alexandros Stergiou

Convolutional networks are powerful visual models that yield hierarchies of features. We show that convolutional networks by themselves, trained end-to-end, pixels-to-pixels, improve on the previous best result in semantic segmentation. Our…

Computer Vision and Pattern Recognition · Computer Science 2016-05-23 Evan Shelhamer , Jonathan Long , Trevor Darrell

Convolutional Neural Networks (CNNs) are successfully used for the important automotive visual perception tasks including object recognition, motion and depth estimation, visual SLAM, etc. However, these tasks are typically independently…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Ganesh Sistu , Isabelle Leang , Sumanth Chennupati , Senthil Yogamani , Ciaran Hughes , Stefan Milz , Samir Rawashdeh

We introduce a general theoretical framework, designed for the study of gradient optimisation of deep neural networks, that encompasses ubiquitous architecture choices including batch normalisation, weight normalisation and skip…

Machine Learning · Computer Science 2023-12-05 Lachlan Ewen MacDonald , Jack Valmadre , Hemanth Saratchandran , Simon Lucey

For convolutional neural network models that optimize an image embedding, we propose a method to highlight the regions of images that contribute most to pairwise similarity. This work is a corollary to the visualization tools developed for…

Computer Vision and Pattern Recognition · Computer Science 2019-01-04 Abby Stylianou , Richard Souvenir , Robert Pless

We propose a novel visual tracking algorithm based on the representations from a discriminatively trained Convolutional Neural Network (CNN). Our algorithm pretrains a CNN using a large set of videos with tracking ground-truths to obtain a…

Computer Vision and Pattern Recognition · Computer Science 2016-01-07 Hyeonseob Nam , Bohyung Han

Convolutional networks trained on large supervised dataset produce visual features which form the basis for the state-of-the-art in many computer-vision problems. Further improvements of these visual features will likely require even larger…

Computer Vision and Pattern Recognition · Computer Science 2015-11-10 Armand Joulin , Laurens van der Maaten , Allan Jabri , Nicolas Vasilache

Normalization layers have been shown to improve convergence in deep neural networks, and even add useful inductive biases. In many vision applications the local spatial context of the features is important, but most common normalization…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Anthony Ortiz , Caleb Robinson , Dan Morris , Olac Fuentes , Christopher Kiekintveld , Md Mahmudulla Hassan , Nebojsa Jojic

Recently, state-of-the-art results have been achieved in semantic segmentation using fully convolutional networks (FCNs). Most of these networks employ encoder-decoder style architecture similar to U-Net and are trained with images and the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Balamurali Murugesan , Kaushik Sarveswaran , Sharath M Shankaranarayana , Keerthi Ram , Mohanasankar Sivaprakasam

A large body of animation research focuses on optimization of movement control, either as action sequences or policy parameters. However, as closed-form expressions of the objective functions are often not available, our understanding of…

Machine Learning · Computer Science 2020-08-25 Perttu Hämäläinen , Juuso Toikka , Amin Babadi , C. Karen Liu

The power of neural networks lies in their ability to generalize to unseen data, yet the underlying reasons for this phenomenon remain elusive. Numerous rigorous attempts have been made to explain generalization, but available bounds are…

Machine Learning · Computer Science 2021-11-17 W. Ronny Huang , Zeyad Emam , Micah Goldblum , Liam Fowl , J. K. Terry , Furong Huang , Tom Goldstein

We analyze the loss landscape and expressiveness of practical deep convolutional neural networks (CNNs) with shared weights and max pooling layers. We show that such CNNs produce linearly independent features at a "wide" layer which has…

Machine Learning · Computer Science 2018-06-07 Quynh Nguyen , Matthias Hein

In recent years, Fully Convolutional Networks (FCN) has been widely used in various semantic segmentation tasks, including multi-modal remote sensing imagery. How to fuse multi-modal data to improve the segmentation performance has always…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Shihao Sun , Lei Yang , Wenjie Liu , Ruirui Li

A number of recent studies have shown that a Deep Convolutional Neural Network (DCNN) pretrained on a large dataset can be adopted as a universal image description which leads to astounding performance in many visual classification tasks.…

Computer Vision and Pattern Recognition · Computer Science 2014-12-01 Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

The trend towards higher resolution remote sensing imagery facilitates a transition from land-use classification to object-level scene understanding. Rather than relying purely on spectral content, appearance-based image features come into…

Computer Vision and Pattern Recognition · Computer Science 2016-06-09 Jamie Sherrah