English
Related papers

Related papers: Gradually Updated Neural Networks for Large-Scale …

200 papers

Past few years have witnessed exponential growth of interest in deep learning methodologies with rapidly improving accuracies and reduced computational complexity. In particular, architectures using Convolutional Neural Networks (CNNs) have…

Computer Vision and Pattern Recognition · Computer Science 2018-05-11 Sai Samarth R Phaye , Apoorva Sikka , Abhinav Dhall , Deepti Bathula

Modern convolutional networks such as ResNet and NASNet have achieved state-of-the-art results in many computer vision applications. These architectures consist of stages, which are sets of layers that operate on representations in the same…

Computer Vision and Pattern Recognition · Computer Science 2020-10-21 Artur Jordao , Fernando Akio , Maiko Lie , William Robson Schwartz

Learning models that execute algorithms can enable us to address a key problem in deep learning: generalizing to out-of-distribution data. However, neural networks are currently unable to execute recursive algorithms because they do not…

Machine Learning · Computer Science 2023-11-22 Jonas Jürß , Dulhan Jayalath , Petar Veličković

The latest generation of Convolutional Neural Networks (CNN) have achieved impressive results in challenging benchmarks on image recognition and object detection, significantly raising the interest of the community in these methods.…

Computer Vision and Pattern Recognition · Computer Science 2014-11-06 Ken Chatfield , Karen Simonyan , Andrea Vedaldi , Andrew Zisserman

The success of deep learning depends on finding an architecture to fit the task. As deep learning has scaled up to more challenging tasks, the architectures have become difficult to design by hand. This paper proposes an automated method,…

Neural and Evolutionary Computing · Computer Science 2017-03-07 Risto Miikkulainen , Jason Liang , Elliot Meyerson , Aditya Rawal , Dan Fink , Olivier Francon , Bala Raju , Hormoz Shahrzad , Arshak Navruzyan , Nigel Duffy , Babak Hodjat

Intermediate features at different layers of a deep neural network are known to be discriminative for visual patterns of different complexities. However, most existing works ignore such cross-layer heterogeneities when classifying samples…

Computer Vision and Pattern Recognition · Computer Science 2016-07-20 Xiaojie Jin , Yunpeng Chen , Jian Dong , Jiashi Feng , Shuicheng Yan

We introduce the concept of dynamically growing a neural network during training. In particular, an untrainable deep network starts as a trainable shallow network and newly added layers are slowly, organically added during training, thereby…

Neural and Evolutionary Computing · Computer Science 2015-11-24 Leslie N. Smith , Emily M. Hand , Timothy Doster

Guided sparse depth upsampling aims to upsample an irregularly sampled sparse depth map when an aligned high-resolution color image is given as guidance. Many neural networks have been designed for this task. However, they often ignore the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Yi Guo , Ji Liu

Depth image super-resolution is an extremely challenging task due to the information loss in sub-sampling. Deep convolutional neural network have been widely applied to color image super-resolution. Quite surprisingly, this success has not…

Computer Vision and Pattern Recognition · Computer Science 2016-07-08 Xibin Song , Yuchao Dai , Xueying Qin

The online learning of deep neural networks is an interesting problem of machine learning because, for example, major IT companies want to manage the information of the massive data uploaded on the web daily, and this technology can…

Machine Learning · Computer Science 2015-06-16 Sang-Woo Lee , Min-Oh Heo , Jiwon Kim , Jeonghee Kim , Byoung-Tak Zhang

Traditionally, deep learning algorithms update the network weights whereas the network architecture is chosen manually, using a process of trial and error. In this work, we propose two novel approaches that automatically update the network…

Machine Learning · Computer Science 2018-04-10 Ozan İrsoy , Ethem Alpaydın

While neural networks have achieved vastly enhanced performance over traditional iterative methods in many cases, they are generally empirically designed and the underlying structures are difficult to interpret. The algorithm unrolling…

Computer Vision and Pattern Recognition · Computer Science 2019-02-18 Yuelong Li , Mohammad Tofighi , Vishal Monga , Yonina C. Eldar

Rendering an accurate image of an isosurface in a volumetric field typically requires large numbers of data samples. Reducing the number of required samples lies at the core of research in volume rendering. With the advent of deep learning…

Graphics · Computer Science 2022-05-31 Sebastian Weiss , Mengyu Chu , Nils Thuerey , Rüdiger Westermann

Image compression is a method to remove spatial redundancy between adjacent pixels and reconstruct a high-quality image. In the past few years, deep learning has gained huge attention from the research community and produced promising image…

Image and Video Processing · Electrical Eng. & Systems 2021-09-07 Khawar Islam , L. Minh Dang , Sujin Lee , Hyeonjoon Moon

In recent years, convolutional neural networks (CNNs) have shown great performance in various fields such as image classification, pattern recognition, and multi-media compression. Two of the feature properties, local connectivity and…

Machine Learning · Computer Science 2018-07-24 Qianru Zhang , Meng Zhang , Tinghuan Chen , Zhifei Sun , Yuzhe Ma , Bei Yu

State-of-the-art image segmentation algorithms generally consist of at least two successive and distinct computations: a boundary detection process that uses local image information to classify image locations as boundaries between objects,…

Computer Vision and Pattern Recognition · Computer Science 2016-11-03 Michał Januszewski , Jeremy Maitin-Shepard , Peter Li , Jörgen Kornfeld , Winfried Denk , Viren Jain

Convolutional neural networks (CNNs) have constantly achieved better performance over years by introducing more complex topology, and enlarging the capacity towards deeper and wider CNNs. This makes the manual design of CNNs extremely…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Bin Wang , Bing Xue , Mengjie Zhang

Nowadays, Deep Neural Networks are among the main tools used in various sciences. Convolutional Neural Network is a special type of DNN consisting of several convolution layers, each followed by an activation function and a pooling layer.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-17 Hossein Gholamalinezhad , Hossein Khosravi

One impressive advantage of convolutional neural networks (CNNs) is their ability to automatically learn feature representation from raw pixels, eliminating the need for hand-designed procedures. However, recent methods for single image…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Yifan Wang , Lijun Wang , Hongyu Wang , Peihua Li

In this paper, we present a novel approach for contour detection with Convolutional Neural Networks. A multi-scale CNN learning framework is designed to automatically learn the most relevant features for contour patch detection. Our method…

Computer Vision and Pattern Recognition · Computer Science 2017-05-10 Teck Wee Chua , Li Shen