English
Related papers

Related papers: Mimicking Ensemble Learning with Deep Branched Net…

200 papers

Decomposing a deep neural network's learned representations into interpretable features could greatly enhance its safety and reliability. To better understand features, we adopt a geometric perspective, viewing them as a learned coordinate…

Machine Learning · Computer Science 2025-04-30 Aryeh Brill

Representation learning on graphs has been gaining attention due to its wide applicability in predicting missing links, and classifying and recommending nodes. Most embedding methods aim to preserve certain properties of the original graph…

Social and Information Networks · Computer Science 2019-09-13 Palash Goyal , Di Huang , Sujit Rokka Chhetri , Arquimedes Canedo , Jaya Shree , Evan Patterson

Deep neural networks have shown the ability to extract universal feature representations from data such as images and text that have been useful for a variety of learning tasks. However, the fruits of representation learning have yet to be…

Machine Learning · Computer Science 2023-03-28 Liam Collins , Hamed Hassani , Aryan Mokhtari , Sanjay Shakkottai

Deeper neural networks are more difficult to train. We present a residual learning framework to ease the training of networks that are substantially deeper than those used previously. We explicitly reformulate the layers as learning…

Computer Vision and Pattern Recognition · Computer Science 2015-12-11 Kaiming He , Xiangyu Zhang , Shaoqing Ren , Jian Sun

In comparison to classical shallow representation learning techniques, deep neural networks have achieved superior performance in nearly every application benchmark. But despite their clear empirical advantages, it is still not well…

Machine Learning · Computer Science 2022-01-11 Calvin Murdock , George Cazenavette , Simon Lucey

Classification for degraded images having various levels of degradation is very important in practical applications. This paper proposes a convolutional neural network to classify degraded images by using a restoration network and an…

Computer Vision and Pattern Recognition · Computer Science 2020-06-16 Kazuki Endo , Masayuki Tanaka , Masatoshi Okutomi

We introduce an architecture for large-scale image categorization that enables the end-to-end learning of separate visual features for the different classes to distinguish. The proposed model consists of a deep CNN shaped like a tree. The…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Karim Ahmed , Lorenzo Torresani

Deep convolutional neural networks (DCNNs) have shown remarkable performance in image classification tasks in recent years. Generally, deep neural network architectures are stacks consisting of a large number of convolutional layers, and…

Computer Vision and Pattern Recognition · Computer Science 2017-09-07 Dongyoon Han , Jiwhan Kim , Junmo Kim

With the tremendous success of deep learning in visual tasks, the representations extracted from intermediate layers of learned models, that is, deep features, attract much attention of researchers. Previous empirical analysis shows that…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Qi Qian , Juhua Hu , Hao Li

Deep residual networks (ResNets) made a recent breakthrough in deep learning. The core idea of ResNets is to have shortcut connections between layers that allow the network to be much deeper while still being easy to optimize avoiding…

Computer Vision and Pattern Recognition · Computer Science 2018-04-30 Sam Leroux , Pavlo Molchanov , Pieter Simoens , Bart Dhoedt , Thomas Breuel , Jan Kautz

In the context of multi-task learning, neural networks with branched architectures have often been employed to jointly tackle the tasks at hand. Such ramified networks typically start with a number of shared layers, after which different…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Simon Vandenhende , Stamatios Georgoulis , Bert De Brabandere , Luc Van Gool

Because hyperspectral remote sensing images contain a lot of redundant information and the data structure is highly non-linear, leading to low classification accuracy of traditional machine learning methods. The latest research shows that…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Xiangdong Zhang , Tengjun Wang , Yun Yang

Representation learning of networks has witnessed significant progress in recent times. Such representations have been effectively used for classic network-based machine learning tasks like node classification, link prediction, and network…

Social and Information Networks · Computer Science 2018-12-07 Arunkumar Bagavathi , Siddharth Krishnan

Deep learning has been widely used for hyperspectral pixel classification due to its ability of generating deep feature representation. However, how to construct an efficient and powerful network suitable for hyperspectral data is still…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Jingzhou Chen , Siyu Chen , Peilin Zhou , Yuntao Qian

We propose a novel subgraph image representation for classification of network fragments with the targets being their parent networks. The graph image representation is based on 2D image embeddings of adjacency matrices. We use this image…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Kshiteesh Hegde , Malik Magdon-Ismail , Ram Ramanathan , Bishal Thapa

We propose an automatic preprocessing and ensemble learning for segmentation of cell images with low quality. It is difficult to capture cells with strong light. Therefore, the microscopic images of cells tend to have low image quality but…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Sota Kato , Kazuhiro Hotta

In this paper, we propose a novel ensembling technique for deep neural networks, which is able to drastically reduce the required memory compared to alternative approaches. In particular, we propose to extract multiple sub-networks from a…

Machine Learning · Computer Science 2022-10-07 Jary Pomponi , Simone Scardapane , Aurelio Uncini

Deep neural networks can be effective means to automatically classify aerial images but is easy to overfit to the training data. It is critical for trained neural networks to be robust to variations that exist between training and test…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Jiayun Wang , Patrick Virtue , Stella X. Yu

Image-language matching tasks have recently attracted a lot of attention in the computer vision field. These tasks include image-sentence matching, i.e., given an image query, retrieving relevant sentences and vice versa, and region-phrase…

Computer Vision and Pattern Recognition · Computer Science 2018-05-03 Liwei Wang , Yin Li , Jing Huang , Svetlana Lazebnik

Residual networks (Resnets) have become a prominent architecture in deep learning. However, a comprehensive understanding of Resnets is still a topic of ongoing research. A recent view argues that Resnets perform iterative refinement of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-09 Stanisław Jastrzębski , Devansh Arpit , Nicolas Ballas , Vikas Verma , Tong Che , Yoshua Bengio