English
Related papers

Related papers: Visualizing Transfer Learning

200 papers

Deep learning methods have recently made notable advances in the tasks of classification and representation learning. These tasks are important for brain imaging and neuroscience discovery, making the methods attractive for porting to a…

Neural and Evolutionary Computing · Computer Science 2014-02-20 Sergey M. Plis , Devon R. Hjelm , Ruslan Salakhutdinov , Vince D. Calhoun

We present a deep learning-based method for propagating spatially-varying visual material attributes (e.g. texture maps or image stylizations) to larger samples of the same or similar materials. For training, we leverage images of the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Carlos Rodriguez-Pardo , Elena Garces

Training deep neural networks using simulations typically requires very large numbers of simulated events. This can be a large computational burden and a limitation in the performance of the deep learning algorithm when insufficient numbers…

High Energy Physics - Experiment · Physics 2023-03-21 Andrew Chappell , Leigh H. Whitehead

The use of neural networks for diagnosis classification is becoming more and more prevalent in the medical imaging community. However, deep learning method outputs remain hard to explain. Another difficulty is to choose among the large…

Image and Video Processing · Electrical Eng. & Systems 2020-02-11 Elina Thibeau Sutre , Olivier Colliot , Didier Dormont , Ninon Burgos

Deep learning models usually require a huge amount of data. However, these large datasets are not always attainable. This is common in many challenging NLP tasks. Consider Neural Machine Translation, for instance, where curating such large…

Computation and Language · Computer Science 2020-07-09 Zaid Alyafeai , Maged Saeed AlShaibani , Irfan Ahmad

The growing use of Machine Learning has produced significant advances in many fields. For image-based tasks, however, the use of deep learning remains challenging in small datasets. In this article, we review, evaluate and compare the…

Machine Learning · Computer Science 2021-06-09 Miguel Romero , Yannet Interian , Timothy Solberg , Gilmer Valdes

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci

This article presents the prediction difference analysis method for visualizing the response of a deep neural network to a specific input. When classifying images, the method highlights areas in a given input image that provide evidence for…

Computer Vision and Pattern Recognition · Computer Science 2017-02-16 Luisa M Zintgraf , Taco S Cohen , Tameem Adel , Max Welling

The field of image classification has shown an outstanding success thanks to the development of deep learning techniques. Despite the great performance obtained, most of the work has focused on natural images ignoring other domains like…

Computer Vision and Pattern Recognition · Computer Science 2019-02-07 Manuel Lagunas , Elena Garces

Artificial intelligence (AI) systems power the world we live in. Deep neural networks (DNNs) are able to solve tasks in an ever-expanding landscape of scenarios, but our eagerness to apply these powerful models leads us to focus on their…

Computer Vision and Pattern Recognition · Computer Science 2022-04-22 Loris Giulivi , Mark James Carman , Giacomo Boracchi

Convolutional Neural Networks (CNNs) are a standard approach for visual recognition due to their capacity to learn hierarchical representations from raw pixels. In practice, practitioners often choose among (i) training a compact custom CNN…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Annoor Sharara Akhand

Image representations, from SIFT and bag of visual words to Convolutional Neural Networks (CNNs) are a crucial component of almost all computer vision systems. However, our understanding of them remains limited. In this paper we study…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Aravindh Mahendran , Andrea Vedaldi

Learning from small amounts of labeled data is a challenge in the area of deep learning. This is currently addressed by Transfer Learning where one learns the small data set as a transfer task from a larger source dataset. Transfer Learning…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Parijat Dube , Bishwaranjan Bhattacharjee , Elisabeth Petit-Bois , Matthew Hill

Interpreting how does deep neural networks (DNNs) make predictions is a vital field in artificial intelligence, which hinders wide applications of DNNs. Visualization of learned representations helps we humans understand the vision of DNNs.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Chen Li , Jinzhe Jiang , Xin Zhang , Tonghuan Zhang , Yaqian Zhao , Dongdong Jiang , RenGang Li

In this paper, we present contemporary techniques for visualising the feature space of a deep learning image classification neural network. These techniques are viewed in the context of a feed-forward network trained to classify low…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Ezra Webb , Cheng Lei , Chun-Jung Huang , Hirofumi Kobayashi , Hideharu Mikami , Keisuke Goda

Transfer learning is critical for efficient information transfer across multiple related learning problems. A simple, yet effective transfer learning approach utilizes deep neural networks trained on a large-scale task for feature…

Sound · Computer Science 2021-06-23 Anurag Kumar , Yun Wang , Vamsi Krishna Ithapu , Christian Fuegen

Transfer learning is a machine learning technique designed to improve generalization performance by using pre-trained parameters obtained from other learning tasks. For image recognition tasks, many previous studies have reported that, when…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Aiga Suzuki , Hidenori Sakanashi , Shoji Kido , Hayaru Shouno

This paper takes a problem-oriented perspective and presents a comprehensive review of transfer learning methods, both shallow and deep, for cross-dataset visual recognition. Specifically, it categorises the cross-dataset recognition into…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Jing Zhang , Wanqing Li , Philip Ogunbona , Dong Xu

Machine Learning with Deep Neural Networks (DNNs) has become a successful tool in solving tasks across various fields of application. However, the complexity of DNNs makes it difficult to understand how they solve their learned task. To…

Machine Learning · Computer Science 2023-06-16 Valerie Krug , Raihan Kabir Ratul , Christopher Olson , Sebastian Stober

For convolutional neural network models that optimize an image embedding, we propose a method to highlight the regions of images that contribute most to pairwise similarity. This work is a corollary to the visualization tools developed for…

Computer Vision and Pattern Recognition · Computer Science 2019-01-04 Abby Stylianou , Richard Souvenir , Robert Pless