English
Related papers

Related papers: Zero-shot generalization across architectures for …

200 papers

In this paper, we look at the problem of few-shot classification that aims to learn a classifier for previously unseen classes and domains from few labeled samples. Recent methods use adaptation networks for aligning their features to new…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Wei-Hong Li , Xialei Liu , Hakan Bilen

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

We consider a classifier whose test set is exposed to various perturbations that are not present in the training set. These test samples still contain enough features to map them to the same class as their unperturbed counterpart. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Yuchen Li , Safwan Hossain , Kiarash Jamali , Frank Rudzicz

Climate downscaling, the process of generating high-resolution climate data from low-resolution simulations, is essential for understanding and adapting to climate change at regional and local scales. Deep learning approaches have proven…

Machine Learning · Computer Science 2024-07-18 Ayush Prasad , Paula Harder , Qidong Yang , Prasanna Sattegeri , Daniela Szwarcman , Campbell Watson , David Rolnick

Machine learning systems generally assume that the training and testing distributions are the same. To this end, a key requirement is to develop models that can generalize to unseen distributions. Domain generalization (DG), i.e.,…

Machine Learning · Computer Science 2022-05-25 Jindong Wang , Cuiling Lan , Chang Liu , Yidong Ouyang , Tao Qin , Wang Lu , Yiqiang Chen , Wenjun Zeng , Philip S. Yu

This paper introduces a generalization of Convolutional Neural Networks (CNNs) from low-dimensional grid data, such as images, to graph-structured data. We propose a novel spatial convolution utilizing a random walk to uncover the relations…

Machine Learning · Statistics 2017-04-27 Yotam Hechtlinger , Purvasha Chakravarti , Jining Qin

Computer vision has made remarkable progress in recent years. Deep neural network (DNN) models optimized to identify objects in images exhibit unprecedented task-trained accuracy and, remarkably, some generalization ability: new visual…

Computer Vision and Pattern Recognition · Computer Science 2017-01-18 Ron Dekel

Generalization to unseen degradations remains a fundamental challenge for low-level vision models. This paper aims to investigate the underlying mechanism of this failure, using image deraining as a primary case study due to its…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Jinfan Hu , Zhiyuan You , Jinjin Gu , Kaiwen Zhu , Tianfan Xue , Chao Dong

Deep convolutional neural networks (DCNNs) have attracted much attention recently, and have shown to be able to recognize thousands of object categories in natural image databases. Their architecture is somewhat similar to that of the human…

Computer Vision and Pattern Recognition · Computer Science 2016-09-13 Saeed Reza Kheradpisheh , Masoud Ghodrati , Mohammad Ganjtabesh , Timothée Masquelier

To overcome the absence of training data for unseen classes, conventional zero-shot learning approaches mainly train their model on seen datapoints and leverage the semantic descriptions for both seen and unseen classes. Beyond exploiting…

Machine Learning · Computer Science 2019-10-22 Hyeonwoo Yu , Beomhee Lee

Most modern convolutional neural networks (CNNs) used for object recognition are built using the same principles: Alternating convolution and max-pooling layers followed by a small number of fully connected layers. We re-evaluate the state…

Machine Learning · Computer Science 2015-04-14 Jost Tobias Springenberg , Alexey Dosovitskiy , Thomas Brox , Martin Riedmiller

In Generalized Zero-Shot Learning (GZSL), unseen categories (for which no visual data are available at training time) can be predicted by leveraging their class embeddings (e.g., a list of attributes describing them) together with a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Federico Marmoreo , Julio Ivan Davila Carrazco , Vittorio Murino , Jacopo Cavazza

A robust theoretical framework that can describe and predict the generalization ability of deep neural networks (DNNs) in general circumstances remains elusive. Classical attempts have produced complexity metrics that rely heavily on global…

Machine Learning · Computer Science 2020-01-20 Marelie H. Davel , Marthinus W. Theunissen , Arnold M. Pretorius , Etienne Barnard

Zero-shot Learners are models capable of predicting unseen classes. In this work, we propose a Zero-shot Learning approach for text categorization. Our method involves training model on a large corpus of sentences to learn the relationship…

Computation and Language · Computer Science 2017-12-27 Pushpankar Kumar Pushp , Muktabh Mayank Srivastava

In the context of few-shot learning, one cannot measure the generalization ability of a trained classifier using validation sets, due to the small number of labeled samples. In this paper, we are interested in finding alternatives to answer…

Machine Learning · Computer Science 2020-07-09 Myriam Bontonou , Louis Béthune , Vincent Gripon

Fine-grained few-shot recognition often suffers from the problem of training data scarcity for novel categories.The network tends to overfit and does not generalize well to unseen classes due to insufficient training data. Many methods have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Jingyi Xu , Hieu Le , Mingzhen Huang , ShahRukh Athar , Dimitris Samaras

As data-driven methods rise in popularity in materials science applications, a key question is how these machine learning models can be used to understand microstructure. Given the importance of process-structure-property relations…

Artificial Intelligence · Computer Science 2017-11-02 Julia Ling , Maxwell Hutchinson , Erin Antono , Brian DeCost , Elizabeth A. Holm , Bryce Meredig

Graph neural networks (GNN) represent an emerging line of deep learning models that operate on graph structures. It is becoming more and more popular due to its high accuracy achieved in many graph-related tasks. However, GNN is not as well…

Hardware Architecture · Computer Science 2021-12-28 Zhihui Zhang , Jingwen Leng , Lingxiao Ma , Youshan Miao , Chao Li , Minyi Guo

Generalization is the key capability for deep neural networks (DNNs). However, it is challenging to give a reliable measure of the generalization ability of a DNN via only its nature. In this paper, we propose a novel method for estimating…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Yang Zhao , Hao Zhang

Convolutional Neural Networks (CNNs) are widely used for image classification in a variety of fields, including medical imaging. While most studies deploy cross-entropy as the loss function in such tasks, a growing number of approaches have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Vasileios Baltatzis , Loic Le Folgoc , Sam Ellis , Octavio E. Martinez Manzanera , Kyriaki-Margarita Bintsi , Arjun Nair , Sujal Desai , Ben Glocker , Julia A. Schnabel