English
Related papers

Related papers: Achieving Data Efficient Neural Networks with Hybr…

200 papers

Deep convolutional neural networks, assisted by architectural design strategies, make extensive use of data augmentation techniques and layers with a high number of feature maps to embed object transformations. That is highly inefficient…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Vittorio Mazzia , Francesco Salvetti , Marcello Chiaberge

When neural networks are trained to classify a dataset, one finds a set of weights from which the network produces a label for each data point. We study the algorithmic complexity of finding a collision in a single-layer neural net, where a…

With the rapid development of Deep Neural Networks (DNNs), they have been applied in numerous fields. However, research indicates that DNNs are susceptible to adversarial examples, and this is equally true in the multi-label domain. To…

Artificial Intelligence · Computer Science 2024-09-27 Yujiang Liu , Wenjian Luo , Zhijian Chen , Muhammad Luqman Naseem

Models play an essential role in the design process of cyber-physical systems. They form the basis for simulation and analysis and help in identifying design problems as early as possible. However, the construction of models that comprise…

In this paper, we formalize the idea behind capsule nets of using a capsule vector rather than a neuron activation to predict the label of samples. To this end, we propose to learn a group of capsule subspaces onto which an input feature…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Liheng Zhang , Marzieh Edraki , Guo-Jun Qi

Graph-based methods have been demonstrated as one of the most effective approaches for semi-supervised learning, as they can exploit the connectivity patterns between labeled and unlabeled data samples to improve learning performance.…

Machine Learning · Computer Science 2019-07-01 Qimai Li , Xiao-Ming Wu , Han Liu , Xiaotong Zhang , Zhichao Guan

Attributes act as intermediate representations that enable parameter sharing between classes, a must when training data is scarce. We propose to view attribute-based image classification as a label-embedding problem: each class is embedded…

Computer Vision and Pattern Recognition · Computer Science 2016-10-05 Zeynep Akata , Florent Perronnin , Zaid Harchaoui , Cordelia Schmid

Although neural models have achieved remarkable performance, they still encounter doubts due to the intransparency. To this end, model prediction explanation is attracting more and more attentions. However, current methods rarely…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yong Guan , Freddy Lecue , Jiaoyan Chen , Ru Li , Jeff Z. Pan

Modern deep learning requires large-scale extensively labelled datasets for training. Few-shot learning aims to alleviate this issue by learning effectively from few labelled examples. In previously proposed few-shot visual classifiers, it…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Peyman Bateni , Jarred Barber , Raghav Goyal , Vaden Masrani , Jan-Willem van de Meent , Leonid Sigal , Frank Wood

We propose a new approach to promote safety in classification tasks with established concepts. Our approach -- called a conceptual safeguard -- acts as a verification layer for models that predict a target outcome by first predicting the…

Machine Learning · Computer Science 2024-11-08 Hailey Joren , Charles Marx , Berk Ustun

In this paper we propose to augment a modern neural-network architecture with an attention model inspired by human perception. Specifically, we adversarially train and analyze a neural model incorporating a human inspired, visual attention…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Daniel Zoran , Mike Chrzanowski , Po-Sen Huang , Sven Gowal , Alex Mott , Pushmeet Kohl

To address semi-supervised learning from both labeled and unlabeled data, we present a novel meta-learning scheme. We particularly consider that labeled and unlabeled data share disjoint ground truth label sets, which can be seen tasks like…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Yun-Chun Chen , Chao-Te Chou , Yu-Chiang Frank Wang

Recently proposed Capsule Network is a brain inspired architecture that brings a new paradigm to deep learning by modelling input domain variations through vector based representations. Despite being a seminal contribution, CapsNet does not…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Sameera Ramasinghe , C. D. Athuralya , Salman Khan

Humans possess a remarkable ability to acquire knowledge efficiently and apply it across diverse modalities through a coherent and shared understanding of the world. Inspired by this cognitive capability, we introduce a concept-centric…

Artificial Intelligence · Computer Science 2026-01-26 Yuchong Geng , Ao Tang

Transfer learning is a widely-used paradigm in deep learning, where models pre-trained on standard datasets can be efficiently adapted to downstream tasks. Typically, better pre-trained models yield better transfer results, suggesting that…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Hadi Salman , Andrew Ilyas , Logan Engstrom , Ashish Kapoor , Aleksander Madry

In reality, learning from multi-view multi-label data inevitably confronts three challenges: missing labels, incomplete views, and non-aligned views. Existing methods mainly concern the first two and commonly need multiple assumptions to…

Machine Learning · Computer Science 2024-06-12 Xiang Li , Songcan Chen

Neuro-symbolic hybrid systems are promising for integrating machine learning and symbolic reasoning, where perception models are facilitated with information inferred from a symbolic knowledge base through logical reasoning. Despite…

Artificial Intelligence · Computer Science 2024-01-24 Lue Tao , Yu-Xuan Huang , Wang-Zhou Dai , Yuan Jiang

In recent years, the CNNs have achieved great successes in the image processing tasks, e.g., image recognition and object detection. Unfortunately, traditional CNN's classification is found to be easily misled by increasingly complex image…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-11-12 Xingyao Zhang , Shuaiwen Leon Song , Chenhao Xie , Jing Wang , Weigong Zhang , Xin Fu

Concept bottleneck models perform classification by first predicting which of a list of human provided concepts are true about a datapoint. Then a downstream model uses these predicted concept labels to predict the target label. The…

Machine Learning · Computer Science 2022-11-08 Joshua Lockhart , Nicolas Marchesotti , Daniele Magazzeni , Manuela Veloso

One-hot labels do not represent soft decision boundaries among concepts, and hence, models trained on them are prone to overfitting. Using soft labels as targets provide regularization, but different soft labels might be optimal at…

Machine Learning · Computer Science 2020-09-22 Nidhi Vyas , Shreyas Saxena , Thomas Voice