English
Related papers

Related papers: Capsule Neural Networks as Noise Stabilizer for Ti…

200 papers

This paper presents a novel version of the hypergraph neural network method. This method is utilized to solve the noisy label learning problem. First, we apply the PCA dimensional reduction technique to the feature matrices of the image…

Machine Learning · Statistics 2022-09-07 Nguyen Trinh Vu Dang , Loc Tran , Linh Tran

Research on improving the robustness of neural networks to adversarial noise - imperceptible malicious perturbations of the data - has received significant attention. The currently uncontested state-of-the-art defense to obtain robust deep…

Machine Learning · Computer Science 2023-04-20 Jingtong Su , Julia Kempe

Capsules are grouping of neurons that allow to represent sophisticated information of a visual entity such as pose and features. In the view of this property, Capsule Networks outperform CNNs in challenging tasks like object recognition in…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Barış Özcan , Furkan Kınlı , Furkan Kıraç

This paper has two messages. First, we demonstrate that neural networks that process noisy data can learn to exploit, when available, access to auxiliary noise that is correlated with the noise on the data. In effect, the network learns to…

Quantum Physics · Physics 2020-09-17 Aida Ahmadzadegan , Petar Simidzija , Ming Li , Achim Kempf

Graph Neural Networks (GNNs) have become widely-used models for semi-supervised learning. However, the robustness of GNNs in the presence of label noise remains a largely under-explored problem. In this paper, we consider an important yet…

Machine Learning · Computer Science 2023-02-28 Siyi Qian , Haochao Ying , Renjun Hu , Jingbo Zhou , Jintai Chen , Danny Z. Chen , Jian Wu

We examine the role of memorization in deep learning, drawing connections to capacity, generalization, and adversarial robustness. While deep networks are capable of memorizing noise data, our results suggest that they tend to prioritize…

Consistency regularization is a commonly-used technique for semi-supervised and self-supervised learning. It is an auxiliary objective function that encourages the prediction of the network to be similar in the vicinity of the observed…

Machine Learning · Computer Science 2021-10-05 Erik Englesson , Hossein Azizpour

Deep learning-based applications have seen a lot of success in recent years. Text, audio, image, and video have all been explored with great success using deep learning approaches. The use of convolutional neural networks (CNN) in computer…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Nosseiba Ben Salem , Younes Bennani , Joseph Karkazan , Abir Barbara , Charles Dacheux , Thomas Gregory

In recent years, neural networks have demonstrated outstanding effectiveness in a large amount of applications.However, recent works have shown that neural networks are susceptible to adversarial examples, indicating possible flaws…

Machine Learning · Computer Science 2018-06-08 Fuxun Yu , Zirui Xu , Yanzhi Wang , Chenchen Liu , Xiang Chen

Although provably robust to translational perturbations, convolutional neural networks (CNNs) are known to suffer from extreme performance degradation when presented at test time with more general geometric transformations of inputs.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Lachlan Ewen MacDonald , Sameera Ramasinghe , Simon Lucey

The task of multimodal learning has seen a growing interest recently as it allows for training neural architectures based on different modalities such as vision, text, and audio. One challenge in training such models is that they need to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Kevin Duarte , Brian Chen , Nina Shvetsova , Andrew Rouditchenko , Samuel Thomas , Alexander Liu , David Harwath , James Glass , Hilde Kuehne , Mubarak Shah

Recently deep neural networks have shown their capacity to memorize training data, even with noisy labels, which hurts generalization performance. To mitigate this issue, we provide a simple but effective baseline method that is robust to…

Machine Learning · Computer Science 2019-09-30 Yucen Luo , Jun Zhu , Tomas Pfister

We study the recently introduced stability training as a general-purpose method to increase the robustness of deep neural networks against input perturbations. In particular, we explore its use as an alternative to data augmentation and…

Machine Learning · Computer Science 2019-11-14 Jan Laermann , Wojciech Samek , Nils Strodthoff

We propose a capsule network-based architecture for generalizing learning to new data with few examples. Using both generative and non-generative capsule networks with intermediate routing, we are able to generalize to new information over…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Andrew Gritsevskiy , Maksym Korablyov

Noise and decoherence are two major obstacles to the implementation of large-scale quantum computing. Because of the no-cloning theorem, which says we cannot make an exact copy of an arbitrary quantum state, simple redundancy will not work…

Quantum Physics · Physics 2020-07-09 Nam H. Nguyen , Elizabeth C. Behrman , James E. Steck

Synthetic Aperture Radar (SAR) constitutes a fundamental asset for wide-areas monitoring with high-resolution requirements. The first SAR sensors have given rise to coarse coastal and maritime monitoring applications, including oil spill,…

Image and Video Processing · Electrical Eng. & Systems 2019-10-15 Leonardo De Laurentiis , Andrea Pomente , Fabio Del Frate , Giovanni Schiavon

We investigate robustness properties of pre-trained neural models for automatic speech recognition. Real life data in machine learning is usually very noisy and almost never clean, which can be attributed to various factors depending on the…

Computation and Language · Computer Science 2022-08-19 Goutham Rajendran , Wei Zou

How to improve the efficiency of routing procedures in CapsNets has been studied a lot. However, the efficiency of capsule convolutions has largely been neglected. Capsule convolution, which uses capsules rather than neurons as the basic…

Artificial Intelligence · Computer Science 2021-04-07 Zhenhua Chen , Xiwen Li , Qian Lou , David Crandall

Errors in measurements are key to weighting the value of data, but are often neglected in Machine Learning (ML). We show how Convolutional Neural Networks (CNNs) are able to learn about the context and patterns of signal and noise, leading…

Machine Learning · Computer Science 2021-08-11 Natália V. N. Rodrigues , L. Raul Abramo , Nina S. Hirata

Audio classification aims at recognizing audio signals, including speech commands or sound events. However, current audio classifiers are susceptible to perturbations and adversarial attacks. In addition, real-world audio classification…

Sound · Computer Science 2024-03-28 Sayanton V. Dibbo , Juston S. Moore , Garrett T. Kenyon , Michael A. Teti