English
Related papers

Related papers: Decision boundaries and convex hulls in the featur…

200 papers

Neural models learn representations of high-dimensional data on low-dimensional manifolds. Multiple factors, including stochasticities in the training process, model architectures, and additional inductive biases, may induce different…

Machine Learning · Computer Science 2025-12-02 Hanlin Yu , Berfin Inal , Georgios Arvanitidis , Soren Hauberg , Francesco Locatello , Marco Fumero

In this paper, we present a strategy for training convolutional neural networks to effectively resolve interference arising from competing hypotheses relating to inter-categorical information throughout the network. The premise is based on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Md Amirul Islam , Matthew Kowal , Konstantinos G. Derpanis , Neil D. B. Bruce

Deep learning models extract, before a final classification layer, features or patterns which are key for their unprecedented advantageous performance. However, the process of complex nonlinear feature extraction is not well understood, a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Roozbeh Yousefzadeh , Furong Huang

Despite achieving remarkable performance on many image classification tasks, state-of-the-art machine learning (ML) classifiers remain vulnerable to small input perturbations. Especially, the existence of adversarial examples raises…

Machine Learning · Computer Science 2020-02-06 David Mickisch , Felix Assion , Florens Greßner , Wiebke Günther , Mariele Motta

Deep neural networks have reshaped modern machine learning by learning powerful latent representations that often align with the manifold hypothesis: high-dimensional data lie on lower-dimensional manifolds. In this paper, we establish a…

Machine Learning · Computer Science 2025-06-09 Nico Pelleriti , Max Zimmer , Elias Wirth , Sebastian Pokutta

Deep neural networks tend to exhibit a bias toward low-rank solutions during training, implicitly learning low-dimensional feature representations. This paper investigates how deep multilayer perceptrons (MLPs) encode these feature…

Machine Learning · Computer Science 2024-10-11 Niket Patel , Ravid Shwartz-Ziv

Deep learning is the mainstream technique for many machine learning tasks, including image recognition, machine translation, speech recognition, and so on. It has outperformed conventional methods in various fields and achieved great…

Machine Learning · Computer Science 2018-06-01 Na Lei , Zhongxuan Luo , Shing-Tung Yau , David Xianfeng Gu

This work proposes a new framework for deep learning that has been particularly tailored for hyperspectral image classification. We learn multiple levels of dictionaries in a robust fashion. The last layer is discriminative that learns a…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Vanika Singhal , Hemant K. Aggarwal , Snigdha Tariyal , Angshul Majumdar

It is generally believed that the human visual system is biased towards the recognition of shapes rather than textures. This assumption has led to a growing body of work aiming to align deep models' decision-making processes with the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Adriano Lucieri , Fabian Schmeisser , Christoph Peter Balada , Shoaib Ahmed Siddiqui , Andreas Dengel , Sheraz Ahmed

Deep convolutional neural networks have been successfully applied to image classification tasks. When these same networks have been applied to image retrieval, the assumption has been made that the last layers would give the best…

Computer Vision and Pattern Recognition · Computer Science 2015-05-01 Joe Yue-Hei Ng , Fan Yang , Larry S. Davis

Important insights towards the explainability of neural networks reside in the characteristics of their decision boundaries. In this work, we borrow tools from the field of adversarial robustness, and propose a new perspective that relates…

Machine Learning · Computer Science 2020-10-16 Guillermo Ortiz-Jimenez , Apostolos Modas , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard

Deep learning has achieved great success as a powerful classification tool and also made great progress in sematic segmentation. As a result, many researchers also believe that deep learning is the most powerful tool for pixel level image…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Zhenzhou Wang

Convolutional Neural Networks (CNNs) currently achieve state-of-the-art accuracy in image classification. With a growing number of classes, the accuracy usually drops as the possibilities of confusion increase. Interestingly, the class…

Computer Vision and Pattern Recognition · Computer Science 2017-10-25 Bilal Alsallakh , Amin Jourabloo , Mao Ye , Xiaoming Liu , Liu Ren

This paper strives to address image classifier bias, with a focus on both feature and label embedding spaces. Previous works have shown that spurious correlations from protected attributes, such as age, gender, or skin tone, can cause…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 William Thong , Cees G. M. Snoek

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional network that maps the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 ShahRukh Athar , Evgeny Burnaev , Victor Lempitsky

Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Kalun Ho , Franz-Josef Pfreundt , Janis Keuper , Margret Keuper

The methods of extracting image features are the key to many image processing tasks. At present, the most popular method is the deep neural network which can automatically extract robust features through end-to-end training instead of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Xiang Ma , Liangzhe Chen , Zhaohong Deng , Peng Xu , Qisheng Yan , Kup-Sze Choi , Shitong Wang

A variety of real-world tasks involve the classification of images into pre-determined categories. Designing image classification algorithms that exhibit robustness to acquisition noise and image distortions, particularly when the available…

Machine Learning · Statistics 2016-03-10 Umamahesh Srinivas

According to a popular viewpoint, neural networks learn from data by first identifying low-dimensional representations, and subsequently fitting the best model in this space. Recent works provide a formalization of this phenomenon when…

Machine Learning · Computer Science 2026-02-27 Andrea Montanari , Zihao Wang

Deep neural networks learn feature representations via complex geometric transformations of the input data manifold. Despite the models' empirical success across domains, our understanding of neural feature representations is still…

Machine Learning · Computer Science 2025-09-29 Moritz Hehl , Max von Renesse , Melanie Weber