English
Related papers

Related papers: Maximally Compact and Separated Features with Regu…

200 papers

The purpose of feature extraction on convolutional neural networks is to reuse deep representations learnt for a pre-trained model to solve a new, potentially unrelated problem. However, raw feature extraction from all layers is unfeasible…

Neural and Evolutionary Computing · Computer Science 2019-11-11 Victor Gimenez-Abalos , Armand Vilalta , Dario Garcia-Gasulla , Jesus Labarta , Eduard Ayguadé

The modern strategy for training deep neural networks for classification tasks includes optimizing the network's weights even after the training error vanishes to further push the training loss toward zero. Recently, a phenomenon termed…

Machine Learning · Computer Science 2022-10-13 Tom Tirer , Joan Bruna

The backbone of traditional CNN classifier is generally considered as a feature extractor, followed by a linear layer which performs the classification. We propose a novel loss function, termed as CAM-loss, to constrain the embedded feature…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Chaofei Wang , Jiayu Xiao , Yizeng Han , Qisen Yang , Shiji Song , Gao Huang

Person re-identification is a challenging task because of the high intra-class variance induced by the unrestricted nuisance factors of variations such as pose, illumination, viewpoint, background, and sensor noise. Recent approaches…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Sinan Sabri , Zaigham Randhawa , Gianfranco Doretto

Current research in Computer Vision has shown that Convolutional Neural Networks (CNN) give state-of-the-art performance in many classification tasks and Computer Vision problems. The embedding of CNN, which is the internal representation…

Computer Vision and Pattern Recognition · Computer Science 2015-08-04 Axel Angel

For the convolutional neural network (CNN) used for pattern classification, the training loss function is usually applied to the final output of the network, except for some regularization constraints on the network parameters. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Qiuyu Zhu , Hao Wang , Xuewen Zu , Chengfei Liu

Features play a crucial role in computer vision. Initially designed to detect salient elements by means of handcrafted algorithms, features are now often learned by different layers in Convolutional Neural Networks (CNNs). This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Loris Nanni , Stefano Ghidoni , Sheryl Brahnam

Recent findings reveal that over-parameterized deep neural networks, trained beyond zero training-error, exhibit a distinctive structural pattern at the final layer, termed as Neural-collapse (NC). These results indicate that the final…

Machine Learning · Computer Science 2024-03-01 Tina Behnia , Christos Thrampoulidis

A major challenge in Fine-Grained Visual Classification (FGVC) is distinguishing various categories with high inter-class similarity by learning the feature that differentiate the details. Conventional cross entropy trained Convolutional…

Machine Learning · Computer Science 2021-03-17 Runkai Zheng , Zhijia Yu , Yinqi Zhang , Chris Ding , Hei Victor Cheng , Li Liu

Most existing methods usually formulate the non-blind deconvolution problem into a maximum-a-posteriori framework and address it by manually designing kinds of regularization terms and data terms of the latent clear images. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Pin-Hung Kuo , Jinshan Pan , Shao-Yi Chien , Ming-Hsuan Yang

We propose a deep learning-based solution for the problem of feature learning in one-class classification. The proposed method operates on top of a Convolutional Neural Network (CNN) of choice and produces descriptive features while…

Computer Vision and Pattern Recognition · Computer Science 2019-10-02 Pramuditha Perera , Vishal M. Patel

Convolutional Neural Networks (CNNs) are known to be brittle under various image transformations, including rotations, scalings, and changes of lighting conditions. We observe that the features of a transformed image are drastically…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Shaohua Li , Xiuchao Sui , Jie Fu , Yong Liu , Rick Siow Mong Goh

Face recognition (FR) methods report significant performance by adopting the convolutional neural network (CNN) based learning methods. Although CNNs are mostly trained by optimizing the softmax loss, the recent trend shows an improvement…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Abul Hasnat , Julien Bohné , Jonathan Milgram , Stéphane Gentric , Liming Chen

Face recognition has made extraordinary progress owing to the advancement of deep convolutional neural networks (CNNs). The central task of face recognition, including face verification and identification, involves face feature…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Hao Wang , Yitong Wang , Zheng Zhou , Xing Ji , Dihong Gong , Jingchao Zhou , Zhifeng Li , Wei Liu

Deep artificial neural networks have made remarkable progress in different tasks in the field of computer vision. However, the empirical analysis of these models and investigation of their failure cases has received attention recently. In…

Computer Vision and Pattern Recognition · Computer Science 2016-02-10 Babak Saleh , Ahmed Elgammal , Jacob Feldman

Ensembles of Convolutional neural networks have shown remarkable results in learning discriminative semantic features for image classification tasks. Though, the models in the ensemble often concentrate on similar regions in images. This…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Tobias Schlagenhauf , Yiwen Lin , Benjamin Noack

Convolutional neural networks (CNN) are widely used in computer vision, especially in image classification. However, the way in which information and invariance properties are encoded through in deep CNN architectures is still an open…

Computer Vision and Pattern Recognition · Computer Science 2016-10-26 Michael Blot , Matthieu Cord , Nicolas Thome

Deep learning models have become increasingly useful in many different industries. On the domain of image classification, convolutional neural networks proved the ability to learn robust features for the closed set problem, as shown in many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Rafael S. Pereira , Alexis Joly , Patrick Valduriez , Fabio Porto

This paper investigates the deep learning optimization problem with softmax cross-entropy loss. We propose a layer separation strategy to alleviate the strong nonconvexity encountered during training deep networks. For cross-entropy models…

Machine Learning · Computer Science 2026-04-28 Yaru Liu , Michael K. Ng , Yiqi Gu

Convolutional Neural Networks have achieved impressive results in various tasks, but interpreting the internal mechanism is a challenging problem. To tackle this problem, we exploit a multi-channel attention mechanism in feature space. Our…

Computer Vision and Pattern Recognition · Computer Science 2019-05-22 Masanari Kimura , Masayuki Tanaka