English
Related papers

Related papers: Collaborative Layer-wise Discriminative Learning i…

200 papers

Deep neural networks (DNNs) have achieved state-of-the-art results in various pattern recognition tasks. However, they perform poorly on out-of-distribution adversarial examples i.e. inputs that are specifically crafted by an adversary to…

Cryptography and Security · Computer Science 2019-05-09 Chirag Agarwal , Anh Nguyen , Dan Schonfeld

Traditional deep network training methods optimize a monolithic objective function jointly for all the components. This can lead to various inefficiencies in terms of potential parallelization. Local learning is an approach to…

Machine Learning · Computer Science 2023-01-19 Adeetya Patel , Michael Eickenberg , Eugene Belilovsky

Deep Neural Networks (DNNs) have significantly advanced the field of computer vision. To improve DNN training process, knowledge distillation methods demonstrate their effectiveness in accelerating network training by introducing a fixed…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Daqian Shi , Xiaolei Diao , Xu Chen , Cédric M. John

This article presents the first results from using a learning classifier system capable of performing adaptive computation with deep neural networks. Individual classifiers within the population are composed of two neural networks. The…

Neural and Evolutionary Computing · Computer Science 2021-03-02 Richard J. Preen , Larry Bull

The usage of convolutional neural networks (CNNs) for unsupervised image segmentation was investigated in this study. In the proposed approach, label prediction and network parameter learning are alternately iterated to meet the following…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Wonjik Kim , Asako Kanezaki , Masayuki Tanaka

Data heterogeneity is one of the most challenging issues in federated learning, which motivates a variety of approaches to learn personalized models for participating clients. One such approach in deep neural networks based tasks is…

Machine Learning · Computer Science 2023-06-22 Jian Xu , Xinyi Tong , Shao-Lun Huang

We propose a novel approach to enhance the discriminability of Convolutional Neural Networks (CNN). The key idea is to build a tree structure that could progressively learn fine-grained features to distinguish a subset of classes, by…

Computer Vision and Pattern Recognition · Computer Science 2017-09-25 Zhenhua Wang , Xingxing Wang , Gang Wang

Features play a crucial role in computer vision. Initially designed to detect salient elements by means of handcrafted algorithms, features are now often learned by different layers in Convolutional Neural Networks (CNNs). This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-11-18 Loris Nanni , Stefano Ghidoni , Sheryl Brahnam

This paper presents Discriminative Part Network (DP-Net), a deep architecture with strong interpretation capabilities, which exploits a pretrained Convolutional Neural Network (CNN) combined with a part-based recognition module. This system…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ronan Sicre , Hanwei Zhang , Julien Dejasmin , Chiheb Daaloul , Stéphane Ayache , Thierry Artières

A robust theoretical framework that can describe and predict the generalization ability of deep neural networks (DNNs) in general circumstances remains elusive. Classical attempts have produced complexity metrics that rely heavily on global…

Machine Learning · Computer Science 2020-01-20 Marelie H. Davel , Marthinus W. Theunissen , Arnold M. Pretorius , Etienne Barnard

Learning with noisy labels (LNL) has been extensively studied, with existing approaches typically following a framework that alternates between clean sample selection and semi-supervised learning (SSL). However, this approach has a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Qing Miao , Xiaohe Wu , Chao Xu , Yanli Ji , Wangmeng Zuo , Yiwen Guo , Zhaopeng Meng

Deep learning has excelled in image recognition tasks through neural networks inspired by the human brain. However, the necessity for large models to improve prediction accuracy introduces significant computational demands and extended…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Taigo Sakai , Kazuhiro Hotta

Deep learning provides accurate collaborative filtering models to improve recommender system results. Deep matrix factorization and their related collaborative neural networks are the state-of-art in the field; nevertheless, both models…

Information Retrieval · Computer Science 2021-07-28 Jesús Bobadilla , Fernando Ortega , Abraham Gutiérrez , Ángel González-Prieto

Although the lower layers of a deep neural network learn features which are transferable across datasets, these layers are not transferable within the same dataset. That is, in general, freezing the trained feature extractor (the lower…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-10 Shucong Zhang , Cong-Thanh Do , Rama Doddipatla , Erfan Loweimi , Peter Bell , Steve Renals

Active deep learning classification of hyperspectral images is considered in this paper. Deep learning has achieved success in many applications, but good-quality labeled samples are needed to construct a deep learning network. It is…

Machine Learning · Computer Science 2016-12-04 Peng Liu , Hui Zhang , Kie B. Eom

One of the most promising approaches for unsupervised learning is combining deep representation learning and deep clustering. Some recent works propose to simultaneously learn representation using deep neural networks and perform clustering…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Mina Rezaei , Emilio Dorigatti , David Ruegamer , Bernd Bischl

In many image-related tasks, learning expressive and discriminative representations of images is essential, and deep learning has been studied for automating the learning of such representations. Some user-centric tasks, such as image…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Chenyi Lei , Dong Liu , Weiping Li , Zheng-Jun Zha , Houqiang Li

Deep learning has attracted great attention recently and yielded the state of the art performance in dimension reduction and classification problems. However, it cannot effectively handle the structured output prediction, e.g. sequential…

Machine Learning · Computer Science 2015-05-05 Gang Chen , Ran Xu , Sargur Srihari

Successful continual learning of new knowledge would enable intelligent systems to recognize more and more classes of objects. However, current intelligent systems often fail to correctly recognize previously learned classes of objects when…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Changhong Zhong , Zhiying Cui , Ruixuan Wang , Wei-Shi Zheng

Unsupervised learning of visual similarities is of paramount importance to computer vision, particularly due to lacking training data for fine-grained similarities. Deep learning of similarities is often based on relationships between pairs…

Computer Vision and Pattern Recognition · Computer Science 2017-04-12 Miguel A Bautista , Artsiom Sanakoyeu , Björn Ommer