English
Related papers

Related papers: Rethinking Feature Distribution for Loss Functions…

200 papers

Real-world object classes appear in imbalanced ratios. This poses a significant challenge for classifiers which get biased towards frequent classes. We hypothesize that improving the generalization capability of a classifier should improve…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Munawar Hayat , Salman Khan , Waqas Zamir , Jianbing Shen , Ling Shao

Functional brain networks are well described and estimated from data with Gaussian Graphical Models (GGMs), e.g. using sparse inverse covariance estimators. Comparing functional connectivity of subjects in two populations calls for…

Machine Learning · Statistics 2016-11-21 Eugene Belilovsky , Gaël Varoquaux , Matthew B. Blaschko

The estimation of the generalization error of classifiers often relies on a validation set. Such a set is hardly available in few-shot learning scenarios, a highly disregarded shortcoming in the field. In these scenarios, it is common to…

Recent state-of-the-art image segmentation algorithms are mostly based on deep neural networks, thanks to their high performance and fast computation time. However, these methods are usually trained in a supervised manner, which requires…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Boah Kim , Jong Chul Ye

Adversarial attacks on convolutional neural networks (CNN) have gained significant attention and there have been active research efforts on defense mechanisms. Stochastic input transformation methods have been proposed, where the idea is to…

Machine Learning · Computer Science 2020-01-31 Connie Kou , Hwee Kuan Lee , Ee-Chien Chang , Teck Khim Ng

Deep neural networks can be effective means to automatically classify aerial images but is easy to overfit to the training data. It is critical for trained neural networks to be robust to variations that exist between training and test…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Jiayun Wang , Patrick Virtue , Stella X. Yu

We present variational generative adversarial networks, a general learning framework that combines a variational auto-encoder with a generative adversarial network, for synthesizing images in fine-grained categories, such as faces of a…

Computer Vision and Pattern Recognition · Computer Science 2018-02-06 Jianmin Bao , Dong Chen , Fang Wen , Houqiang Li , Gang Hua

In recent years, with the rapid development of computer information technology, the development of artificial intelligence has been accelerating. The traditional geometry recognition technology is relatively backward and the recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Ruiyang Wang , Haonan Wang , Junfeng Sun , Mingjia Zhao , Meng Liu

This paper shows that deep learning (DL) representations of data produced by generative adversarial nets (GANs) are random vectors which fall within the class of so-called \textit{concentrated} random vectors. Further exploiting the fact…

Machine Learning · Computer Science 2020-01-24 Mohamed El Amine Seddik , Cosme Louart , Mohamed Tamaazousti , Romain Couillet

Recent methods for deep metric learning have been focusing on designing different contrastive loss functions between positive and negative pairs of samples so that the learned feature embedding is able to pull positive samples of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Shichao Kan , Zhiquan He , Yigang Cen , Yang Li , Vladimir Mladenovic , Zhihai He

Image-generating machine learning models are typically trained with loss functions based on distance in the image space. This often leads to over-smoothed results. We propose a class of loss functions, which we call deep perceptual…

Machine Learning · Computer Science 2016-02-10 Alexey Dosovitskiy , Thomas Brox

We propose a novel method to learn intractable distributions from their samples. The main idea is to use a parametric distribution model, such as a Gaussian Mixture Model (GMM), to approximate intractable distributions by minimizing the…

Machine Learning · Computer Science 2023-08-15 Chenqiu Zhao , Guanfang Dong , Anup Basu

Nowadays, deep learning is the standard approach for a wide range of problems, including biometrics, such as face recognition and speech recognition, etc. Biometric problems often use deep learning models to extract features from images,…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Pedro Silva , Gladston Moreira , Vander Freitas , Rodrigo Silva , David Menotti , Eduardo Luz

In this paper, we propose a deep generative adversarial network for super-resolution considering the trade-off between perception and distortion. Based on good performance of a recently developed model for super-resolution, i.e., deep…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Manri Cheon , Jun-Hyuk Kim , Jun-Ho Choi , Jong-Seok Lee

In this paper, we focus on the separability of classes with the cross-entropy loss function for classification problems by theoretically analyzing the intra-class distance and inter-class distance (i.e. the distance between any two points…

Machine Learning · Computer Science 2019-09-17 Rudrajit Das , Subhasis Chaudhuri

High-performance learned image compression codecs require flexible probability models to fit latent representations. Gaussian Mixture Models (GMMs) were proposed to satisfy this demand, but suffer from a significant runtime performance…

Image and Video Processing · Electrical Eng. & Systems 2025-09-24 Shimon Murai , Fangzheng Lin , Jiro Katto

Widely used loss functions for CNN segmentation, e.g., Dice or cross-entropy, are based on integrals over the segmentation regions. Unfortunately, for highly unbalanced segmentations, such regional summations have values that differ by…

Image and Video Processing · Electrical Eng. & Systems 2020-10-20 Hoel Kervadec , Jihene Bouchtiba , Christian Desrosiers , Eric Granger , Jose Dolz , Ismail Ben Ayed

Distance metric learning (DML) approaches learn a transformation to a representation space where distance is in correspondence with a predefined notion of similarity. While such models offer a number of compelling benefits, it has been…

Machine Learning · Statistics 2016-03-03 Oren Rippel , Manohar Paluri , Piotr Dollar , Lubomir Bourdev

Automatic building extraction from aerial imagery has several applications in urban planning, disaster management, and change detection. In recent years, several works have adopted deep convolutional neural networks (CNNs) for building…

Image and Video Processing · Electrical Eng. & Systems 2020-01-22 Clint Sebastian , Raffaele Imbriaco , Egor Bondarev , Peter H. N. de With

Generative adversarial networks (GANs) have achieved rapid progress in learning rich data distributions. However, we argue about two main issues in existing techniques. First, the low quality problem where the learned distribution has…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Shuyang Gu , Jianmin Bao , Dong Chen , Fang Wen