English
Related papers

Related papers: Edgeworth Expansion for Semi-hard Triplet Loss

200 papers

This paper proposes a novel algorithm for semisupervised learning. This algorithm learns graph cuts that maximize the margin with respect to the labels induced by the harmonic function solution. We motivate the approach, compare it to…

Machine Learning · Computer Science 2026-04-30 Branislav Kveton , Michal Valko , Ali Rahimi , Ling Huang

A significant challenge for a supervised learning approach to inertial human activity recognition is the heterogeneity of data between individual users, resulting in very poor performance of impersonal algorithms for some subjects. We…

Machine Learning · Statistics 2020-01-17 David M. Burns , Cari M. Whyne

Deep-learning architectures for classification problems involve the cross-entropy loss sometimes assisted with auxiliary loss functions like center loss, contrastive loss and triplet loss. These auxiliary loss functions facilitate better…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Hongjun Choi , Anirudh Som , Pavan Turaga

Stochastic Gradient Descent (SGD) based methods have been widely used for training large-scale machine learning models that also generalize well in practice. Several explanations have been offered for this generalization performance, a…

Machine Learning · Computer Science 2021-02-11 Yikai Zhang , Wenjia Zhang , Sammy Bald , Vamsi Pingali , Chao Chen , Mayank Goswami

The Burr III distribution is used in a wide variety of fields of lifetime data analysis, reliability theory, and financial literature, etc. It is defined on the positive axis and has two shape parameters, say $c$ and $k$. These shape…

Statistics Theory · Mathematics 2017-05-30 Mehmet Niyazi Çankaya , Abdullah Yalçınkaya , Ömer Altındaǧ , Olcay Arslan

All machine learning algorithms use a loss, cost, utility or reward function to encode the learning objective and oversee the learning process. This function that supervises learning is a frequently unrecognized hyperparameter that…

Neural and Evolutionary Computing · Computer Science 2024-11-06 Mathew Mithra Noel , Arindam Banerjee , Yug Oswal , Geraldine Bessie Amali D , Venkataraman Muthiah-Nakarajan

Deep neural networks trained using a softmax layer at the top and the cross-entropy loss are ubiquitous tools for image classification. Yet, this does not naturally enforce intra-class similarity nor inter-class margin of the learned deep…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 José Lezama , Qiang Qiu , Pablo Musé , Guillermo Sapiro

We show how to calculate individual terms of the Edgeworth series to approximate the distribution of the Pearson correlation coefficient with the help of a simple Mathematica program. We also demonstrate how to eliminate the corresponding…

Statistics Theory · Mathematics 2022-08-11 Jan Vrbik

We propose a simple, yet powerful regularization technique that can be used to significantly improve both the pairwise and triplet losses in learning local feature descriptors. The idea is that in order to fully utilize the expressive power…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Xu Zhang , Felix X. Yu , Sanjiv Kumar , Shih-Fu Chang

Aim of the paper is the qualitative analysis of a quasi-linear parabolic third order equation, which describes the evolution in a large class of dissipative models. As examples of some typical boundary problems, both Dirichlet's and…

Mathematical Physics · Physics 2012-03-13 M. De Angelis , G. Fiore. P. Renno

We present a new loss function that addresses the out-of-distribution (OOD) calibration problem. While many objective functions have been proposed to effectively calibrate models in-distribution, our findings show that they do not always…

Machine Learning · Computer Science 2024-03-12 Dexter Neo , Stefan Winkler , Tsuhan Chen

Deep metric learning techniques have been used for visual representation in various supervised and unsupervised learning tasks through learning embeddings of samples with deep networks. However, classic approaches, which employ a fixed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Zhiyuan Li , Ziru Liu , Anna Zou , Anca L. Ralescu

The density weighted average derivative (DWAD) of a regression function is a canonical parameter of interest in economics. Classical first-order large sample distribution theory for kernel-based DWAD estimators relies on tuning parameter…

Econometrics · Economics 2024-02-16 Matias D. Cattaneo , Max H. Farrell , Michael Jansson , Ricardo Masini

Acoustic word embeddings (AWEs) are discriminative representations of speech segments, and learned embedding space reflects the phonetic similarity between words. With multi-view learning, where text labels are considered as supplementary…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-28 Myunghun Jung , Hoirin Kim

Variants of Triplet networks are robust entities for learning a discriminative embedding subspace. There exist different triplet mining approaches for selecting the most suitable training triplets. Some of these mining methods rely on the…

Machine Learning · Statistics 2021-11-05 Milad Sikaroudi , Benyamin Ghojogh , Fakhri Karray , Mark Crowley , H. R. Tizhoosh

Consider a homogeneous Poisson process in $\mathbb{R}^d$, $d \ge 1$. Let $R_1 < R_2 < \dots$ be the distances of the points from the origin, and let $S = R_1^{-\gamma} + R_2^{-\gamma} + \dots$, where $\gamma > d$ is a parameter. Let…

Probability · Mathematics 2019-12-17 Antal A. Járai

In this article, we study rates of convergence of the generalization error of multi-class margin classifiers. In particular, we develop an upper bound theory quantifying the generalization error of various large margin classifiers. The…

Statistics Theory · Mathematics 2011-11-10 Xiaotong Shen , Lifeng Wang

In this brief, we discuss the implementation of a third order semi-implicit differentiator as a complement of the recent work by the author that proposes an interconnected semi-implicit Euler double differentiators algorithm through Taylor…

Numerical Analysis · Mathematics 2024-08-02 Loïc Michel , Jean-Pierre Barbot

Researches using margin based comparison loss demonstrate the effectiveness of penalizing the distance between face feature and their corresponding class centers. Despite their popularity and excellent performance, they do not explicitly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Ying Huang , Shangfeng Qiu , Wenwei Zhang , Xianghui Luo , Jinzhuo Wang

Modifications on triplet loss that rescale the back-propagated gradients of special pairs have made significant progress on local descriptor learning. However, current gradient modulation strategies are mainly static so that they would…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Jiayi Ma , Yuxin Deng