English
Related papers

Related papers: Do Different Deep Metric Learning Losses Lead to S…

200 papers

Pair-wise loss functions have been extensively studied and shown to continuously improve the performance of deep metric learning (DML). However, they are primarily designed with intuition based on simple toy examples, and experimentally…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Haozhi Zhang , Xun Wang , Weilin Huang , Matthew R. Scott

Despite being able to capture a range of features of the data, high accuracy models trained with supervision tend to make similar predictions. This seemingly implies that high-performing models share similar biases regardless of training…

Machine Learning · Computer Science 2022-04-27 Raphael Gontijo-Lopes , Yann Dauphin , Ekin D. Cubuk

Deep neural networks are over-parameterized and easily overfit the datasets they train on. In the extreme case, it has been shown that these networks can memorize a training set with fully randomized labels. We propose using the curvature…

Machine Learning · Computer Science 2023-10-03 Isha Garg , Deepak Ravikumar , Kaushik Roy

This paper presents a novel deep learning architecture to classify structured objects in datasets with a large number of visually similar categories. We model sequences of images as linear-chain CRFs, and jointly learn the parameters from…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Eran Goldman , Jacob Goldberger

Deep neural networks trained for classification have been found to learn powerful image representations, which are also often used for other tasks such as comparing images w.r.t. their visual similarity. However, visual similarity does not…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Björn Barz , Joachim Denzler

Nowadays, deep-learning image coding solutions have shown similar or better compression efficiency than conventional solutions based on hand-crafted transforms and spatial prediction techniques. These deep-learning codecs require a large…

Multimedia · Computer Science 2023-11-13 Shima Mohammadi , Joao Ascenso

Metric Learning for visual similarity has mostly adopted binary supervision indicating whether a pair of images are of the same class or not. Such a binary indicator covers only a limited subset of image relations, and is not sufficient to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Sungyeon Kim , Minkyo Seo , Ivan Laptev , Minsu Cho , Suha Kwak

This paper studies the problem of generalized zero-shot learning which requires the model to train on image-label pairs from some seen classes and test on the task of classifying new images from both seen and unseen classes. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 He Huang , Changhu Wang , Philip S. Yu , Chang-Dong Wang

Despite the success of a number of recent techniques for visual self-supervised deep learning, there has been limited investigation into the representations that are ultimately learned. By leveraging recent advances in the comparison of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Tom George Grigg , Dan Busbridge , Jason Ramapuram , Russ Webb

Image space feature detection is the act of selecting points or parts of an image that are easy to distinguish from the surrounding image region. By combining a repeatable point detection with a descriptor, parts of an image can be matched…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Alexander Mai , Joseph Menke , Allen Yang

An important characteristic of neural networks is their ability to learn representations of the input data with effective features for prediction, which is believed to be a key factor to their superior empirical performance. To better…

Machine Learning · Computer Science 2022-06-06 Zhenmei Shi , Junyi Wei , Yingyu Liang

Deep neural networks (DNNs) are increasingly proposed as models of human vision, bolstered by their impressive performance on image classification and object recognition tasks. Yet, the extent to which DNNs capture fundamental aspects of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Ethan O. Nadler , Elise Darragh-Ford , Bhargav Srinivasa Desikan , Christian Conaway , Mark Chu , Tasker Hull , Douglas Guilbeault

Features obtained from object recognition CNNs have been widely used for measuring perceptual similarities between images. Such differentiable metrics can be used as perceptual learning losses to train image enhancement models. However, the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Mauricio Delbracio , Hossein Talebi , Peyman Milanfar

For a large class of feature maps we provide a tight asymptotic characterisation of the test error associated with learning the readout layer, in the high-dimensional limit where the input dimension, hidden layer widths, and number of…

Machine Learning · Statistics 2024-06-11 Dominik Schröder , Daniil Dmitriev , Hugo Cui , Bruno Loureiro

The use of deep neural networks as function approximators has led to striking progress for reinforcement learning algorithms and applications. Yet the knowledge we have on decision boundary geometry and the loss landscape of neural policies…

Machine Learning · Computer Science 2021-12-17 Ezgi Korkmaz

Deep classifiers are known to rely on spurious features $\unicode{x2013}$ patterns which are correlated with the target on the training data but not inherently relevant to the learning problem, such as the image backgrounds when classifying…

Machine Learning · Computer Science 2022-10-21 Pavel Izmailov , Polina Kirichenko , Nate Gruver , Andrew Gordon Wilson

We revisit two popular convolutional neural networks (CNN) in person re-identification (re-ID), i.e, verification and classification models. The two models have their respective advantages and limitations due to different loss functions. In…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Zhedong Zheng , Liang Zheng , Yi Yang

Finding localized correspondences across different images of the same object is crucial to understand its geometry. In recent years, this problem has seen remarkable progress with the advent of deep learning-based local image features and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Arjun Karpur , Guilherme Perrotta , Ricardo Martin-Brualla , Howard Zhou , André Araujo

Deep learning models for medical data are typically trained using task specific objectives that encourage representations to collapse onto a small number of discriminative directions. While effective for individual prediction problems, this…

Machine Learning · Computer Science 2026-02-10 Yuanyun Zhang , Mingxuan Zhang , Siyuan Li , Zihan Wang , Haoran Chen , Wenbo Zhou , Shi Li

Visual Similarity plays an important role in many computer vision applications. Deep metric learning (DML) is a powerful framework for learning such similarities which not only generalize from training data to identically distributed test…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Timo Milbich , Karsten Roth , Homanga Bharadhwaj , Samarth Sinha , Yoshua Bengio , Björn Ommer , Joseph Paul Cohen