English
Related papers

Related papers: Deep Perceptual Similarity is Adaptable to Ambiguo…

200 papers

We consider a classifier whose test set is exposed to various perturbations that are not present in the training set. These test samples still contain enough features to map them to the same class as their unperturbed counterpart. Current…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Yuchen Li , Safwan Hossain , Kiarash Jamali , Frank Rudzicz

We study the problem of similarity learning and its application to image retrieval with large-scale data. The similarity between pairs of images can be measured by the distances between their high dimensional representations, and the…

Machine Learning · Computer Science 2015-12-08 Qi Qian , Inci M. Baytas , Rong Jin , Anil Jain , Shenghuo Zhu

State-of-the-art methods for counting people in crowded scenes rely on deep networks to estimate crowd density. They typically use the same filters over the whole image or over large image patches. Only then do they estimate local scale to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Weizhe Liu , Mathieu Salzmann , Pascal Fua

Low dimensional embeddings that capture the main variations of interest in collections of data are important for many applications. One way to construct these embeddings is to acquire estimates of similarity from the crowd. However,…

Machine Learning · Computer Science 2018-03-30 Kun Ho Kim , Oisin Mac Aodha , Pietro Perona

Image translation with convolutional neural networks has recently been used as an approach to multimodal change detection. Existing approaches train the networks by exploiting supervised information of the change areas, which, however, is…

In many computer vision tasks, for example saliency prediction or semantic segmentation, the desired output is a foreground map that predicts pixels where some criteria is satisfied. Despite the inherently spatial nature of this task…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Nicholas Kolkin , Gregory Shakhnarovich , Eli Shechtman

Iterative prompt refinement is central to reproducing target images with text to image generative models. Previous studies have incorporated image similarity metrics (ISMs) as additional feedback to human users. Existing ISMs such as LPIPS…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Khoi Trinh , Jay Rothenberger , Scott Seidenberger , Dimitrios Diochnos , Anindya Maiti

In recent years, deep metric learning has achieved promising results in learning high dimensional semantic feature embeddings where the spatial relationships of the feature vectors match the visual similarities of the images. Similarity…

Machine Learning · Computer Science 2019-09-25 Konstantin Schall , Kai Uwe Barthel , Nico Hezel , Klaus Jung

Image metrics predict the perceived per-pixel difference between a reference image and its degraded (e. g., re-rendered) version. In several important applications, the reference image is not available and image metrics cannot be applied.…

The perceptual loss has been widely used as an effective loss term in image synthesis tasks including image super-resolution, and style transfer. It was believed that the success lies in the high-level perceptual feature representations…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Yifan Liu , Hao Chen , Yu Chen , Wei Yin , Chunhua Shen

Deep neural networks have reached human-level performance on many computer vision tasks. However, the objectives used to train these networks enforce only that similar images are embedded at similar locations in the representation space,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Lukas Muttenthaler , Lorenz Linhardt , Jonas Dippel , Robert A. Vandermeulen , Katherine Hermann , Andrew K. Lampinen , Simon Kornblith

While deep neural networks have achieved remarkable performance, data augmentation has emerged as a crucial strategy to mitigate overfitting and enhance network performance. These techniques hold particular significance in industrial…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Hyungmin Kim , Donghun Kim , Pyunghwan Ahn , Sungho Suh , Hansang Cho , Junmo Kim

This paper investigates contextual word representation models from the lens of similarity analysis. Given a collection of trained models, we measure the similarity of their internal representations and attention. Critically, these models…

Computation and Language · Computer Science 2020-05-05 John M. Wu , Yonatan Belinkov , Hassan Sajjad , Nadir Durrani , Fahim Dalvi , James Glass

Deep neural networks represent a powerful class of function approximators that can learn to compress and reconstruct images. Existing image compression algorithms based on neural networks learn quantized representations with a constant…

Computer Vision and Pattern Recognition · Computer Science 2018-02-09 David Minnen , George Toderici , Michele Covell , Troy Chinen , Nick Johnston , Joel Shor , Sung Jin Hwang , Damien Vincent , Saurabh Singh

Various work has suggested that the memorability of an image is consistent across people, and thus can be treated as an intrinsic property of an image. Using computer vision models, we can make specific predictions about what people will…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Coen D. Needell , Wilma A. Bainbridge

Measuring visual similarity between two or more instances within a data distribution is a fundamental task in image retrieval. Theoretically, non-metric distances are able to generate a more complex and accurate similarity model than metric…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Noa Garcia , George Vogiatzis

Deep neural networks are increasingly being used in cognitive modeling as a means of deriving representations for complex stimuli such as images. While the predictive power of these networks is high, it is often not clear whether they also…

Neurons and Cognition · Quantitative Biology 2020-06-01 Aditi Jha , Joshua Peterson , Thomas L. Griffiths

Understanding what information neural networks capture is an essential problem in deep learning, and studying whether different models capture similar features is an initial step to achieve this goal. Previous works sought to define metrics…

Machine Learning · Computer Science 2020-07-27 Yunzhen Feng , Runtian Zhai , Di He , Liwei Wang , Bin Dong

Deep metric learning for vision is trained by optimizing a representation network to map (non-)matching image pairs to (non-)similar representations. During testing, which typically corresponds to image retrieval, both database and query…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Pavel Suma , Giorgos Tolias

Humans judge perceptual similarity according to diverse visual attributes, including scene layout, subject location, and camera pose. Existing vision models understand a wide range of semantic abstractions but improperly weigh these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Shobhita Sundaram , Stephanie Fu , Lukas Muttenthaler , Netanel Y. Tamir , Lucy Chai , Simon Kornblith , Trevor Darrell , Phillip Isola