English
Related papers

Related papers: Improving Deep Binary Embedding Networks by Order-…

200 papers

The history of deep learning has shown that human-designed problem-specific networks can greatly improve the classification performance of general neural models. In most practical cases, however, choosing the optimal architecture for a…

Machine Learning · Computer Science 2020-09-14 Nicolo Colombo , Yang Gao

We introduce an algorithm where the individual bits representing the weights of a neural network are learned. This method allows training weights with integer values on arbitrary bit-depths and naturally uncovers sparse networks, without…

Machine Learning · Computer Science 2022-02-22 Cristian Ivan

We employ triplet loss as a feature embedding regularizer to boost classification performance. Standard architectures, like ResNet and Inception, are extended to support both losses with minimal hyper-parameter tuning. This promotes…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Ahmed Taha , Yi-Ting Chen , Teruhisa Misu , Abhinav Shrivastava , Larry Davis

Deep metric learning seeks to define an embedding where semantically similar images are embedded to nearby locations, and semantically dissimilar images are embedded to distant locations. Substantial work has focused on loss functions and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Hong Xuan , Abby Stylianou , Robert Pless

In the past few years, triplet loss-based metric embeddings have become a de-facto standard for several important computer vision problems, most no-tably, person reidentification. On the other hand, in the area of speech recognition the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-02-08 Roman Vygon , Nikolay Mikhaylovskiy

Neural networks can be trained to rank the choices made by logical reasoners, resulting in more efficient searches for answers. A key step in this process is creating useful embeddings, i.e., numeric representations of logical statements.…

Artificial Intelligence · Computer Science 2026-05-21 Yifan Zhang , Yasir White , Dean Clark , Joseph Sanchez , Jevon Lipsey , Ashely Hirst , Jeff Heflin

Understanding and quantifying node importance is a fundamental problem in network science and engineering, underpinning a wide range of applications such as influence maximization, social recommendation, and network dismantling. Prior…

Social and Information Networks · Computer Science 2026-02-17 Jiahui Gao , Kuang Zhou , Yuchen Zhu , Keyu Wu

In information retrieval, learning to rank constructs a machine-based ranking model which given a query, sorts the search results by their degree of relevance or importance to the query. Neural networks have been successfully applied to…

Machine Learning · Computer Science 2017-12-12 Baiyang Wang , Diego Klabjan

Big neural networks trained on large datasets have advanced the state-of-the-art for a large variety of challenging problems, improving performance by a large margin. However, under low memory and limited computational power constraints,…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Adrian Bulat , Georgios Tzimiropoulos , Jean Kossaifi , Maja Pantic

How to effectively approximate real-valued parameters with binary codes plays a central role in neural network binarization. In this work, we reveal an important fact that binarizing different layers has a widely-varied effect on the…

Computer Vision and Pattern Recognition · Computer Science 2018-02-19 Lixue Zhuang , Yi Xu , Bingbing Ni , Hongteng Xu

Deep neural networks can be effective means to automatically classify aerial images but is easy to overfit to the training data. It is critical for trained neural networks to be robust to variations that exist between training and test…

Computer Vision and Pattern Recognition · Computer Science 2019-09-25 Jiayun Wang , Patrick Virtue , Stella X. Yu

We propose a method that substantially improves the efficiency of deep distance metric learning based on the optimization of the triplet loss function. One epoch of such training process based on a naive optimization of the triplet loss…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Thanh-Toan Do , Toan Tran , Ian Reid , Vijay Kumar , Tuan Hoang , Gustavo Carneiro

Deep-networks-based hashing has become a leading approach for large-scale image retrieval, which learns a similarity-preserving network to map similar images to nearby hash codes. The pairwise and triplet losses are two widely used…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Shaoying Wang , Haijiang Lai , Yifan Yang , Jian Yin

Learning compact binary codes for image retrieval task using deep neural networks has attracted increasing attention recently. However, training deep hashing networks for the task is challenging due to the binary constraints on the hash…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Thanh-Toan Do , Tuan Hoang , Dang-Khoa Le Tan , Trung Pham , Huu Le , Ngai-Man Cheung , Ian Reid

This work proposes deep network models and learning algorithms for unsupervised and supervised binary hashing. Our novel network design constrains one hidden layer to directly output the binary codes. This addresses a challenging issue in…

Computer Vision and Pattern Recognition · Computer Science 2016-07-19 Thanh-Toan Do , Anh-Dzung Doan , Ngai-Man Cheung

Binarization is an extreme network compression approach that provides large computational speedups along with energy and memory savings, albeit at significant accuracy costs. We investigate the question of where to binarize inputs at…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Ameya Prabhu , Vishal Batchu , Rohit Gajawada , Sri Aurobindo Munagala , Anoop Namboodiri

The huge size of deep networks hinders their use in small computing devices. In this paper, we consider compressing the network by weight quantization. We extend a recently proposed loss-aware weight binarization scheme to ternarization,…

Machine Learning · Computer Science 2018-05-11 Lu Hou , James T. Kwok

The modern image search system requires semantic understanding of image, and a key yet under-addressed problem is to learn a good metric for measuring the similarity between images. While deep metric learning has yielded impressive…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Jian Wang , Feng Zhou , Shilei Wen , Xiao Liu , Yuanqing Lin

In this paper we tackle the problem of vehicle re-identification in a camera network utilizing triplet embeddings. Re-identification is the problem of matching appearances of objects across different cameras. With the proliferation of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Ratnesh Kumar , Edwin Weill , Farzin Aghdasi , Parthsarathy Sriram

How to develop slim and accurate deep neural networks has become crucial for real- world applications, especially for those employed in embedded systems. Though previous work along this research line has shown some promising results, most…

Neural and Evolutionary Computing · Computer Science 2019-10-02 Xin Dong , Shangyu Chen , Sinno Jialin Pan