中文
相关论文

相关论文: Revisiting Winner Take All (WTA) Hashing for Spars…

200 篇论文

This paper addresses the problem of Approximate Nearest Neighbor (ANN) search in pattern recognition where feature vectors in a database are encoded as compact codes in order to speed-up the similarity search in large-scale databases.…

信息论 · 计算机科学 2017-04-26 Sohrab Ferdowsi , Slava Voloshynovskiy , Dimche Kostadinov , Taras Holotyak

Vision Transformers has demonstrated competitive performance on computer vision tasks benefiting from their ability to capture long-range dependencies with multi-head self-attention modules and multi-layer perceptron. However, calculating…

计算机视觉与模式识别 · 计算机科学 2022-10-25 Xiangyu Chen , Qinghao Hu , Kaidong Li , Cuncong Zhong , Guanghui Wang

While vision transformers have achieved impressive results, effectively and efficiently accelerating these models can further boost performances. In this work, we propose a dense/sparse training framework to obtain a unified model, enabling…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Ling Li , David Thorsley , Joseph Hassoun

The facility location problem is widely used for summarizing large datasets and has additional applications in sensor placement, image retrieval, and clustering. One difficulty of this problem is that submodular optimization algorithms…

机器学习 · 统计学 2017-03-09 Erik M. Lindgren , Shanshan Wu , Alexandros G. Dimakis

This paper addresses the topic of sparsifying deep neural networks (DNN's). While DNN's are powerful models that achieve state-of-the-art performance on a large number of tasks, the large number of model parameters poses serious storage and…

机器学习 · 计算机科学 2018-02-07 Igor Fedorov , Bhaskar D. Rao

The conventional supervised hashing methods based on classification do not entirely meet the requirements of hashing technique, but Linear Discriminant Analysis (LDA) does. In this paper, we propose to perform a revised LDA objective over…

计算机视觉与模式识别 · 计算机科学 2018-10-09 Di Hu , Feiping Nie , Xuelong Li

This work explores the potency of stochastic competition-based activations, namely Stochastic Local Winner-Takes-All (LWTA), against powerful (gradient-based) white-box and black-box adversarial attacks; we especially focus on Adversarial…

机器学习 · 计算机科学 2021-12-07 Konstantinos P. Panousis , Sotirios Chatzis , Sergios Theodoridis

Many approaches to semantic image hashing have been formulated as supervised learning problems that utilize images and label information to learn the binary hash codes. However, large-scale labeled image data is expensive to obtain, thus…

计算机视觉与模式识别 · 计算机科学 2019-01-29 Vijetha Gattupalli , Yaoxin Zhuo , Baoxin Li

Deep Neural Networks (DNNs) generalization is known to be closely related to the flatness of minima, leading to the development of Sharpness-Aware Minimization (SAM) for seeking flatter minima and better generalization. In this paper, we…

机器学习 · 计算机科学 2024-12-06 Yun Yue , Jiadi Jiang , Zhiling Ye , Ning Gao , Yongchao Liu , Ke Zhang

Deep hamming hashing has gained growing popularity in approximate nearest neighbour search for large-scale image retrieval. Until now, the deep hashing for the image retrieval community has been dominated by convolutional neural network…

计算机视觉与模式识别 · 计算机科学 2021-05-06 Yongbiao Chen , Sheng Zhang , Fangxin Liu , Zhigang Chang , Mang Ye , Zhengwei Qi

Lottery Ticket Hypothesis (LTH) suggests that a dense neural network contains a sparse sub-network that can match the performance of the original dense network when trained in isolation from scratch. Most works retrain the sparse…

机器学习 · 计算机科学 2021-10-12 Ajay Kumar Jaiswal , Haoyu Ma , Tianlong Chen , Ying Ding , Zhangyang Wang

Image hashing is a popular technique applied to large scale content-based visual retrieval due to its compact and efficient binary codes. Our work proposes a new end-to-end deep network architecture for supervised hashing which directly…

计算机视觉与模式识别 · 计算机科学 2018-10-30 Dang-Khoa Le Tan , Thanh-Toan Do , Ngai-Man Cheung

We propose a novel method to sparsify attention in the Transformer model by learning to select the most-informative token representations during the training process, thus focusing on the task-specific parts of an input. A reduction of…

计算与语言 · 计算机科学 2022-03-08 Michał Pietruszka , Łukasz Borchmann , Łukasz Garncarek

This paper studies the data sparsity problem in multi-view learning. To solve data sparsity problem in multiview ratings, we propose a generic architecture of deep transfer tensor factorization (DTTF) by integrating deep learning and…

计算机视觉与模式识别 · 计算机科学 2023-02-14 Penghao Jiang , Ke Xin , Chunxi Li

Supervised hashing methods are widely-used for nearest neighbor search in computer vision applications. Most state-of-the-art supervised hashing approaches employ batch-learners. Unfortunately, batch-learning strategies can be inefficient…

计算机视觉与模式识别 · 计算机科学 2015-11-11 Fatih Cakir , Sarah Adel Bargal , Stan Sclaroff

In this paper we study the problem of storing reliably an archive of versioned data. Specifically, we focus on systems where the differences (deltas) between subsequent versions rather than the whole objects are stored - a typical model for…

信息论 · 计算机科学 2014-11-19 J. Harshan , Frédérique Oggier , Anwitaman Datta

In the real world, the degradation of images taken under haze can be quite complex, where the spatial distribution of haze is varied from image to image. Recent methods adopt deep neural networks to recover clean scenes from hazy images…

计算机视觉与模式识别 · 计算机科学 2021-11-19 Tian Ye , Mingchao Jiang , Yunchen Zhang , Liang Chen , Erkang Chen , Pen Chen , Zhiyong Lu

Learning suitable Whole slide images (WSIs) representations for efficient retrieval systems is a non-trivial task. The WSI embeddings obtained from current methods are in Euclidean space not ideal for efficient WSI retrieval. Furthermore,…

计算机视觉与模式识别 · 计算机科学 2022-09-26 Sobhan Hemati , Shivam Kalra , Morteza Babaie , H. R. Tizhoosh

Vision transformers (ViTs) have recently received explosive popularity, but their enormous model sizes and training costs remain daunting. Conventional post-training pruning often incurs higher training budgets. In contrast, this paper aims…

计算机视觉与模式识别 · 计算机科学 2021-10-26 Tianlong Chen , Yu Cheng , Zhe Gan , Lu Yuan , Lei Zhang , Zhangyang Wang

The development of unsupervised hashing is advanced by the recent popular contrastive learning paradigm. However, previous contrastive learning-based works have been hampered by (1) insufficient data similarity mining based on global-only…

计算机视觉与模式识别 · 计算机科学 2022-09-29 Jiaguo Yu , Huming Qiu , Dubing Chen , Haofeng Zhang