English
Related papers

Related papers: Embarrassingly Simple Binary Representation Learni…

200 papers

With the tremendous success of deep learning in visual tasks, the representations extracted from intermediate layers of learned models, that is, deep features, attract much attention of researchers. Previous empirical analysis shows that…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Qi Qian , Juhua Hu , Hao Li

Deep learning representations are often difficult to interpret, which can hinder their deployment in sensitive applications. Concept Bottleneck Models (CBMs) have emerged as a promising approach to mitigate this issue by learning…

Machine Learning · Computer Science 2026-01-30 Antonio Almudévar , José Miguel Hernández-Lobato , Alfonso Ortega

A growing number of state-of-the-art transfer learning methods employ language models pretrained on large generic corpora. In this paper we present a conceptually simple and effective transfer learning approach that addresses the problem of…

Computation and Language · Computer Science 2019-06-03 Alexandra Chronopoulou , Christos Baziotis , Alexandros Potamianos

Conventional unsupervised hashing methods usually take advantage of similarity graphs, which are either pre-computed in the high-dimensional space or obtained from random anchor points. On the one hand, existing methods uncouple the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Yuming Shen , Jie Qin , Jiaxin Chen , Mengyang Yu , Li Liu , Fan Zhu , Fumin Shen , Ling Shao

With the advent of kernel methods, automating the task of specifying a suitable kernel has become increasingly important. In this context, the Multiple Kernel Learning (MKL) problem of finding a combination of pre-specified base kernels…

Machine Learning · Computer Science 2012-07-03 Abhishek Kumar , Alexandru Niculescu-Mizil , Koray Kavukcuoglu , Hal Daume

Extracting informative image features and learning effective approximate hashing functions are two crucial steps in image retrieval . Conventional methods often study these two steps separately, e.g., learning hash functions from a…

Computer Vision and Pattern Recognition · Computer Science 2015-10-28 Ruimao Zhang , Liang Lin , Rui Zhang , Wangmeng Zuo , Lei Zhang

Unsupervised feature learning often finds low-dimensional embeddings that capture the structure of complex data. For tasks for which prior expert topological knowledge is available, incorporating this into the learned representation may…

Machine Learning · Computer Science 2022-03-08 Robin Vandaele , Bo Kang , Jefrey Lijffijt , Tijl De Bie , Yvan Saeys

Binary Neural Networks (BNNs), known to be one among the effectively compact network architectures, have achieved great outcomes in the visual tasks. Designing efficient binary architectures is not trivial due to the binary nature of the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Hai Phan , Zechun Liu , Dang Huynh , Marios Savvides , Kwang-Ting Cheng , Zhiqiang Shen

Understanding binary code is an essential but complex software engineering task for reverse engineering, malware analysis, and compiler optimization. Unlike source code, binary code has limited semantic information, which makes it…

Software Engineering · Computer Science 2022-10-12 Yifan Zhang

Deep neural networks have demonstrated their superior performance in almost every Natural Language Processing task, however, their increasing complexity raises concerns. In particular, these networks require high expenses on computational…

Machine Learning · Computer Science 2020-10-13 Harshil Jain , Akshat Agarwal , Kumar Shridhar , Denis Kleyko

Recently, the deep neural network (derived from the artificial neural network) has attracted many researchers' attention by its outstanding performance. However, since this network requires high-performance GPUs and large storage, it is…

Neural and Evolutionary Computing · Computer Science 2016-02-25 Song Wang , Dongchun Ren , Li Chen , Wei Fan , Jun Sun , Satoshi Naoi

Binary neural networks (BNNs), where both weights and activations are binarized into 1 bit, have been widely studied in recent years due to its great benefit of highly accelerated computation and substantially reduced memory footprint that…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Zhuo Su , Linpu Fang , Deke Guo , Dewen Hu , Matti Pietikäinen , Li Liu

Recently, motion generation by machine learning has been actively researched to automate various tasks. Imitation learning is one such method that learns motions from data collected in advance. However, executing long-term tasks remains…

Robotics · Computer Science 2022-03-17 Kazuki Hayashi , Sho Sakaino , Toshiaki Tsuji

Binary Neural Network (BNN) represents convolution weights with 1-bit values, which enhances the efficiency of storage and computation. This paper is motivated by a previously revealed phenomenon that the binary kernels in successful BNNs…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yikai Wang , Wenbing Huang , Yinpeng Dong , Fuchun Sun , Anbang Yao

Batch normalization (BN) is a key facilitator and considered essential for state-of-the-art binary neural networks (BNN). However, the BN layer is costly to calculate and is typically implemented with non-binary parameters, leaving a hurdle…

Machine Learning · Computer Science 2021-04-19 Tianlong Chen , Zhenyu Zhang , Xu Ouyang , Zechun Liu , Zhiqiang Shen , Zhangyang Wang

Learning to hash has been widely applied to approximate nearest neighbor search for large-scale multimedia retrieval, due to its computation efficiency and retrieval quality. Deep learning to hash, which improves retrieval quality by…

Machine Learning · Computer Science 2017-08-01 Zhangjie Cao , Mingsheng Long , Jianmin Wang , Philip S. Yu

Over the past years, embedding learning on networks has shown tremendous results in link prediction tasks for complex systems, with a wide range of real-life applications. Learning a representation for each node in a knowledge graph allows…

Machine Learning · Computer Science 2026-02-03 Orell Trautmann , Olaf Wolkenhauer , Clémence Réda

Hashing-based methods seek compact and efficient binary codes that preserve the neighborhood structure in the original data space. For most existing hashing methods, an image is first encoded as a vector of hand-crafted visual feature,…

Computer Vision and Pattern Recognition · Computer Science 2015-07-17 Guoqiang Zhong , Pan Yang , Sijiang Wang , Junyu Dong

Learning representations for pixel-based control has garnered significant attention recently in reinforcement learning. A wide range of methods have been proposed to enable efficient learning, leading to sample complexities similar to those…

Machine Learning · Computer Science 2021-11-16 Manan Tomar , Utkarsh A. Mishra , Amy Zhang , Matthew E. Taylor

Deep metric learning seeks to define an embedding where semantically similar images are embedded to nearby locations, and semantically dissimilar images are embedded to distant locations. Substantial work has focused on loss functions and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Hong Xuan , Abby Stylianou , Robert Pless