English
Related papers

Related papers: Bi-Encoder Cascades for Efficient Image Search

200 papers

Large transformer-based language models have been shown to be very effective in many classification tasks. However, their computational complexity prevents their use in applications requiring the classification of a large set of candidates.…

Computation and Language · Computer Science 2020-05-08 Luca Soldaini , Alessandro Moschitti

Image captioning is a challenging task and attracting more and more attention in the field of Artificial Intelligence, and which can be applied to efficient image retrieval, intelligent blind guidance and human-computer interaction, etc. In…

Computer Vision and Pattern Recognition · Computer Science 2019-05-21 Yiyu Wang , Jungang Xu , Yingfei Sun , Ben He

DeepSeek-OCR shows that rendered text can be reconstructed from a small number of vision tokens, sparking excitement about using vision as a compression medium for long textual contexts. But this pipeline requires rendering token embeddings…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Ivan Yee Lee , Cheng Yang , Taylor Berg-Kirkpatrick

Arithmetic coding is an essential class of coding techniques. One key issue of arithmetic encoding method is to predict the probability of the current coding symbol from its context, i.e., the preceding encoded symbols, which usually can be…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Mu Li , Shuhang Gu , David Zhang , Wangmeng Zuo

The traditional SegNet architecture commonly encounters significant information loss during the sampling process, which detrimentally affects its accuracy in image semantic segmentation tasks. To counter this challenge, we introduce an…

Image and Video Processing · Electrical Eng. & Systems 2024-06-05 Zijun Gao , Qi Wang , Taiyuan Mei , Xiaohan Cheng , Yun Zi , Haowei Yang

Cross-modal retrieval is an important functionality in modern search engines, as it increases the user experience by allowing queries and retrieved objects to pertain to different modalities. In this paper, we focus on the image-sentence…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Nicola Messina , Giuseppe Amato , Fabrizio Falchi , Claudio Gennaro , Stéphane Marchand-Maillet

Dual-encoder-based neural retrieval models achieve appreciable performance and complement traditional lexical retrievers well due to their semantic matching capabilities, which makes them a common choice for hybrid IR systems. However,…

Information Retrieval · Computer Science 2022-11-10 Jurek Leonhardt , Marcel Jahnke , Avishek Anand

Most image-text retrieval work adopts binary labels indicating whether a pair of image and text matches or not. Such a binary indicator covers only a limited subset of image-text semantic relations, which is insufficient to represent…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Zheng Li , Caili Guo , Zerun Feng , Jenq-Neng Hwang , Ying Jin , Yufeng Zhang

A novel representation of images for image retrieval is introduced in this paper, by using a new type of feature with remarkable discriminative power. Despite the multi-scale nature of objects, most existing models perform feature…

Computer Vision and Pattern Recognition · Computer Science 2014-06-06 Shasha Bu , Yu-Jin Zhang

For improving short-length codes, we demonstrate that classic decoders can also be used with real-valued, neural encoders, i.e., deep-learning based codeword sequence generators. Here, the classical decoder can be a valuable tool to gain…

Information Theory · Computer Science 2023-05-05 Jannis Clausius , Marvin Geiselhart , Stephan ten Brink

Modern computer vision pipelines handle large images in one of two sub-optimal ways: down-sampling or cropping. These two methods incur significant losses in the amount of information and context present in an image. There are many…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ritwik Gupta , Shufan Li , Tyler Zhu , Jitendra Malik , Trevor Darrell , Karttikeya Mangalam

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

With the advent of convolutional neural networks, stereo matching algorithms have recently gained tremendous progress. However, it remains a great challenge to accurately extract disparities from real-world image pairs taken by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jiankun Li , Peisen Wang , Pengfei Xiong , Tao Cai , Ziwei Yan , Lei Yang , Jiangyu Liu , Haoqiang Fan , Shuaicheng Liu

Deep learning models named transformers achieved state-of-the-art results in a vast majority of NLP tasks at the cost of increased computational complexity and high memory consumption. Using the transformer model in real-time inference…

Search-based dialog models typically re-encode the dialog history at every turn, incurring high cost. Curved Contrastive Learning, a representation learning method that encodes relative distances between utterances into the embedding space…

Computation and Language · Computer Science 2024-07-16 Justus-Jonas Erker , Florian Mai , Nils Reimers , Gerasimos Spanakis , Iryna Gurevych

A Content-Based Image Retrieval (CBIR) system which identifies similar medical images based on a query image can assist clinicians for more accurate diagnosis. The recent CBIR research trend favors the construction and use of binary codes…

Computer Vision and Pattern Recognition · Computer Science 2016-04-26 Antonio Sze-To , Hamid R. Tizhoosh , Andrew K. C. Wong

Image denoising techniques are essential to reducing noise levels and enhancing diagnosis reliability in low-dose computed tomography (CT). Machine learning based denoising methods have shown great potential in removing the complex and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Dufan Wu , Kyungsang Kim , Georges El Fakhri , Quanzheng Li

Transformer encoding networks have been proved to be a powerful tool of understanding natural languages. They are playing a critical role in native ads service, which facilitates the recommendation of appropriate ads based on user's web…

Information Retrieval · Computer Science 2021-04-23 Junhan Yang , Zheng Liu , Bowen Jin , Jianxun Lian , Defu Lian , Akshay Soni , Eun Yong Kang , Yajun Wang , Guangzhong Sun , Xing Xie

This paper attacks the challenging problem of video retrieval by text. In such a retrieval paradigm, an end user searches for unlabeled videos by ad-hoc queries described exclusively in the form of a natural-language sentence, with no…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Jianfeng Dong , Xirong Li , Chaoxi Xu , Xun Yang , Gang Yang , Xun Wang , Meng Wang

Larger models often outperform smaller ones but come with high computational costs. Cascading offers a potential solution. By default, it uses smaller models and defers only some instances to larger, more powerful models. However, designing…

Computation and Language · Computer Science 2025-02-19 António Farinhas , Nuno M. Guerreiro , Sweta Agrawal , Ricardo Rei , André F. T. Martins