English
Related papers

Related papers: Improved Residual Vector Quantization for High-dim…

200 papers

Vector databases typically rely on approximate nearest neighbor (ANN) search to retrieve the top-k closest vectors to a query in embedding space. While effective, this approach often yields semantically redundant results, missing the…

Machine Learning · Computer Science 2025-07-29 Rahul Raja , Arpita Vats

Masked Image Modeling (MIM) with Vector Quantization (VQ) has achieved great success in both self-supervised pre-training and image generation. However, most existing methods struggle to address the trade-off in shared latent space for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Siyuan Li , Luyuan Zhang , Zedong Wang , Juanxi Tian , Cheng Tan , Zicheng Liu , Chang Yu , Qingsong Xie , Haonan Lu , Haoqian Wang , Zhen Lei

Vector Quantized Variational Autoencoders (VQ-VAEs) leverage self-supervised learning through reconstruction tasks to represent continuous vectors using the closest vectors in a codebook. However, issues such as codebook collapse persist in…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Hong-Kai Zheng , Piji Li

A broad range of technologies rely on remote inference, wherein data acquired is conveyed over a communication channel for inference in a remote server. Communication between the participating entities is often carried out over rate-limited…

Signal Processing · Electrical Eng. & Systems 2025-01-07 Eyal Fishel , May Malka , Shai Ginzach , Nir Shlezinger

The Visual Question Answering (VQA) system offers a user-friendly interface and enables human-computer interaction. However, VQA models commonly face the challenge of language bias, resulting from the learned superficial correlation between…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Zhenghang Yuan , Lichao Mou , Xiao Xiang Zhu

Hash based nearest neighbor search has become attractive in many applications. However, the quantization in hashing usually degenerates the discriminative power when using Hamming distance ranking. Besides, for large-scale visual search,…

Information Retrieval · Computer Science 2019-04-19 Xianglong Liu , Lei Huang , Cheng Deng , Bo Lang , Dacheng Tao

For a large number of tasks, quantum computing demonstrates the potential for exponential acceleration over classical computing. In the NISQ era, variable-component subcircuits enable applications of quantum computing. To reduce the…

Quantum Physics · Physics 2022-12-12 Junhan Qin

Visual Question Answering (VQA) is a challenging task that requires systems to provide accurate answers to questions based on image content. Current VQA models struggle with complex questions due to limitations in capturing and integrating…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Peiyuan Chen , Zecheng Zhang , Yiping Dong , Li Zhou , Han Wang

Variational quantum algorithms (VQAs) provide a promising approach to achieve quantum advantage in the noisy intermediate-scale quantum era. In this era, quantum computers experience high error rates and quantum error detection and…

Emerging Technologies · Computer Science 2021-09-07 Salonik Resch , Anthony Gutierrez , Joon Suk Huh , Srikant Bharadwaj , Yasuko Eckert , Gabriel Loh , Mark Oskin , Swamit Tannu

Image compression techniques have made remarkable progress when it comes to file size reduction with a tolerable quality reduction; nonetheless, they are facing some challenges when it comes to applying more compression with the same…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Fikresilase Wondmeneh Abebayew

Mixed Precision Quantization (MPQ) has become an essential technique for optimizing neural network by determining the optimal bitwidth per layer. Existing MPQ methods, however, face a major hurdle: they require a computationally expensive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Lianbo Ma , Jianlun Ma , Yuee Zhou , Guoyang Xie , Qiang He , Zhichao Lu

Image processing is one of the most promising applications for quantum machine learning (QML). Quanvolutional Neural Networks with non-trainable parameters are the preferred solution to run on current and near future quantum devices. The…

Quantum Physics · Physics 2024-10-10 Daniele Lizzio Bosco , Beatrice Portelli , Giuseppe Serra

The k-nearest neighbor search is used in various applications such as machine learning, computer vision, database search, and information retrieval. While the computational cost of the exact nearest neighbor search is enormous, an…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-18 Hiroyuki Ootomo , Akira Naruse

In this work, we address unsupervised temporal action segmentation, which segments a set of long, untrimmed videos into semantically meaningful segments that are consistent across videos. While recent approaches combine representation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Federico Spurio , Emad Bahrami , Gianpiero Francesca , Juergen Gall

Deep Q-learning algorithms often suffer from poor gradient estimations with an excessive variance, resulting in unstable training and poor sampling efficiency. Stochastic variance-reduced gradient methods such as SVRG have been applied to…

Machine Learning · Computer Science 2020-07-28 Haonan Jia , Xiao Zhang , Jun Xu , Wei Zeng , Hao Jiang , Xiaohui Yan , Ji-Rong Wen

Efficient Nearest Neighbor (NN) search in high-dimensional spaces is a foundation of many multimedia retrieval systems. Because it offers low responses times, Product Quantization (PQ) is a popular solution. PQ compresses high-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Fabien André , Anne-Marie Kermarrec , Nicolas Le Scouarnec

Nearest neighbor search is a very active field in machine learning for it appears in many application cases, including classification and object retrieval. In its canonical version, the complexity of the search is linear with both the…

Machine Learning · Computer Science 2017-07-06 Vincent Gripon , Matthias Löwe , Franck Vermet

Although Multi-Vector Retrieval (MVR) has achieved the state of the art on many information retrieval (IR) tasks, its performance highly depends on how to decompose queries into smaller pieces, say phrases or tokens. However, optimizing…

Information Retrieval · Computer Science 2025-06-03 Yaoyang Liu , Junlin Li , Yinjun Wu , Zhen Chen

A multi-grid multi-block-size vector quantization (MGBVQ) method is proposed for image coding in this work. The fundamental idea of image coding is to remove correlations among pixels before quantization and entropy coding, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Yifan Wang , Zhanxuan Mei , Ioannis Katsavounidis , C. -C. Jay Kuo

Efficient k-nearest neighbor search is a fundamental task, foundational for many problems in NLP. When the similarity is measured by dot-product between dual-encoder vectors or $\ell_2$-distance, there already exist many scalable and…

Computation and Language · Computer Science 2022-10-25 Nishant Yadav , Nicholas Monath , Rico Angell , Manzil Zaheer , Andrew McCallum