English
Related papers

Related papers: Fast binary embeddings, and quantized compressed s…

200 papers

Clustering is a fundamental unsupervised learning approach. Many clustering algorithms -- such as $k$-means -- rely on the euclidean distance as a similarity measure, which is often not the most relevant metric for high dimensional data…

Machine Learning · Computer Science 2019-10-22 Aude Genevay , Gabriel Dulac-Arnold , Jean-Philippe Vert

Over the last years, word and sentence embeddings have established as text preprocessing for all kinds of NLP tasks and improved the performances significantly. Unfortunately, it has also been shown that these embeddings inherit various…

Computation and Language · Computer Science 2024-09-13 Sarah Schröder , Alexander Schulz , Philip Kenneweg , Robert Feldhans , Fabian Hinder , Barbara Hammer

Noise-shaping quantization techniques are widely used for converting bandlimited signals from the analog to the digital domain. They work by ``shaping" the quantization noise so that it falls close to the reconstruction operator's null…

Information Theory · Computer Science 2026-05-21 Rohan Joy , Felix Krahmer , Alessandro Lupoli , Radha Ramakrishnan

Common imaging techniques for detecting structural defects typically require sampling at more than twice the spatial frequency to achieve a target resolution. This study introduces a novel framework for imaging structural defects using…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Wei-Chen Li , Chun-Yeon Lin

A new multiscale implementation of non-local means filtering for image denoising is proposed. The proposed algorithm also introduces a modification of similarity measure for patch comparison. The standard Euclidean norm is replaced by…

Computer Vision and Pattern Recognition · Computer Science 2013-04-04 Zahid Hussain Shamsi , Dai-Gyoung Kim

We analyze in detail, beyond the usual scaling hypothesis, the finite-size convergence of static quantities toward the thermodynamic limit. In this way we are able to obtain sequences of pseudo-critical points which display a faster…

Statistical Mechanics · Physics 2008-04-10 M. Roncaglia , L. Campos Venuti , C. Degli Esposti Boschi

We consider chance-constrained binary knapsack problems, where the weights of items are independent random variables with the means and standard deviations known. The chance constraint can be reformulated as a second-order cone constraint…

Optimization and Control · Mathematics 2021-05-26 Jaehyeon Ryu , Sungsoo Park

We describe a new method called t-ETE for finding a low-dimensional embedding of a set of objects in Euclidean space. We formulate the embedding problem as a joint ranking problem over a set of triplets, where each triplet captures the…

Artificial Intelligence · Computer Science 2017-05-18 Ehsan Amid , Nikos Vlassis , Manfred K. Warmuth

Word-embeddings are vital components of Natural Language Processing (NLP) models and have been extensively explored. However, they consume a lot of memory which poses a challenge for edge deployment. Embedding matrices, typically, contain…

Computation and Language · Computer Science 2020-11-12 Vasileios Lioutas , Ahmad Rashid , Krtin Kumar , Md Akmal Haidar , Mehdi Rezagholizadeh

The ever-growing size of neural networks poses serious challenges on resource-constrained devices, such as embedded sensors. Compression algorithms that reduce their size can mitigate these problems, provided that model performance stays…

Machine Learning · Computer Science 2025-05-27 Alexander Conzelmann , Robert Bamler

Traditionally, quantization is designed to minimize the reconstruction error of a data source. When considering downstream classification tasks, other measures of distortion can be of interest; such as the 0-1 classification loss.…

Machine Learning · Computer Science 2021-07-22 Daniel Severo , Elad Domanovitz , Ashish Khisti

Semantic representations of text, i.e. representations of natural language which capture meaning by geometry, are essential for areas such as information retrieval and document grouping. High-dimensional trained dense vectors have received…

Computation and Language · Computer Science 2023-12-01 Beatrix M. G. Nielsen , Lars Kai Hansen

Metric learning seeks perceptual embeddings where visually similar instances are close and dissimilar instances are apart, but learned representations can be sub-optimal when the distribution of intra-class samples is diverse and distinct…

Machine Learning · Computer Science 2021-08-30 Elad Levi , Tete Xiao , Xiaolong Wang , Trevor Darrell

Many modern distributed real-time signal sensing/monitoring systems require quantization for efficient signal representation. These distributed sensors often have inherent computational and energy limitations. Motivated by this concern, we…

Signal Processing · Electrical Eng. & Systems 2019-02-19 Vijay Anavangot , Animesh Kumar

The Johnson-Lindenstrauss Lemma states that there exist linear maps that project a set of points of a vector space into a space of much lower dimension such that the Euclidean distance between these points is approximately preserved. This…

Optimization and Control · Mathematics 2023-01-18 Pierre-Louis Poirion , Bruno F. Lourenço , Akiko Takeda

Similarity query is the family of queries based on some similarity metrics. Unlike the traditional database queries which are mostly based on value equality, similarity queries aim to find targets "similar enough to" the given data objects,…

Databases · Computer Science 2022-04-19 Yifan Wang

Vector representations of sentences, trained on massive text corpora, are widely used as generic sentence embeddings across a variety of NLP problems. The learned representations are generally assumed to be continuous and real-valued,…

Computation and Language · Computer Science 2019-06-21 Dinghan Shen , Pengyu Cheng , Dhanasekar Sundararaman , Xinyuan Zhang , Qian Yang , Meng Tang , Asli Celikyilmaz , Lawrence Carin

We propose methods to train convolutional neural networks (CNNs) with both binarized weights and activations, leading to quantized models that are specifically friendly to mobile devices with limited power capacity and computation…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Bohan Zhuang , Chunhua Shen , Mingkui Tan , Peng Chen , Lingqiao Liu , Ian Reid

Quantum machines are among the most promising technologies expected to provide significant improvements in the following years. However, bridging the gap between real-world applications and their implementation on quantum hardware is still…

Clustering is a fundamental unsupervised learning task for uncovering patterns in data. While Gaussian Blurring Mean Shift (GBMS) has proven effective for identifying arbitrarily shaped clusters in Euclidean space, it struggles with…

Machine Learning · Computer Science 2025-12-15 Arghya Pratihar , Arnab Seal , Swagatam Das , Inesh Chattopadhyay