English
Related papers

Related papers: Context Steering: A New Paradigm for Compression-b…

200 papers

While convolution and self-attention are extensively used in learned image compression (LIC) for transform coding, this paper proposes an alternative called Contextual Clustering based LIC (CLIC) which primarily relies on clustering…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Yichi Zhang , Zhihao Duan , Ming Lu , Dandan Ding , Fengqing Zhu , Zhan Ma

The advent of contextual word embeddings -- representations of words which incorporate semantic and syntactic information from their context -- has led to tremendous improvements on a wide variety of NLP tasks. However, recent contextual…

Computation and Language · Computer Science 2021-06-09 Prakhar Gupta , Martin Jaggi

The clustering of data into physically meaningful subsets often requires assumptions regarding the number, size, or shape of the subgroups. Here, we present a new method, simultaneous coherent structure coloring (sCSC), which accomplishes…

Machine Learning · Statistics 2019-11-26 Brooke E. Husic , Kristy L. Schlueter-Kuck , John O. Dabiri

Clustering high-dimensional data is a critical challenge in machine learning due to the curse of dimensionality and the presence of noise. Traditional clustering algorithms often fail to capture the intrinsic structures in such data. This…

Machine Learning · Computer Science 2025-03-21 Joanikij Chulev , Angela Mladenovska

Compression-based similarity measures are effectively employed in applications on diverse data types with a basically parameter-free approach. Nevertheless, there are problems in applying these techniques to medium-to-large datasets which…

Machine Learning · Statistics 2012-10-03 Daniele Cerra , Mihai Datcu

What makes images similar? To measure the similarity between images, they are typically embedded in a feature-vector space, in which their distance preserve the relative dissimilarity. However, when learning such similarity embeddings the…

Computer Vision and Pattern Recognition · Computer Science 2017-04-11 Andreas Veit , Serge Belongie , Theofanis Karaletsos

Data similarity is a key concept in many data-driven applications. Many algorithms are sensitive to similarity measures. To tackle this fundamental problem, automatically learning of similarity information from data via self-expression has…

Machine Learning · Computer Science 2019-03-12 Zhao Kang , Yiwei Lu , Yuanzhang Su , Changsheng Li , Zenglin Xu

We propose a novel method to determine the dissimilarity between subjects for functional data clustering. Spline smoothing or interpolation is common to deal with data of such type. Instead of estimating the best-representing curve for each…

Methodology · Statistics 2021-03-23 ShengLi Tzeng , Christian Hennig , Yu-Fen Li , Chien-Ju Lin

Topic modelling is a pivotal unsupervised machine learning technique for extracting valuable insights from large document collections. Existing neural topic modelling methods often encode contextual information of documents, while ignoring…

Computation and Language · Computer Science 2025-02-07 Yanan Ma , Chenghao Xiao , Chenhan Yuan , Sabine N van der Veer , Lamiece Hassan , Chenghua Lin , Goran Nenadic

Neural processes (NPs) aim to stochastically complete unseen data points based on a given context dataset. NPs essentially leverage a given dataset as a context representation to derive a suitable identifier for a novel task. To improve the…

Machine Learning · Computer Science 2022-04-13 Mingyu Kim , Kyeongryeol Go , Se-Young Yun

Contrary to other standard cameras, event cameras interpret the world in an entirely different manner; as a collection of asynchronous events. Despite event camera's unique data output, many event feature detection and tracking algorithms…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Sumin Hu , Yeeun Kim , Hyungtae Lim , Alex Junho Lee , Hyun Myung

Clustering is one of the fundamental tasks in computer vision and pattern recognition. Recently, deep clustering methods (algorithms based on deep learning) have attracted wide attention with their impressive performance. Most of these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Yanhai Gan , Xinghui Dong , Huiyu Zhou , Feng Gao , Junyu Dong

Discrete diffusion models are a class of generative models that construct sequences by progressively denoising samples from a categorical noise distribution. Beyond their rapidly growing ability to generate coherent natural language, these…

Computation and Language · Computer Science 2025-12-11 Michael Cardei , Jacob K Christopher , Thomas Hartvigsen , Bhavya Kailkhura , Ferdinando Fioretto

Clustering is spotting pattern in a group of objects and resultantly grouping the similar objects together. Objects have attributes which are not always numerical, sometimes attributes have domain or categories to which they could belong…

Machine Learning · Computer Science 2020-11-20 Utkarsh Nath , Shikha Asrani , Rahul Katarya

We found that enforcing guidance throughout the sampling process is often counterproductive due to the model-fitting issue, where samples are 'tuned' to match the classifier's parameters rather than generalizing the expected condition. This…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Anh-Dung Dinh , Daochang Liu , Chang Xu

It is generally well understood that predictive classification and compression are intrinsically related concepts in information theory. Indeed, many deep learning methods are explained as learning a kind of compression, and that better…

Machine Learning · Computer Science 2024-10-22 John Hurwitz , Charles Nicholas , Edward Raff

Despite the success of deep neural network (DNN) on sequential data (i.e., scene text and speech) recognition, it suffers from the over-confidence problem mainly due to overfitting in training with the cross-entropy loss, which may make the…

Artificial Intelligence · Computer Science 2023-03-14 Shuangping Huang , Yu Luo , Zhenzhou Zhuang , Jin-Gang Yu , Mengchao He , Yongpan Wang

In-context learning enables language models (LM) to adapt to downstream data or tasks by incorporating few samples as demonstrations within the prompts. It offers strong performance without the expense of fine-tuning. However, the…

Computation and Language · Computer Science 2024-10-15 Jian Gu , Aldeida Aleti , Chunyang Chen , Hongyu Zhang

This report investigates enhancing semantic caching effectiveness by employing specialized, fine-tuned embedding models. Semantic caching relies on embedding similarity rather than exact key matching, presenting unique challenges in…

We define disentanglement as how far class-different data points from each other are, relative to the distances among class-similar data points. When maximizing disentanglement during representation learning, we obtain a transformed feature…

Machine Learning · Computer Science 2021-08-02 Abien Fred Agarap