English
Related papers

Related papers: Revisiting Mutual Information Maximization for Gen…

200 papers

We explore the problem of Incremental Generalized Category Discovery (IGCD). This is a challenging category incremental learning setting where the goal is to develop models that can correctly categorize images from previously seen…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Bingchen Zhao , Oisin Mac Aodha

Extreme Classification (XC) aims to map a query to the most relevant documents from a very large document set. XC algorithms used in real-world applications learn this mapping from datasets curated from implicit feedback, such as user…

Deep learning-based models, when trained in a fully-supervised manner, can be effective in performing complex image analysis tasks, although contingent upon the availability of large labeled datasets. Especially in the medical imaging…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Ayaan Haque , Abdullah-Al-Zubaer Imran , Adam Wang , Demetri Terzopoulos

Generalizable person re-identification (Re-ID) aims to recognize individuals across unseen cameras and environments. While existing methods rely heavily on limited labeled multi-camera data, we propose DynaMix, a novel method that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Timur Mamedov , Anton Konushin , Vadim Konushin

We introduce a parameterization method called Neural Bayes which allows computing statistical quantities that are in general difficult to compute and opens avenues for formulating new objectives for unsupervised representation learning.…

Machine Learning · Statistics 2020-02-24 Devansh Arpit , Huan Wang , Caiming Xiong , Richard Socher , Yoshua Bengio

Evidence suggests that networks trained on large datasets generalize well not solely because of the numerous training examples, but also class diversity which encourages learning of enriched features. This raises the question of whether…

Universal supervised learning is considered from an information theoretic point of view following the universal prediction approach, see Merhav and Feder (1998). We consider the standard supervised "batch" learning where prediction is done…

Information Theory · Computer Science 2018-12-27 Yaniv Fogel , Meir Feder

Generalized Category Discovery (GCD) utilizes labeled samples of known classes to discover novel classes in unlabeled samples. Existing methods show effective performance on artificial datasets with balanced distributions. However,…

Artificial Intelligence · Computer Science 2025-07-31 Cuong Manh Hoang

In this paper, we consider a real-world scenario where a model that is trained on pre-defined classes continually encounters unlabeled data that contains both known and novel classes. The goal is to continually discover novel classes while…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Yanan Wu , Zhixiang Chi , Yang Wang , Songhe Feng

In video surveillance, person re-identification is the task of searching person images in non-overlapping cameras. Though supervised methods for person re-identification have attained impressive performance, obtaining large scale cross-view…

Computer Vision and Pattern Recognition · Computer Science 2019-10-10 T M Feroz Ali , Subhasis Chaudhuri

Although a number of studies are devoted to novel category discovery, most of them assume a static setting where both labeled and unlabeled data are given at once for finding new categories. In this work, we focus on the application…

Machine Learning · Computer Science 2022-10-11 Xinwei Zhang , Jianwen Jiang , Yutong Feng , Zhi-Fan Wu , Xibin Zhao , Hai Wan , Mingqian Tang , Rong Jin , Yue Gao

This paper introduces a generalized few-shot segmentation framework with a straightforward training process and an easy-to-optimize inference phase. In particular, we propose a simple yet effective model based on the well-known InfoMax…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Sina Hajimiri , Malik Boudiaf , Ismail Ben Ayed , Jose Dolz

Semi-supervised image classification, leveraging pseudo supervision and consistency regularization, has demonstrated remarkable success. However, the ongoing challenge lies in fully exploiting the potential of unlabeled data. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Qi Han , Zhibo Tian , Chengwei Xia , Kun Zhan

In this work, we perform unsupervised learning of representations by maximizing mutual information between an input and the output of a deep neural network encoder. Importantly, we show that structure matters: incorporating knowledge about…

The state of the art in semantic segmentation is steadily increasing in performance, resulting in more precise and reliable segmentations in many different applications. However, progress is limited by the cost of generating labels for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Viktor Olsson , Wilhelm Tranheden , Juliano Pinto , Lennart Svensson

Existing point cloud semantic segmentation networks cannot identify unknown classes and update their knowledge, due to a closed-set and static perspective of the real world, which would induce the intelligent agent to make bad decisions. To…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Jinfeng Xu , Siyuan Yang , Xianzhi Li , Yuan Tang , Yixue Hao , Long Hu , Min Chen

Mutual information is widely applied to learn latent representations of observations, whilst its implication in classification neural networks remain to be better explained. We show that optimising the parameters of classification neural…

Machine Learning · Computer Science 2020-09-18 Zhenyue Qin , Dongwoo Kim , Tom Gedeon

This paper provides a unified account of two schools of thinking in information retrieval modelling: the generative retrieval focusing on predicting relevant documents given a query, and the discriminative retrieval focusing on predicting…

Information Retrieval · Computer Science 2018-02-23 Jun Wang , Lantao Yu , Weinan Zhang , Yu Gong , Yinghui Xu , Benyou Wang , Peng Zhang , Dell Zhang

Post Randomization Methods (PRAM) are among the most popular disclosure limitation techniques for both categorical and continuous data. In the categorical case, given a stochastic matrix $M$ and a specified variable, an individual belonging…

Methodology · Statistics 2020-09-24 Fadhel Ayed , Marco Battiston , Federico Camerlenghi

We introduce a new approach to probabilistic unsupervised learning based on the recognition-parametrised model (RPM): a normalised semi-parametric hypothesis class for joint distributions over observed and latent variables. Under the key…

Machine Learning · Computer Science 2023-04-21 William I. Walker , Hugo Soulat , Changmin Yu , Maneesh Sahani