English
Related papers

Related papers: Transductive Information Maximization For Few-Shot…

200 papers

Due to the fact that fully supervised semantic segmentation methods require sufficient fully-labeled data to work well and can not generalize to unseen classes, few-shot segmentation has attracted lots of research attention. Previous arts…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guolei Sun , Yun Liu , Jingyun Liang , Luc Van Gool

Recently, \textit{diffusion history inference} has become an emerging research topic due to its great benefits for various applications, whose purpose is to reconstruct the missing histories of information diffusion traces according to…

Social and Information Networks · Computer Science 2017-08-24 Yanchao Sun , Cong Qian , Ning Yang , Philip S. Yu

Network seeding for efficient information diffusion over time-varying graphs~(TVGs) is a challenging task with many real-world applications. There are several ways to model this spatio-temporal influence maximization problem, but the…

Machine Learning · Computer Science 2020-11-30 Matheus R. F. Mendonça , André M. S. Barreto , Artur Ziviani

We introduce the Mutual Information Machine (MIM), a probabilistic auto-encoder for learning joint distributions over observations and latent variables. MIM reflects three design principles: 1) low divergence, to encourage the encoder and…

Machine Learning · Computer Science 2020-02-24 Micha Livne , Kevin Swersky , David J. Fleet

Modern deep learning systems are increasingly deployed in situations such as personalization and federated learning where it is necessary to support i) learning on small amounts of data, and ii) communication efficient distributed training…

We show state-of-the-art word representation learning methods maximize an objective function that is a lower bound on the mutual information between different parts of a word sequence (i.e., a sentence). Our formulation provides an…

Computation and Language · Computer Science 2019-11-27 Lingpeng Kong , Cyprien de Masson d'Autume , Wang Ling , Lei Yu , Zihang Dai , Dani Yogatama

Proprietary and closed APIs are becoming increasingly common to process natural language, and are impacting the practical applications of natural language processing, including few-shot classification. Few-shot classification involves…

Computation and Language · Computer Science 2023-10-24 Pierre Colombo , Victor Pellegrain , Malik Boudiaf , Victor Storchan , Myriam Tami , Ismail Ben Ayed , Celine Hudelot , Pablo Piantanida

We introduce the Mutual Information Machine (MIM), a novel formulation of representation learning, using a joint distribution over the observations and latent state in an encoder/decoder framework. Our key principles are symmetry and mutual…

Machine Learning · Statistics 2019-10-10 Micha Livne , Kevin Swersky , David J. Fleet

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

The objective of Few-shot learning is to fully leverage the limited data resources for exploring the latent correlations within the data by applying algorithms and training a model with outstanding performance that can adequately meet the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wenqing Zhao , Guojia Xie , Han Pan , Biao Yang , Weichuan Zhang

Few-shot object detection, learning to adapt to the novel classes with a few labeled data, is an imperative and long-lasting problem due to the inherent long-tail distribution of real-world data and the urgent demands to cut costs of data…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Leng Jiaxu , Chen Taiyue , Gao Xinbo , Yu Yongtao , Wang Ye , Gao Feng , Wang Yue

Few-shot video object segmentation (FS-VOS) aims at segmenting video frames using a few labelled examples of classes not seen during initial training. In this paper, we present a simple but effective temporal transductive inference (TTI)…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Mennatullah Siam , Konstantinos G. Derpanis , Richard P. Wildes

Many recent methods for unsupervised or self-supervised representation learning train feature extractors by maximizing an estimate of the mutual information (MI) between different views of the data. This comes with several immediate…

Machine Learning · Computer Science 2020-01-24 Michael Tschannen , Josip Djolonga , Paul K. Rubenstein , Sylvain Gelly , Mario Lucic

Recently, few-shot video classification has received an increasing interest. Current approaches mostly focus on effectively exploiting the temporal dimension in videos to improve learning under low data regimes. However, most works have…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Andrés Villa , Juan-Manuel Perez-Rua , Victor Escorcia , Vladimir Araujo , Juan Carlos Niebles , Alvaro Soto

In inference problems, we often have domain knowledge which allows us to define summary statistics that capture most of the information content in a dataset. In this paper, we present a hybrid approach, where such physics-based summaries…

Cosmology and Nongalactic Astrophysics · Physics 2025-04-24 T. Lucas Makinen , Alan Heavens , Natalia Porqueres , Tom Charnock , Axel Lapel , Benjamin D. Wandelt

Few-shot tabular learning, in which machine learning models are trained with a limited amount of labeled data, provides a cost-effective approach to addressing real-world challenges. The advent of Large Language Models (LLMs) has sparked…

Machine Learning · Computer Science 2025-05-09 Ruxue Shi , Hengrui Gu , Hangting Ye , Yiwei Dai , Xu Shen , Xin Wang

Humans exhibit a remarkable ability to learn quickly from a limited number of labeled samples, a capability that starkly contrasts with that of current machine learning systems. Unsupervised Few-Shot Learning (U-FSL) seeks to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhenyu Zhang , Guangyao Chen , Yixiong Zou , Zhimeng Huang , Yuhua Li , Ruixuan Li

Transduction is a powerful paradigm that leverages the structure of unlabeled data to boost predictive accuracy. We present TransCLIP, a novel and computationally efficient transductive approach designed for Vision-Language Models (VLMs).…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Maxime Zanella , Benoît Gérin , Ismail Ben Ayed

In task-based few-shot learning paradigms, it is commonly assumed that different tasks are independently and identically distributed (i.i.d.). However, in real-world scenarios, the distribution encountered in few-shot learning can…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jiajun Chen , Hongpeng Yin , Yifu Yang

Few-shot Multi-label Intent Detection (MID) is crucial for dialogue systems, aiming to detect multiple intents of utterances in low-resource dialogue domains. Previous studies focus on a two-stage pipeline. They first learn representations…

Computation and Language · Computer Science 2025-10-10 Shiman Zhao , Shangyuan Li , Wei Chen , Tengjiao Wang , Jiahui Yao , Jiabin Zheng , Kam Fai Wong