English

Zero-Episode Few-Shot Contrastive Predictive Coding: Solving intelligence tests without prior training

Computer Vision and Pattern Recognition 2022-05-05 v1 Machine Learning

Abstract

Video prediction models often combine three components: an encoder from pixel space to a small latent space, a latent space prediction model, and a generative model back to pixel space. However, the large and unpredictable pixel space makes training such models difficult, requiring many training examples. We argue that finding a predictive latent variable and using it to evaluate the consistency of a future image enables data-efficient predictions because it precludes the necessity of a generative model training. To demonstrate it, we created sequence completion intelligence tests in which the task is to identify a predictably changing feature in a sequence of images and use this prediction to select the subsequent image. We show that a one-dimensional Markov Contrastive Predictive Coding (M-CPC_1D) model solves these tests efficiently, with only five examples. Finally, we demonstrate the usefulness of M-CPC_1D in solving two tasks without prior training: anomaly detection and stochastic movement video prediction.

Keywords

Cite

@article{arxiv.2205.01924,
  title  = {Zero-Episode Few-Shot Contrastive Predictive Coding: Solving intelligence tests without prior training},
  author = {T. Barak and Y. Loewenstein},
  journal= {arXiv preprint arXiv:2205.01924},
  year   = {2022}
}
R2 v1 2026-06-24T11:06:46.377Z