English
Related papers

Related papers: A Universal Discriminator for Zero-Shot Generaliza…

200 papers

A well trained and generalized deep neural network (DNN) should be robust to both seen and unseen classes. However, the performance of most of the existing supervised DNN algorithms degrade for classes which are unseen in the training set.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Rohit Keshari , Richa Singh , Mayank Vatsa

A modern paradigm for generalization in machine learning and AI consists of pre-training a task-agnostic foundation model, generally obtained using self-supervised and multimodal contrastive learning. The resulting representations can be…

Machine Learning · Statistics 2025-09-03 Ronak Mehta , Zaid Harchaoui

Zero-shot referring image segmentation is a challenging task because it aims to find an instance segmentation mask based on the given referring descriptions, without training on this type of paired data. Current zero-shot methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Minheng Ni , Yabo Zhang , Kailai Feng , Xiaoming Li , Yiwen Guo , Wangmeng Zuo

Traditionally, discriminative models have been the predominant choice for tasks like document classification and information extraction. These models make predictions that fall into a limited number of predefined classes, facilitating a…

Computation and Language · Computer Science 2025-04-23 David Peer , Philemon Schöpf , Volckmar Nebendahl , Alexander Rietzler , Sebastian Stabinger

With the development of large language models (LLMs), zero-shot learning has attracted much attention for various NLP tasks. Different from prior works that generate training data with billion-scale natural language generation (NLG) models,…

Computation and Language · Computer Science 2023-05-19 Yue Yu , Yuchen Zhuang , Rongzhi Zhang , Yu Meng , Jiaming Shen , Chao Zhang

Learning to classify unseen class samples at test time is popularly referred to as zero-shot learning (ZSL). If test samples can be from training (seen) as well as unseen classes, it is a more challenging problem due to the existence of…

Machine Learning · Statistics 2019-09-11 Vinay Kumar Verma , Dhanajit Brahma , Piyush Rai

While Generative Adversarial Networks (GANs) achieve spectacular results on unstructured data like images, there is still a gap on tabular data, data for which state of the art supervised learning still favours to a large extent decision…

Machine Learning · Computer Science 2022-02-14 Richard Nock , Mathieu Guillame-Bert

The purpose of generative Zero-shot learning (ZSL) is to learning from seen classes, transfer the learned knowledge, and create samples of unseen classes from the description of these unseen categories. To achieve better ZSL accuracies,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Shayan Kousha , Marcus A. Brubaker

Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning…

Machine Learning · Computer Science 2021-06-14 Saehoon Kim , Sungwoong Kim , Juho Lee

Many natural language inference (NLI) datasets contain biases that allow models to perform well by only using a biased subset of the input, without considering the remainder features. For instance, models are able to make a classification…

Computation and Language · Computer Science 2021-09-01 Dimion Asael , Zachary Ziegler , Yonatan Belinkov

We propose a new paradigm for zero-shot learners that is format agnostic, i.e., it is compatible with any format and applicable to a list of language tasks, such as text classification, commonsense reasoning, coreference resolution, and…

Computation and Language · Computer Science 2022-10-19 Ping Yang , Junjie Wang , Ruyi Gan , Xinyu Zhu , Lin Zhang , Ziwei Wu , Xinyu Gao , Jiaxing Zhang , Tetsuya Sakai

Pre-trained models have achieved remarkable success in natural language processing (NLP). However, existing pre-training methods underutilize the benefits of language understanding for generation. Inspired by the idea of Generative…

Computation and Language · Computer Science 2023-05-10 Jian Yang , Shuming Ma , Li Dong , Shaohan Huang , Haoyang Huang , Yuwei Yin , Dongdong Zhang , Liqun Yang , Furu Wei , Zhoujun Li

Generative models are known to be difficult to assess. Recent works, especially on generative adversarial networks (GANs), produce good visual samples of varied categories of images. However, the validation of their quality is still…

Machine Learning · Computer Science 2019-09-25 Timothée Lesort , Andrei Stoain , Jean-François Goudou , David Filliat

Deep neural networks achieve unprecedented performance levels over many tasks and scale well with large quantities of data, but performance in the low-data regime and tasks like one shot learning still lags behind. While recent work…

Computer Vision and Pattern Recognition · Computer Science 2017-03-24 Akshay Mehrotra , Ambedkar Dukkipati

Thanks to their remarkable generative capabilities, GANs have gained great popularity, and are used abundantly in state-of-the-art methods and applications. In a GAN based model, a discriminator is trained to learn the real data…

Computer Vision and Pattern Recognition · Computer Science 2018-11-21 Firas Shama , Roey Mechrez , Alon Shoshan , Lihi Zelnik-Manor

Generative Adversarial Networks (GANs) are one of the most popular tools for learning complex high dimensional distributions. However, generalization properties of GANs have not been well understood. In this paper, we analyze the…

Machine Learning · Computer Science 2019-02-12 Hoang Thanh-Tung , Truyen Tran , Svetha Venkatesh

In recent years, Generative Adversarial Networks (GANs) have drawn a lot of attentions for learning the underlying distribution of data in various applications. Despite their wide applicability, training GANs is notoriously difficult. This…

Machine Learning · Computer Science 2019-04-23 Babak Barazandeh , Meisam Razaviyayn , Maziar Sanjabi

Generative Large Language Models (LLMs) have become the mainstream choice for fewshot and zeroshot learning thanks to the universality of text generation. Many users, however, do not need the broad capabilities of generative LLMs when they…

Computation and Language · Computer Science 2024-03-25 Moritz Laurer , Wouter van Atteveldt , Andreu Casas , Kasper Welbers

Tabular data prediction is a fundamental machine learning task for many applications. Existing methods predominantly employ discriminative modeling and operate under the assumption of a fixed target column, necessitating re-training for…

Machine Learning · Computer Science 2024-01-18 Ruiyu Wang , Zifeng Wang , Jimeng Sun

Recently, Generative Adversarial Networks (GANs) have demonstrated their potential in federated learning, i.e., learning a centralized model from data privately hosted by multiple sites. A federatedGAN jointly trains a centralized generator…

Machine Learning · Computer Science 2021-02-10 Yikai Zhang , Hui Qu , Qi Chang , Huidong Liu , Dimitris Metaxas , Chao Chen