English
Related papers

Related papers: Linguistically-Enriched and Context-Aware Zero-sho…

200 papers

Pretrained language models have shown success in various areas of natural language processing, including reading comprehension tasks. However, when applying machine learning methods to new domains, labeled data may not always be available.…

Computation and Language · Computer Science 2022-06-15 Xiang Pan , Alex Sheng , David Shimshoni , Aditya Singhal , Sara Rosenthal , Avirup Sil

In the field of visual scene understanding, deep neural networks have made impressive advancements in various core tasks like segmentation, tracking, and detection. However, most approaches operate on the close-set assumption, meaning that…

Computer Vision and Pattern Recognition · Computer Science 2024-02-02 Jianzong Wu , Xiangtai Li , Shilin Xu , Haobo Yuan , Henghui Ding , Yibo Yang , Xia Li , Jiangning Zhang , Yunhai Tong , Xudong Jiang , Bernard Ghanem , Dacheng Tao

To ensure satisfactory user experience, dialog systems must be able to determine whether an input sentence is in-domain (ID) or out-of-domain (OOD). We assume that only ID sentences are available as training data because collecting enough…

Computation and Language · Computer Science 2018-08-01 Seonghan Ryu , Seokhwan Kim , Junhwi Choi , Hwanjo Yu , Gary Geunbae Lee

Zero-shot learning (ZSL) aims to predict unseen classes whose samples have never appeared during training. One of the most effective and widely used semantic information for zero-shot image classification are attributes which are…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Zhuo Chen , Yufeng Huang , Jiaoyan Chen , Yuxia Geng , Wen Zhang , Yin Fang , Jeff Z. Pan , Huajun Chen

Current Zero-Shot Learning (ZSL) approaches are restricted to recognition of a single dominant unseen object category in a test image. We hypothesize that this setting is ill-suited for real-world applications where unseen objects appear…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Shafin Rahman , Salman Khan , Fatih Porikli

Deep learning models are increasingly deployed on edge Internet of Things (IoT) devices. However, these models typically operate under supervised conditions and fail to recognize unseen classes different from training. To address this,…

Artificial Intelligence · Computer Science 2024-07-30 Dinghao Xue , Xiaoran Fan , Tao Chen , Guohao Lan , Qun Song

To overcome the absence of training data for unseen classes, conventional zero-shot learning approaches mainly train their model on seen datapoints and leverage the semantic descriptions for both seen and unseen classes. Beyond exploiting…

Machine Learning · Computer Science 2019-10-22 Hyeonwoo Yu , Beomhee Lee

Recent mask proposal models have significantly improved the performance of zero-shot semantic segmentation. However, the use of a `background' embedding during training in these methods is problematic as the resulting model tends to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Son Duy Dao , Hengcan Shi , Dinh Phung , Jianfei Cai

Zero-shot learning is a new paradigm to classify objects from classes that are not available at training time. Zero-shot learning (ZSL) methods have attracted considerable attention in recent years because of their ability to classify…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Chandan Gautam , Sethupathy Parameswaran , Ashish Mishra , Suresh Sundaram

Speech Recognition builds a bridge between the multimedia streaming (audio-only, visual-only or audio-visual) and the corresponding text transcription. However, when training the specific model of new domain, it often gets stuck in the lack…

Computation and Language · Computer Science 2023-06-13 Xize Cheng , Tao Jin , Linjun Li , Wang Lin , Xinyu Duan , Zhou Zhao

Exploring open-vocabulary video action recognition is a promising venture, which aims to recognize previously unseen actions within any arbitrary set of categories. Existing methods typically adapt pretrained image-text models to the video…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Chengyou Jia , Minnan Luo , Xiaojun Chang , Zhuohang Dang , Mingfei Han , Mengmeng Wang , Guang Dai , Sizhe Dang , Jingdong Wang

Context-aware embedding methods boost retrieval accuracy by conditioning on corpus statistics (e.g., term co-occurrence and topical patterns) extracted from neighboring documents. However, this context-aware approach requires access to the…

Computation and Language · Computer Science 2025-07-01 Philip Lippmann , Jie Yang

In this paper we present a system that exploits different pre-trained Language Models for assigning domain labels to WordNet synsets without any kind of supervision. Furthermore, the system is not restricted to use a particular set of…

Computation and Language · Computer Science 2021-02-01 Oscar Sainz , German Rigau

Zero-shot scene understanding in real-world settings presents major challenges due to the complexity and variability of natural scenes, where models must recognize new objects, actions, and contexts without prior labeled examples. This work…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Manjunath Prasad Holenarasipura Rajiv , B. M. Vidyavathi

We propose a novel zero-shot approach for keypoint detection on 3D shapes. Point-level reasoning on visual data is challenging as it requires precise localization capability, posing problems even for powerful models like DINO or CLIP.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Bingchen Gong , Diego Gomez , Abdullah Hamdi , Abdelrahman Eldesokey , Ahmed Abdelreheem , Peter Wonka , Maks Ovsjanikov

We introduce a simple yet effective episode-based training framework for zero-shot learning (ZSL), where the learning system requires to recognize unseen classes given only the corresponding class semantics. During training, the model is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Yunlong Yu , Zhong Ji , Zhongfei Zhang , Jungong Han

Zero-shot learning (ZSL) is a popular research problem that aims at predicting for those classes that have never appeared in the training stage by utilizing the inter-class relationship with some side information. In this study, we propose…

Artificial Intelligence · Computer Science 2020-07-01 Jiaoyan Chen , Freddy Lecue , Yuxia Geng , Jeff Z. Pan , Huajun Chen

We propose a novel zero-shot learning method for semantic utterance classification (SUC). It learns a classifier $f: X \to Y$ for problems where none of the semantic categories $Y$ are present in the training set. The framework uncovers the…

Computation and Language · Computer Science 2014-03-11 Yann N. Dauphin , Gokhan Tur , Dilek Hakkani-Tur , Larry Heck

Image caption generation is a long standing and challenging problem at the intersection of computer vision and natural language processing. A number of recently proposed approaches utilize a fully supervised object recognition model within…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Berkan Demirel , Ramazan Gokberk Cinbis , Nazli Ikizler-Cinbis

Dialogue State Tracking (DST), a crucial component of task-oriented dialogue (ToD) systems, keeps track of all important information pertaining to dialogue history: filling slots with the most probable values throughout the conversation.…

Computation and Language · Computer Science 2023-02-28 Han Zhou , Ignacio Iacobacci , Pasquale Minervini