English
Related papers

Related papers: WC-SBERT: Zero-Shot Text Classification via SBERT …

200 papers

Zero-shot learning (ZSL) makes object recognition in images possible in absence of visual training data for a part of the classes from a dataset. When the number of classes is large, classes are usually represented by semantic class…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Yannick Le Cacheux , Adrian Popescu , Hervé Le Borgne

In this paper we present a system that exploits different pre-trained Language Models for assigning domain labels to WordNet synsets without any kind of supervision. Furthermore, the system is not restricted to use a particular set of…

Computation and Language · Computer Science 2021-02-01 Oscar Sainz , German Rigau

We propose a semi-supervised text classifier based on self-training using one positive and one negative property of neural networks. One of the weaknesses of self-training is the semantic drift problem, where noisy pseudo-labels accumulate…

Computation and Language · Computer Science 2024-01-02 Payam Karisani

Providing pretrained language models with simple task descriptions in natural language enables them to solve some tasks in a fully unsupervised fashion. Moreover, when combined with regular learning from examples, this idea yields…

Computation and Language · Computer Science 2021-10-05 Timo Schick , Hinrich Schütze

Most of the literature around text classification treats it as a supervised learning problem: given a corpus of labeled documents, train a classifier such that it can accurately predict the classes of unseen documents. In industry, however,…

Computation and Language · Computer Science 2018-04-09 Katherine Bailey , Sunny Chopra

Insufficient or even unavailable training data of emerging classes is a big challenge of many classification tasks, including text classification. Recognising text documents of classes that have never been seen in the learning stage,…

Computation and Language · Computer Science 2019-04-01 Jingqing Zhang , Piyawat Lertvittayakumjorn , Yike Guo

An overwhelming majority of the world's human population lives in urban areas and cities. Understanding a city's transportation typology is immensely valuable for planners and policy makers whose decisions can potentially impact millions of…

Computation and Language · Computer Science 2022-04-12 Srushti Rath , Joseph Y. J. Chow

Zero-shot recognition (ZSR) aims to recognize target-domain data instances of unseen classes based on the models learned from associated pairs of seen-class source and target domain data. One of the key challenges in ZSR is the relative…

Computer Vision and Pattern Recognition · Computer Science 2016-12-06 Ziming Zhang , Venkatesh Saligrama

Active learning strives to reduce annotation costs by choosing the most critical examples to label. Typically, the active learning strategy is contingent on the classification model. For instance, uncertainty sampling depends on poorly…

Computation and Language · Computer Science 2020-10-26 Michelle Yuan , Hsuan-Tien Lin , Jordan Boyd-Graber

Using pre-trained transformer models such as BERT has proven to be effective in many NLP tasks. This paper presents our work to fine-tune BERT models for Arabic Word Sense Disambiguation (WSD). We treated the WSD task as a sentence-pair…

Computation and Language · Computer Science 2022-05-20 Moustafa Al-Hajj , Mustafa Jarrar

Recently, large-scale pre-trained Vision and Language (VL) models have set a new state-of-the-art (SOTA) in zero-shot visual classification enabling open-vocabulary recognition of potentially unlimited set of categories defined as simple…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Mateusz Kozinski , Horst Possegger , Rogerio Feris , Horst Bischof

Meta-training, which fine-tunes the language model (LM) on various downstream tasks by maximizing the likelihood of the target label given the task instruction and input instance, has improved the zero-shot task generalization performance.…

Computation and Language · Computer Science 2023-06-07 Seonghyeon Ye , Doyoung Kim , Joel Jang , Joongbo Shin , Minjoon Seo

This study demonstrates a cost-effective approach to semantic segmentation using self-supervised vision transformers (SSVT). By freezing the SSVT backbone and training a lightweight segmentation head, our approach effectively utilizes…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Seungho Lee , Seoungyoon Kang , Hyunjung Shim

The extraction and analysis of insights from medical data, primarily stored in free-text formats by healthcare workers, presents significant challenges due to its unstructured nature. Medical coding, a crucial process in healthcare, remains…

Computation and Language · Computer Science 2024-05-28 Mikhail Kulyabin , Gleb Sokolov , Aleksandr Galaida , Andreas Maier , Tomas Arias-Vergara

In some of object recognition problems, labeled data may not be available for all categories. Zero-shot learning utilizes auxiliary information (also called signatures) describing each category in order to find a classifier that can…

Computer Vision and Pattern Recognition · Computer Science 2016-06-01 Seyed Mohsen Shojaee , Mahdieh Soleymani Baghshah

Natural language processing methods have several applications in automated auditing, including document or passage classification, information retrieval, and question answering. However, training such models requires a large amount of…

Computation and Language · Computer Science 2022-11-16 David Biesner , Maren Pielka , Rajkumar Ramamurthy , Tim Dilmaghani , Bernd Kliem , Rüdiger Loitz , Rafet Sifa

Active learning is an iterative labeling process that is used to obtain a small labeled subset, despite the absence of labeled data, thereby enabling to train a model for supervised tasks such as text classification. While active learning…

Computation and Language · Computer Science 2024-10-07 Christopher Schröder , Gerhard Heyer

Supervised learning methods can solve the given problem in the presence of a large set of labeled data. However, the acquisition of a dataset covering all the target classes typically requires manual labeling which is expensive and…

Sound · Computer Science 2022-06-13 Duygu Dogan , Huang Xie , Toni Heittola , Tuomas Virtanen

We consider the problem of zero-shot one-class visual classification, extending traditional one-class classification to scenarios where only the label of the target class is available. This method aims to discriminate between positive and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yassir Bendou , Giulia Lioi , Bastien Pasdeloup , Lukas Mauch , Ghouthi Boukli Hacene , Fabien Cardinaux , Vincent Gripon

Keyword extraction has been an important topic for modern natural language processing. With its applications ranging from ontology generation, fact verification in summarized text, and recommendation systems. While it has had significant…

Computation and Language · Computer Science 2022-11-17 Aman Priyanshu , Supriti Vijay