English
Related papers

Related papers: CO3: Low-resource Contrastive Co-training for Gene…

200 papers

This work explores how self-supervised learning can be universally used to discover speaker-specific features towards enabling personalized speech enhancement models. We specifically address the few-shot learning scenario where access to…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-11 Aswin Sivaraman , Minje Kim

Constructing an organized dataset comprised of a large number of images and several captions for each image is a laborious task, which requires vast human effort. On the other hand, collecting a large number of images and sentences…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Dong-Jin Kim , Jinsoo Choi , Tae-Hyun Oh , In So Kweon

Classifying and segmenting patterns from a limited number of examples is a significant challenge in remote sensing and earth observation due to the difficulty in acquiring accurately labeled data in large quantities. Previous studies have…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Jing Wu , Naira Hovakimyan , Jennifer Hobbs

We propose the use of conversational GPT models for easy and quick few-shot text classification in the financial domain using the Banking77 dataset. Our approach involves in-context learning with GPT-3.5 and GPT-4, which minimizes the…

Computation and Language · Computer Science 2023-08-29 Lefteris Loukas , Ilias Stogiannidis , Prodromos Malakasiotis , Stavros Vassos

Compared to standard retrieval tasks, passage retrieval for conversational question answering (CQA) poses new challenges in understanding the current user question, as each question needs to be interpreted within the dialogue context.…

Computation and Language · Computer Science 2022-10-31 Zeqiu Wu , Yi Luan , Hannah Rashkin , David Reitter , Hannaneh Hajishirzi , Mari Ostendorf , Gaurav Singh Tomar

We present RECLIP (Resource-efficient CLIP), a simple method that minimizes computational resource footprint for CLIP (Contrastive Language Image Pretraining). Inspired by the notion of coarse-to-fine in computer vision, we leverage small…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Runze Li , Dahun Kim , Bir Bhanu , Weicheng Kuo

Feature quality is paramount for classification performance, particularly in few-shot scenarios. Contrastive learning, a widely adopted technique for enhancing feature quality, leverages sample relations to extract intrinsic features that…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Guowei Yin , Sheng Huang , Luwen Huangfu , Yi Zhang , Xiaohong Zhang

Few-shot text classification has important application value in low-resource environments. This paper proposes a strategy that combines adaptive fine-tuning, contrastive learning, and regularization optimization to improve the…

Computation and Language · Computer Science 2025-05-12 Xu Han , Yumeng Sun , Weiqiang Huang , Hongye Zheng , Junliang Du

The disparity in language resources poses a challenge in multilingual NLP, with high-resource languages benefiting from extensive data, while low-resource languages lack sufficient data for effective training. Our Contrastive Language…

Computation and Language · Computer Science 2025-08-28 Philipp Borchert , Jochen De Weerdt , Marie-Francine Moens

Zero-shot Relation Triplet Extraction (ZeroRTE) aims to extract relation triplets from texts containing unseen relation types. This capability benefits various downstream information retrieval (IR) tasks. The primary challenge lies in…

Computation and Language · Computer Science 2025-04-29 Wanli Li , Tieyun Qian , Yi Song , Zeyu Zhang , Jiawei Li , Zhuang Chen , Lixin Zou

Natural language serves as a common and straightforward signal for humans to interact seamlessly with machines. Recognizing the importance of this interface, the machine learning community is investing considerable effort in generating data…

Computation and Language · Computer Science 2025-01-03 Shiyu Wang , Yihao Feng , Tian Lan , Ning Yu , Yu Bai , Ran Xu , Huan Wang , Caiming Xiong , Silvio Savarese

Turn-level user satisfaction is one of the most important performance metrics for conversational agents. It can be used to monitor the agent's performance and provide insights about defective user experiences. Moreover, a powerful…

Machine Learning · Computer Science 2021-04-13 Mohammad Kachuee , Hao Yuan , Young-Bum Kim , Sungjin Lee

The major paradigm of applying a pre-trained language model to downstream tasks is to fine-tune it on labeled task data, which often suffers instability and low performance when the labeled examples are scarce.~One way to alleviate this…

Computation and Language · Computer Science 2021-06-07 Ruikun Luo , Guanhuan Huang , Xiaojun Quan

Models for conversational question answering (ConvQA) over knowledge graphs (KGs) are usually trained and tested on benchmarks of gold QA pairs. This implies that training is limited to surface forms seen in the respective datasets, and…

Computation and Language · Computer Science 2024-02-20 Magdalena Kaiser , Rishiraj Saha Roy , Gerhard Weikum

Context modeling plays a significant role in building multi-turn dialogue systems. In order to make full use of context information, systems can use Incomplete Utterance Rewriting(IUR) methods to simplify the multi-turn dialogue into…

Computation and Language · Computer Science 2022-03-23 Zhihao Wang , Tangjian Duan , Zihao Wang , Minghui Yang , Zujie Wen , Yongliang Wang

The goal of few-shot classification is to classify new categories with few labeled examples within each class. Nowadays, the excellent performance in handling few-shot classification problems is shown by metric-based meta-learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Xu Luo , Yuxuan Chen , Liangjian Wen , Lili Pan , Zenglin Xu

Despite the recent developments in the field of cross-modal retrieval, there has been less research focusing on low-resource languages due to the lack of manually annotated datasets. In this paper, we propose a noise-robust cross-lingual…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Yabing Wang , Jianfeng Dong , Tianxiang Liang , Minsong Zhang , Rui Cai , Xun Wang

Retrieving keywords (bidwords) with the same intent as query, referred to as close variant keywords, is of prime importance for effective targeted search advertising. For head and torso search queries, sponsored search engines use a huge…

Computation and Language · Computer Science 2021-06-08 Akash Kumar Mohankumar , Nikit Begwani , Amit Singh

State-of-the-art model for zero-shot cross-lingual spoken language understanding performs cross-lingual unsupervised contrastive learning to achieve the label-agnostic semantic alignment between each utterance and its code-switched data.…

Computation and Language · Computer Science 2024-05-13 Bowen Xing , Ivor W. Tsang

Continual Few-shot Relation Extraction (CFRE) is a practical problem that requires the model to continuously learn novel relations while avoiding forgetting old ones with few labeled training data. The primary challenges are catastrophic…

Computation and Language · Computer Science 2024-02-27 Shengkun Ma , Jiale Han , Yi Liang , Bo Cheng