English
Related papers

Related papers: Domain Adaptation for Contrastive Audio-Language M…

200 papers

Domain generalization (DG) is a difficult transfer learning problem aiming to learn a generalizable model for unseen domains. Recent foundation models (FMs) are robust to many distribution shifts and, therefore, should substantially improve…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Xin Zhang , Shixiang Shane Gu , Yutaka Matsuo , Yusuke Iwasawa

Unsupervised Domain Adaptation (UDA) is a critical challenge in real-world vision systems, especially in resource-constrained environments like drones, where memory and computation are limited. Existing prompt-driven UDA methods typically…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Yasir Ali Farrukh , Syed Wali , Irfan Khan , Nathaniel D. Bastian

The performance of automatic speech recognition systems can be improved by adapting an acoustic model to compensate for the mismatch between training and testing conditions, for example by adapting to unseen speakers. The success of speaker…

Computation and Language · Computer Science 2018-08-31 Ondřej Klejch , Joachim Fainberg , Peter Bell

The assumption that training and testing samples are generated from the same distribution does not always hold for real-world machine-learning applications. The procedure of tackling this discrepancy between the training (source) and…

Machine Learning · Computer Science 2018-12-05 Debasmit Das , C. S. George Lee

While Large Language Models (LLMs) have achieved strong performance on general-purpose language tasks, their deployment in regulated and data-sensitive domains, including insurance, remains limited. Leveraging millions of historical…

Computation and Language · Computer Science 2026-02-20 Zhengda Mo , Zhiyu Quan , Eli O'Donohue , Kaiwen Zhong

Automatic speech recognition models are often adapted to improve their accuracy in a new domain. A potential drawback of model adaptation to new domains is catastrophic forgetting, where the Word Error Rate on the original domain is…

Sound · Computer Science 2022-10-10 Somshubra Majumdar , Shantanu Acharya , Vitaly Lavrukhin , Boris Ginsburg

Large language models (LLMs) are increasingly adopted in educational technologies for a variety of tasks, from generating instructional materials and assisting with assessment design to tutoring. While prior work has investigated how models…

Computation and Language · Computer Science 2025-12-24 Kirk Vanacore , Rene F. Kizilcec

Speech recognition systems are often highly domain dependent, a fact widely reported in the literature. However the concept of domain is complex and not bound to clear criteria. Hence it is often not evident if data should be considered to…

Computation and Language · Computer Science 2015-09-23 Mortaza Doulaty , Oscar Saz , Thomas Hain

Pre-trained vision-language models (VLMs) have shown impressive performance on various downstream tasks by utilizing knowledge learned from large data. In general, the performance of VLMs on target tasks can be further improved by prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Eulrang Cho , Jooyeon Kim , Hyunwoo J. Kim

Few-shot Test-Time Domain Adaptation focuses on adapting a model at test time to a specific domain using only a few unlabeled examples, addressing domain shift. Prior methods leverage CLIP's strong out-of-distribution (OOD) abilities by…

Machine Learning · Computer Science 2025-06-24 Zhixiang Chi , Li Gu , Huan Liu , Ziqiang Wang , Yanan Wu , Yang Wang , Konstantinos N Plataniotis

Speaker verification system trained on one domain usually suffers performance degradation when applied to another domain. To address this challenge, researchers commonly use feature distribution matching-based methods in unsupervised domain…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-23 Wen Huang , Bing Han , Zhengyang Chen , Shuai Wang , Yanmin Qian

Recent multi-modal audio-language models (ALMs) excel at text-audio retrieval but struggle with frame-wise audio understanding. Prior works use temporal-aware labels or unsupervised training to improve frame-wise capabilities, but they…

We propose a simple yet a novel approach to improve completion in domain modeling activities. Our approach exploits the power of large language models by using few-shot prompt learning without the need to train or fine-tune those models…

Software Engineering · Computer Science 2022-12-08 Meriem Ben Chaaben , Lola Burgueño , Houari Sahraoui

While Large Language Models (LLMs) exhibit remarkable capabilities in zero-shot and few-shot scenarios, they often require computationally prohibitive sizes. Conversely, smaller Masked Language Models (MLMs) like BERT and RoBERTa achieve…

Computation and Language · Computer Science 2024-10-18 Ahmed Elshabrawy , Yongxin Huang , Iryna Gurevych , Alham Fikri Aji

The sensor-based recognition of Activities of Daily Living (ADLs) in smart home environments enables several applications in the areas of energy management, safety, well-being, and healthcare. ADLs recognition is typically based on deep…

Artificial Intelligence · Computer Science 2025-03-24 Gabriele Civitarese , Michele Fiori , Priyankar Choudhary , Claudio Bettini

Vision-language models (VLMs) like CLIP have demonstrated remarkable applicability across a variety of downstream tasks, including zero-shot image classification. Recently, the use of prompts or adapters for efficient transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Yongjin Yang , Jongwoo Ko , Se-Young Yun

In this paper, we leverage large language models (LMs) to perform zero-shot text style transfer. We present a prompting method that we call augmented zero-shot learning, which frames style transfer as a sentence rewriting task and requires…

Computation and Language · Computer Science 2022-04-01 Emily Reif , Daphne Ippolito , Ann Yuan , Andy Coenen , Chris Callison-Burch , Jason Wei

Large Language Models (LLMs), being generic task solvers, are versatile. However, despite the vast amount of data they are trained on, there are speculations about their adaptation capabilities to a new domain. Additionally, the simple…

Computation and Language · Computer Science 2025-09-03 Anum Afzal , Mehul Kumawat , Florian Matthes

We present a novel Speech Augmented Language Model (SALM) with {\em multitask} and {\em in-context} learning capabilities. SALM comprises a frozen text LLM, a audio encoder, a modality adapter module, and LoRA layers to accommodate speech…

Computation and Language · Computer Science 2023-10-17 Zhehuai Chen , He Huang , Andrei Andrusenko , Oleksii Hrinchuk , Krishna C. Puvvada , Jason Li , Subhankar Ghosh , Jagadeesh Balam , Boris Ginsburg

Speech recognizers trained on close-talking speech do not generalize to distant speech and the word error rate degradation can be as large as 40% absolute. Most studies focus on tackling distant speech recognition as a separate problem,…

Computation and Language · Computer Science 2018-06-14 Hao Tang , Wei-Ning Hsu , Francois Grondin , James Glass