English
Related papers

Related papers: Generalization Boosted Adapter for Open-Vocabulary…

200 papers

Spoken Language Models (SLMs) are increasingly central to modern speech-driven applications, but performance degrades under acoustic shift - real-world noise, reverberation, and microphone variation. Prior solutions rely on offline domain…

Recent Open-Vocabulary Action Recognition (OVAR) methods typically aggregate visual features into a global representation before computing text alignment, a process that obscures local patch information and fine-grained spatio-temporal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Yerim So , Jiyeong Kim , Jiwon Yoon , Dongbo Min

Adaptation of pretrained vision-language models such as CLIP to various downstream tasks have raised great interest in recent researches. Previous works have proposed a variety of test-time adaptation (TTA) methods to achieve strong…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Taolin Zhang , Jinpeng Wang , Hang Guo , Tao Dai , Bin Chen , Shu-Tao Xia

Vision-Language-Action (VLA) models have made substantial progress by leveraging the robust capabilities of Visual Language Models (VLMs). However, VLMs' significant parameter size and autoregressive (AR) decoding nature impose considerable…

Machine Learning · Computer Science 2025-09-23 Songsheng Wang , Rucheng Yu , Zhihang Yuan , Chao Yu , Feng Gao , Yu Wang , Derek F. Wong

Open-vocabulary semantic segmentation attempts to classify and outline objects in an image using arbitrary text labels, including those unseen during training. Self-supervised learning resolves numerous visual and linguistic processing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Muhammad Atta ur Rahman , Dooseop Choi , Seung-Ik Lee , KyoungWook Min

Visual simultaneous localization and mapping (VSLAM) has broad applications, with state-of-the-art methods leveraging deep neural networks for better robustness and applicability. However, there is a lack of research in fusing these…

Robotics · Computer Science 2024-03-21 Yuxuan Zhou , Xingxing Li , Shengyu Li , Xuanbin Wang , Shaoquan Feng , Yuxuan Tan

Domain adaptive detection aims to improve the generalization of detectors on target domain. To reduce discrepancy in feature distributions between two domains, recent approaches achieve domain adaption through feature alignment in different…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Libo Zhang , Wenzhang Zhou , Heng Fan , Tiejian Luo , Haibin Ling

Domain generalization (DG) aims to adapt a model using one or multiple source domains to ensure robust performance in unseen target domains. Recently, Parameter-Efficient Fine-Tuning (PEFT) of foundation models has shown promising results…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Seokju Yun , Seunghye Chae , Dongheon Lee , Youngmin Ro

General speech restoration demands techniques that can interpret complex speech structures under various distortions. While State-Space Models like SEMamba have advanced the state-of-the-art in speech denoising, they are not inherently…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-13 Yongjoon Lee , Jung-Woo Choi

Existing open-vocabulary object detection (OVD) develops methods for testing unseen categories by aligning object region embeddings with corresponding VLM features. A recent study leverages the idea that VLMs implicitly learn compositional…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Hojun Choi , Junsuk Choe , Hyunjung Shim

Vision-language models (VLMs) have recently shown promise in general-purpose reasoning tasks, yet their applicability to domain-specific scientific workflows remains largely unexplored. In this work, we evaluated a series of open-weight and…

Instrumentation and Methods for Astrophysics · Physics 2026-02-10 S. Riggi

Currently nearing human-level performance, Visual Question Answering (VQA) is an emerging area in artificial intelligence. Established as a multi-disciplinary field in machine learning, both computer vision and natural language processing…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Bhanuka Manesha Samarasekara Vitharana Gamage , Lim Chern Hong

Large vision language models (VLMs) combine large language models with vision encoders, demonstrating promise across various tasks. However, they often underperform in task-specific applications due to domain gaps between pre-training and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yang Bai , Yang Zhou , Jun Zhou , Rick Siow Mong Goh , Daniel Shu Wei Ting , Yong Liu

Image and language modeling is of crucial importance for vision-language pre-training (VLP), which aims to learn multi-modal representations from large-scale paired image-text data. However, we observe that most existing VLP methods focus…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Sunan He , Taian Guo , Tao Dai , Ruizhi Qiao , Chen Wu , Xiujun Shu , Bo Ren

Unsupervised domain adaptation (UDA) has achieved unprecedented success in improving the cross-domain robustness of object detection models. However, existing UDA methods largely ignore the instantaneous data distribution during model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Zongxian Li , Qixiang Ye , Chong Zhang , Jingjing Liu , Shijian Lu , Yonghong Tian

Recent advances in diffusion models have positioned them as powerful generative frameworks for speech synthesis, demonstrating substantial improvements in audio quality and stability. Nevertheless, their effectiveness in vocoders…

Sound · Computer Science 2025-12-01 Teysir Baoueb , Xiaoyu Bie , Mathieu Fontaine , Gaël Richard

The reliance on language in Vision-Language-Action (VLA) models introduces ambiguity, cognitive overhead, and difficulties in precise object identification and sequential task execution, particularly in environments with multiple visually…

Robotics · Computer Science 2026-03-02 Donggeon Kim , Seungwon Jan , Hyeonjun Park , Daegyu Lim

Combining simple architectures with large-scale pre-training has led to massive improvements in image classification. For object detection, pre-training and scaling approaches are less well established, especially in the long-tailed and…

Open-Vocabulary Object Detection (OVOD) has achieved remarkable success in generalizing to novel categories. However, this success often rests on the implicit assumption of domain stationarity. In this work, we provide a principled revisit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Xiaoran Xu , Xiaoshan Yang , Jiangang Yang , Yifan Xu , Jian Liu , Changsheng Xu

While Large Language Models (LLMs) demonstrate impressive generation abilities, they frequently struggle when it comes to specialized domains due to their limited domain-specific knowledge. Studies on domain-specific LLMs resort to…

Computation and Language · Computer Science 2024-10-03 Chengyuan Liu , Shihang Wang , Lizhi Qing , Kun Kuang , Yangyang Kang , Changlong Sun , Fei Wu