English
Related papers

Related papers: DVLA-RL: Dual-Level Vision-Language Alignment with…

200 papers

Recent advances in few-shot adaptation for Vision-Language Models (VLMs) have greatly expanded their ability to generalize across tasks using only a few labeled examples. However, existing approaches primarily build upon the strong…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Maxime Zanella , Clément Fuchs , Ismail Ben Ayed , Christophe De Vleeschouwer

We propose LCLA (Language-Conditioned Latent Alignment), a framework for vision-language navigation that learns modular perception-action interfaces by aligning sensory observations to a latent representation of an expert policy. The expert…

Robotics · Computer Science 2026-02-11 Nitesh Subedi , Adam Haroon , Samuel Tetteh , Prajwal Koirala , Cody Fleming , Soumik Sarkar

Aiming at recognizing the samples from novel categories with few reference samples, few-shot learning (FSL) is a challenging problem. We found that the existing works often build their few-shot model based on the image-level feature by…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Junying Huang , Fan Chen , Keze Wang , Liang Lin , Dongyu Zhang

This report introduces an enhanced method for the Foundational Few-Shot Object Detection (FSOD) task, leveraging the vision-language model (VLM) for object detection. However, on specific datasets, VLM may encounter the problem where the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Hongpeng Pan , Shifeng Yi , Shouwei Yang , Lei Qi , Bing Hu , Yi Xu , Yang Yang

The recent advancements in Vision Language Models (VLMs) have demonstrated progress toward true intelligence requiring robust reasoning capabilities. Beyond pattern recognition, linguistic reasoning must integrate with visual comprehension,…

Artificial Intelligence · Computer Science 2026-04-06 Yunfei Bai , Amit Dhanda , Shekhar Jain

Cross-subject visual decoding aims to reconstruct visual experiences from brain activity across individuals, enabling more scalable and practical brain-computer interfaces. However, existing methods often suffer from degraded performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Shumeng Li , Jintao Guo , Jian Zhang , Yulin Zhou , Luyang Cao , Yinghuan Shi

The Vision Language Model (VLM) excels in aligning vision and language representations, and prompt learning has emerged as a key technique for adapting such models to downstream tasks. However, the application of prompt learning with VLM in…

Machine Learning · Computer Science 2025-09-19 Zhihao Wang , Wenke Huang , Tian Chen , Zekun Shi , Guancheng Wan , Yu Qiao , Bin Yang , Jian Wang , Bing Li , Mang Ye

Few-Shot Learning (FSL) is a challenging task, which aims to recognize novel classes with few examples. Recently, lots of methods have been proposed from the perspective of meta-learning and representation learning. However, few works focus…

Machine Learning · Computer Science 2023-07-27 Baoquan Zhang , Hao Jiang , Xutao Li , Shanshan Feng , Yunming Ye , Rui Ye

Real-world datasets often exhibit class imbalance across multiple categories, manifesting as long-tailed distributions and few-shot scenarios. This is especially challenging in Class-Imbalanced Multi-Label Image Classification (CI-MLIC)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Sheng Huang , Jiexuan Yan , Beiyan Liu , Bo Liu , Richang Hong

Zero-shot learning (ZSL) aims to recognize novel classes through transferring shared semantic knowledge (e.g., attributes) from seen classes to unseen classes. Recently, attention-based methods have exhibited significant progress which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jinwei Han , Yingguo Gao , Zhiwen Lin , Ke Yan , Shouhong Ding , Yuan Gao , Gui-Song Xia

Feature quality is paramount for classification performance, particularly in few-shot scenarios. Contrastive learning, a widely adopted technique for enhancing feature quality, leverages sample relations to extract intrinsic features that…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Guowei Yin , Sheng Huang , Luwen Huangfu , Yi Zhang , Xiaohong Zhang

Ensuring cultural values alignment in Large Language Models (LLMs) remains a critical challenge, as these models often embed Western-centric biases from their training data, leading to misrepresentations and fairness concerns in…

Computation and Language · Computer Science 2025-05-09 Wonduk Seo , Zonghao Yuan , Yi Bu

In recent years, reinforcement learning (RL)-based methods for learning driving policies have gained increasing attention in the autonomous driving community and have achieved remarkable progress in various driving scenarios. However,…

Robotics · Computer Science 2024-12-23 Zilin Huang , Zihao Sheng , Yansong Qu , Junwei You , Sikai Chen

Existing few-shot learning (FSL) methods usually assume base classes and novel classes are from the same domain (in-domain setting). However, in practice, it may be infeasible to collect sufficient training samples for some special domains…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Yixiong Zou , Shanghang Zhang , JianPeng Yu , Yonghong Tian , José M. F. Moura

The rapid progress of auto-regressive vision-language models (VLMs) has inspired growing interest in vision-language-action models (VLA) for robotic manipulation. Recently, masked diffusion models, a paradigm distinct from autoregressive…

Robotics · Computer Science 2025-09-11 Yuqing Wen , Hebei Li , Kefan Gu , Yucheng Zhao , Tiancai Wang , Xiaoyan Sun

Few-shot learning (FSL) has emerged as an effective learning method and shows great potential. Despite the recent creative works in tackling FSL tasks, learning valid information rapidly from just a few or even zero samples still remains a…

Machine Learning · Computer Science 2022-05-25 Yisheng Song , Ting Wang , Subrota K Mondal , Jyoti Prakash Sahoo

Few-shot adaptation of vision-language models remains fundamentally limited by how negative class signals are handled at inference. Existing methods apply uniform negative suppression across all queries, ignoring that the most damaging…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Sriram Mandalika

Few-shot learning in medical image classification presents a significant challenge due to the limited availability of annotated data and the complex nature of medical imagery. In this work, we propose Adaptive Vision-Language Fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Harrison Fuller , Fernando Gabriela Garcia , Victor Flores

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Jinhai Yang , Hua Yang , Lin Chen

Supervised fine-tuning (SFT), supervised instruction tuning (SIT) and in-context learning (ICL) are three alternative, de facto standard approaches to few-shot learning. ICL has gained popularity recently with the advent of LLMs due to its…

Computation and Language · Computer Science 2024-03-05 Evgeniia Razumovskaia , Ivan Vulić , Anna Korhonen