English
Related papers

Related papers: CFM: Language-aligned Concept Foundation Model for…

200 papers

Time-series Foundation Models (TSFMs) have recently emerged as a universal paradigm for learning across diverse temporal domains. However, despite their empirical success, the internal mechanisms by which these models represent fundamental…

Machine Learning · Computer Science 2025-11-20 Atharva Pandey , Abhilash Neog , Gautam Jajoo

Key to tasks that require reasoning about natural language in visual contexts is grounding words and phrases to image regions. However, observing this grounding in contemporary models is complex, even if it is generally expected to take…

Computation and Language · Computer Science 2024-06-03 Noriyuki Kojima , Hadar Averbuch-Elor , Yoav Artzi

Explainable AI (XAI) is crucial for building transparent and trustworthy machine learning systems, especially in high-stakes domains. Concept Bottleneck Models (CBMs) have emerged as a promising ante-hoc approach that provides…

Artificial Intelligence · Computer Science 2026-01-21 Hanwei Zhang , Luo Cheng , Rui Wen , Yang Zhang , Lijun Zhang , Holger Hermanns

Aligning visual features with language embeddings is a key challenge in vision-language models (VLMs). The performance of such models hinges on having a good connector that maps visual features generated by a vision encoder to a shared…

Foundation models are used to extract transferable representations from large amounts of unlabeled data, typically via self-supervised learning (SSL). However, many of these models rely on architectures that offer limited interpretability,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Samuel Ofosu Mensah , Camila Roa , Kerol Djoumessi , Philipp Berens

Depth estimation is a fundamental task in computer vision with diverse applications. Recent advancements in deep learning have led to powerful depth foundation models (DFMs), yet their evaluation remains challenging due to inconsistencies…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zhenyu Li , Haotong Lin , Jiashi Feng , Peter Wonka , Bingyi Kang

Despite the impressive performance of vision-language models (VLMs) on downstream tasks, their ability to understand and reason about causal relationships in visual inputs remains unclear. Robust causal reasoning is fundamental to solving…

Computation and Language · Computer Science 2026-02-05 Zhaotian Weng , Haoxuan Li , Xin Eric Wang , Kuan-Hao Huang , Jieyu Zhao

Vision-language models (VLMs) extend the conventional large language models by integrating visual data, enabling richer multimodal reasoning and significantly broadens the practical applications of AI. However, including visual inputs also…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Daulet Toibazar , Kesen Wang , Sherif Mohamed , Abdulaziz Al-Badawi , Abdulrahman Alfulayt , Pedro J. Moreno

Object-Centric Learning (OCL) aggregates image or video feature maps into object-level feature vectors, termed \textit{slots}. It's self-supervision of reconstructing the input from slots struggles with complex object textures, thus Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Rongzhen Zhao , Vivienne Wang , Juho Kannala , Joni Pajarinen

Concept Bottleneck Models (CBMs) enhance interpretability by predicting human-understandable concepts as intermediate representations. However, existing CBMs often suffer from input-to-concept mapping bias and limited controllability, which…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Gaoxiang Huang , Songning Lai , Yutao Yue

Recent progress in large vision-language models has driven improvements in language-based semantic navigation, where an embodied agent must reach a target object described in natural language. Yet we still lack a clear, language-focused…

Image-Language Foundation Models (ILFMs) have demonstrated remarkable success in vision-language understanding, providing transferable multimodal representations that generalize across diverse downstream image-based tasks. The advancement…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jinxuan Li , Chaolei Tan , Haoxuan Chen , Jianxin Ma , Jian-Fang Hu , Jianhuang Lai , Wei-Shi Zheng

Foundation model-based semantic transmission has recently shown great potential in wireless image communication. However, existing methods exhibit two major limitations: (i) they overlook the varying importance of semantic components for…

Image and Video Processing · Electrical Eng. & Systems 2025-09-30 Fangyu Liu , Peiwen Jiang , Wenjin Wang , Chao-Kai Wen , Shi Jin , Jun Zhang

Vision-Language Models (VLMs) excel at high-level scene understanding but falter on fine-grained perception tasks requiring precise localization. This failure stems from a fundamental mismatch, as generating exact numerical coordinates is a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Peng Liu , Haozhan Shen , Chunxin Fang , Zhicheng Sun , Jiajia Liao , Tiancheng Zhao

Recent vision foundation models (VFMs) have demonstrated proficiency in various tasks but require supervised fine-tuning to perform the task of semantic segmentation effectively. Benchmarking their performance is essential for selecting…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Tommie Kerssies , Daan de Geus , Gijs Dubbelman

Understanding how Multimodal Large Language Models (MLLMs) process low-level visual features is critical for evaluating their perceptual abilities and has not been systematically characterized. Inspired by human psychophysics, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Pablo Hernández-Cámara , Alexandra Gomez-Villa , Jose Manuel Jaén-Lorites , Jorge Vila-Tomás , Valero Laparra , Jesus Malo

Learning concepts that are consistent with human perception is important for Deep Neural Networks to win end-user trust. Post-hoc interpretation methods lack transparency in the feature representations learned by the models. This work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

We have seen great progress in basic perceptual tasks such as object recognition and detection. However, AI models still fail to match humans in high-level vision tasks due to the lack of capacities for deeper reasoning. Recently the new…

Computer Vision and Pattern Recognition · Computer Science 2016-04-12 Yuke Zhu , Oliver Groth , Michael Bernstein , Li Fei-Fei

The integration of vision-language models such as CLIP and Concept Bottleneck Models (CBMs) offers a promising approach to explaining deep neural network (DNN) decisions using concepts understandable by humans, addressing the black-box…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Townim F. Chowdhury , Vu Minh Hieu Phan , Kewen Liao , Minh-Son To , Yutong Xie , Anton van den Hengel , Johan W. Verjans , Zhibin Liao

Decision making demands intricate interplay between perception, memory, and reasoning to discern optimal policies. Conventional approaches to decision making face challenges related to low sample efficiency and poor generalization. In…

Artificial Intelligence · Computer Science 2024-05-30 Xiaoqian Liu , Xingzhou Lou , Jianbin Jiao , Junge Zhang