English
Related papers

Related papers: Multi-modal Semantic Understanding with Contrastiv…

200 papers

Multi-modal contrastive learning as a self-supervised representation learning technique has achieved great success in foundation model training, such as CLIP~\citep{radford2021learning}. In this paper, we study the theoretical properties of…

Machine Learning · Statistics 2025-05-20 Yu Gui , Cong Ma , Zongming Ma

Multi-modal contrastive models such as CLIP achieve state-of-the-art performance in zero-shot classification by embedding input images and texts on a joint representational space. Recently, a modality gap has been reported in two-encoder…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Abrar Fahim , Alex Murphy , Alona Fyshe

Contrastive Language-Image Pre-training (CLIP) demonstrates strong potential in medical image analysis but requires substantial data and computational resources. Due to these restrictions, existing CLIP applications in medical imaging focus…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuexi Du , John Onofrey , Nicha C. Dvornek

Multimodal sentiment analysis has become an increasingly popular research area as the demand for multimodal online content is growing. For multimodal sentiment analysis, words can have different meanings depending on the linguistic context…

Computation and Language · Computer Science 2022-09-16 Junghun Kim , Jihie Kim

Multimodal search has revolutionized the fashion industry, providing a seamless and intuitive way for users to discover and explore fashion items. Based on their preferences, style, or specific attributes, users can search for products by…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Prithviraj Purushottam Naik , Rohit Agarwal

Multi-modal reasoning plays a vital role in bridging the gap between textual and visual information, enabling a deeper understanding of the context. This paper presents the Feature Swapping Multi-modal Reasoning (FSMR) model, designed to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Shuang Li , Jiahua Wang , Lijie Wen

Multi-modality image fusion aims at fusing modality-specific (complementarity) and modality-shared (correlation) information from multiple source images. To tackle the problem of the neglect of inter-feature relationships, high-frequency…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xiaoli Zhang , Liying Wang , Libo Zhao , Xiongfei Li , Siwei Ma

Existed pre-training methods either focus on single-modal tasks or multi-modal tasks, and cannot effectively adapt to each other. They can only utilize single-modal data (i.e. text or image) or limited multi-modal data (i.e. image-text…

Computation and Language · Computer Science 2022-03-15 Wei Li , Can Gao , Guocheng Niu , Xinyan Xiao , Hao Liu , Jiachen Liu , Hua Wu , Haifeng Wang

Although Large Language Models (LLMs) excel in reasoning and generation for language tasks, they are not specifically designed for multimodal challenges. Training Multimodal Large Language Models (MLLMs), however, is resource-intensive and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yuqi Pang , Bowen Yang , Haoqin Tu , Yun Cao , Zeyu Zhang

Prior work has offered evidence for functional localization in the brain; different anatomical regions preferentially activate for certain types of visual input. For example, the fusiform face area preferentially activates for visual…

Machine Learning · Computer Science 2024-10-02 Cory Efird , Alex Murphy , Joel Zylberberg , Alona Fyshe

The rapid emergence of multimodal deepfakes (visual and auditory content are manipulated in concert) undermines the reliability of existing detectors that rely solely on modality-specific artifacts or cross-modal inconsistencies. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Yuxuan Du , Zhendong Wang , Yuhao Luo , Caiyong Piao , Zhiyuan Yan , Hao Li , Li Yuan

Vision-Language Pretraining (VLP) has achieved remarkable success across various downstream tasks, but such gains are largely driven by scaling up on training data. Yet, literature methods treat image-text pairs as isolated training…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Wenbo Lu

Contrastive vision-language models such as CLIP have demonstrated strong performance across a wide range of multimodal tasks by learning from aligned image-text pairs. However, their ability to handle complex, real-world web documents…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yiqi Lin , Alex Jinpeng Wang , Linjie Li , Zhengyuan Yang , Mike Zheng Shou

Music captioning has gained significant attention in the wake of the rising prominence of streaming media platforms. Traditional approaches often prioritize either the audio or lyrics aspect of the music, inadvertently ignoring the…

Sound · Computer Science 2023-10-24 Zihao He , Weituo Hao , Wei-Tsung Lu , Changyou Chen , Kristina Lerman , Xuchen Song

Semi-supervised learning has demonstrated great potential in medical image segmentation by utilizing knowledge from unlabeled data. However, most existing approaches do not explicitly capture high-level semantic relations between distant…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Qianying Liu , Xiao Gu , Paul Henderson , Fani Deligianni

Multimodal AI models have achieved impressive performance in tasks that require integrating information from multiple modalities, such as vision and language. However, their "black-box" nature poses a major barrier to deployment in…

Artificial Intelligence · Computer Science 2026-02-18 Zhanliang Wang , Kai Wang

In an era where social media platforms abound, individuals frequently share images that offer insights into their intents and interests, impacting individual life quality and societal stability. Traditional computer vision tasks, such as…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Yin Tang , Jiankai Li , Hongyu Yang , Xuan Dong , Lifeng Fan , Weixin Li

Multimodal sentiment analysis is a key technology in the fields of human-computer interaction and affective computing. Accurately recognizing human emotional states is crucial for facilitating smooth communication between humans and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wangyuan Zhu , Jun Yu

Learning medical visual representations directly from paired radiology reports has become an emerging topic in representation learning. However, existing medical image-text joint learning methods are limited by instance or local supervision…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Fuying Wang , Yuyin Zhou , Shujun Wang , Varut Vardhanabhuti , Lequan Yu

Multimodal learning leverages complementary information derived from different modalities, thereby enhancing performance in medical image segmentation. However, prevailing multimodal learning methods heavily rely on extensive well-annotated…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiaogen Zhou , Yiyou Sun , Min Deng , Winnie Chiu Wing Chu , Qi Dou