English
Related papers

Related papers: CAMEL-CLIP: Channel-aware Multimodal Electroenceph…

200 papers

Electrocardiograms (ECG) are electrical recordings of the heart that are critical for diagnosing cardiovascular conditions. ECG language models (ELMs) have recently emerged as a promising framework for ECG classification accompanied by…

Foundation models pre-trained through masked reconstruction on large-scale EEG data have emerged as a promising paradigm for learning generalizable neural representations across diverse brain-computer interface applications. However, a…

Artificial Intelligence · Computer Science 2026-05-19 Yang Shao , Peiliang Gong , Qun Dai , Daoqiang Zhang

High-fidelity ECG interpretation is increasingly reliant on massive foundation models, yet their deployment in clinical edge-care remains hindered by extreme computational demands. While knowledge distillation (KD) is a promising solution,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Dang Hong Nguyen , Nhi Ngoc-Yen Nguyen , Huy-Hieu Pham

Electroencephalography (EEG) is a prominent non-invasive neuroimaging technique providing insights into brain function. Unfortunately, EEG data exhibit a high degree of noise and variability across subjects hampering generalizable signal…

Machine Learning · Computer Science 2023-11-15 Anders Vestergaard Nørskov , Alexander Neergaard Zahid , Morten Mørup

Multi-modal representation learning has become a pivotal area in artificial intelligence, enabling the integration of diverse modalities such as vision, text, and audio to solve complex problems. However, existing approaches predominantly…

Machine Learning · Computer Science 2025-05-01 Sangyeon Cho , Jangyeong Jeon , Mingi Kim , Junyeong Kim

In rapidly evolving field of vision-language models (VLMs), contrastive language-image pre-training (CLIP) has made significant strides, becoming foundation for various downstream tasks. However, relying on one-to-one (image, text)…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Haicheng Wang , Chen Ju , Weixiong Lin , Shuai Xiao , Mengting Chen , Yixuan Huang , Chang Liu , Mingshuai Yao , Jinsong Lan , Ying Chen , Qingwen Liu , Yanfeng Wang

Contrastive Language-Image Pre-training (CLIP) excels in multimodal tasks such as image-text retrieval and zero-shot classification but struggles with fine-grained understanding due to its focus on coarse-grained short captions. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Chunyu Xie , Bin Wang , Fanjing Kong , Jincheng Li , Dawei Liang , Gengshen Zhang , Dawei Leng , Yuhui Yin

Most existing semantic communication (SemCom) systems use deep joint source-channel coding (DeepJSCC) to encode task-specific semantics in a goal-oriented manner. However, their reliance on predefined tasks and datasets significantly limits…

Signal Processing · Electrical Eng. & Systems 2025-05-30 Jiangjing Hu , Haotian Wu , Wenjing Zhang , Fengyu Wang , Wenjun Xu , Hui Gao , Deniz Gündüz

Vision-language foundation models have emerged as powerful general-purpose representation learners with strong potential for multimodal understanding, but their deterministic embeddings often fail to provide the reliability required for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ahmad Elallaf , Yu Zhang , Yuktha Priya Masupalli , Jeong Yang , Young Lee , Zechun Cao , Gongbo Liang

Electroencephalography (EEG) signals provide critical insights for applications in disease diagnosis and healthcare. However, the scarcity of labeled EEG data poses a significant challenge. Foundation models offer a promising solution by…

Machine Learning · Computer Science 2025-02-25 Limin Wang , Toyotaro Suzumura , Hiroki Kanezashi

We introduce eCLIP, an enhanced version of the CLIP model that integrates expert annotations in the form of radiologist eye-gaze heatmaps. It tackles key challenges in contrastive multi-modal medical imaging analysis, notably data scarcity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yogesh Kumar , Pekka Marttinen

Although fusion of information from multiple views of mammograms plays an important role to increase accuracy of breast cancer detection, developing multi-view mammograms-based computer-aided diagnosis (CAD) schemes still faces challenges…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xuxin Chen , Yuheng Li , Mingzhe Hu , Ella Salari , Xiaoqian Chen , Richard L. J. Qiu , Bin Zheng , Xiaofeng Yang

Recent work has explored video action recognition as a video-text matching problem and several effective methods have been proposed based on large-scale pre-trained vision-language models. However, these approaches primarily operate at a…

Multimedia · Computer Science 2024-07-22 Rui Zhang , Yafen Lu , Pengli Ji , Junxiao Xue , Xiaoran Yan

Contrastive Language-Image Pre-training (CLIP) has demonstrated strong generalization across a wide range of visual tasks by leveraging large-scale English-image pairs. However, its extension to low-resource languages remains limited due to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Dahyun Chung , Donghyun Shin , Yujin Sung , Seunggi Moon , Jinwoo Jeon , Byung-Jun Lee

Contrastive Language-Image Pre-training (CLIP) has significantly boosted the performance of various vision-language tasks by scaling up the dataset with image-text pairs collected from the web. However, the presence of intrinsic noise and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Kaicheng Yang , Jiankang Deng , Xiang An , Jiawei Li , Ziyong Feng , Jia Guo , Jing Yang , Tongliang Liu

While foundation models excel in text, image, and video domains, the critical biological signals, particularly electroencephalography(EEG), remain underexplored. EEG benefits neurological research with its high temporal resolution,…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Wei Xiong , Junming Lin , Jiangtong Li , Jie Li , Changjun Jiang

Recent multimodal models such as Contrastive Language-Image Pre-training (CLIP) have shown remarkable ability to align visual and linguistic representations. However, domains where small visual differences carry large semantic significance,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hiroshi Sasaki

EEG-based brain-computer interfaces (BCIs) have shown promise in various applications, such as motor imagery and cognitive state monitoring. However, decoding visual representations from EEG signals remains a significant challenge due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Tariq Mehmood , Hamza Ahmad , Muhammad Haroon Shakeel , Murtaza Taj

Training specific deep learning models for particular tasks is common across various domains within seismology. However, this approach encounters two limitations: inadequate labeled data for certain tasks and limited generalization across…

Geophysics · Physics 2023-09-06 Xu Si , Xinming Wu , Hanlin Sheng , Jun Zhu , Zefeng Li

Automatic sleep staging is a critical task in healthcare due to the global prevalence of sleep disorders. This study focuses on single-channel electroencephalography (EEG), a practical and widely available signal for automatic sleep…

Machine Learning · Computer Science 2026-01-01 Amirali Vakili , Salar Jahanshiri , Armin Salimi-Badr