English
Related papers

Related papers: CAMEL-CLIP: Channel-aware Multimodal Electroenceph…

200 papers

Contrastive Language-Image Pretraining (CLIP) has demonstrated strong generalization for vision-language tasks in computer vision and medical domains, yet its text encoder accepts only up to 77 tokens, which limits its ability to represent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Xiaoyang Wei , Camille Kurtz , Florence Cloppet

Despite that deep learning (DL) methods have presented tremendous potential in many medical image analysis tasks, the practical applications of medical DL models are limited due to the lack of enough data samples with manual annotations. By…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Zhiyang Liu , Dong Yang , Minghao Zhang , Hanyu Sun , Hong Wu , Huiying Wang , Wen Shen , Chao Chai , Shuang Xia

Low back pain affects millions worldwide, driving the need for robust diagnostic models that can jointly analyze complex medical images and accompanying text reports. We present LumbarCLIP, a novel multimodal framework that leverages…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Thanh Binh Le , Hoang Nhat Khang Vo , Tan-Ha Mai , Trong Nhan Phan

We propose CHARM, a method for training a single neural network across inconsistent input channels. Our work is motivated by Electroencephalography (EEG), where data collection protocols from different headsets result in varying channel…

Signal Processing · Electrical Eng. & Systems 2020-10-27 Aaqib Saeed , David Grangier , Olivier Pietquin , Neil Zeghidour

Electroencephalography (EEG) - based air-writing recognition offers a human-computer interaction paradigm by decoding neural activity associated with handwriting movements. Despite its potential, reliable EEG-based air-writing recognition…

Signal Processing · Electrical Eng. & Systems 2026-03-23 Anant Jain , Ayush Tripathi

Contrastive Language-Image Pre-training (CLIP) demonstrates strong potential in medical image analysis but requires substantial data and computational resources. Due to these restrictions, existing CLIP applications in medical imaging focus…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yuexi Du , John Onofrey , Nicha C. Dvornek

Electroencephalogram (EEG) decoding models for brain-computer interfaces (BCIs) struggle with cross-dataset learning and generalization due to channel layout inconsistencies, non-stationary signal distributions, and limited…

Human-Computer Interaction · Computer Science 2025-07-17 Xiaoqing Chen , Siyang Li , Dongrui Wu

Recent progress has shown that large-scale pre-training using contrastive image-text pairs can be a promising alternative for high-quality visual representation learning from natural language supervision. Benefiting from a broader source of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Yongming Rao , Wenliang Zhao , Guangyi Chen , Yansong Tang , Zheng Zhu , Guan Huang , Jie Zhou , Jiwen Lu

The ambiguity of human emotions poses several challenges for machine learning models, as they often overlap and lack clear delineating boundaries. Contrastive language-audio pretraining (CLAP) has emerged as a key technique for…

Foundation models for EEG analysis are still in their infancy, limited by two key challenges: (1) variability across datasets caused by differences in recording devices and configurations, and (2) the low signal-to-noise ratio (SNR) of EEG,…

Machine Learning · Computer Science 2025-11-13 Navid Mohammadi Foumani , Soheila Ghane , Nam Nguyen , Mahsa Salehi , Geoffrey I. Webb , Geoffrey Mackellar

Deep learning methods have demonstrated promising results in predicting BI-RADS scores from mammography images. However, the interpretation of these images can vary, leading to discrepancies even among radiologists. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Halil Ibrahim Gulluk , Olivier Gevaert

Automated interpretation of electrocardiograms (ECG) has garnered significant attention with the advancements in machine learning methodologies. Despite the growing interest, most current studies focus solely on classification or regression…

Signal Processing · Electrical Eng. & Systems 2023-11-07 Jielin Qiu , Jiacheng Zhu , Shiqi Liu , William Han , Jingqi Zhang , Chaojing Duan , Michael Rosenberg , Emerson Liu , Douglas Weber , Ding Zhao

Contrastive Language-Image Pretraining (CLIP) achieves strong generalization in vision-language tasks by aligning images and texts in a shared embedding space. However, recent findings show that CLIP-like models still underutilize…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Weiheng Zhao , Zilong Huang , Jiashi Feng , Xinggang Wang

Robust behaviour recognition in real-world farm environments remains challenging due to several data-related limitations, including the scarcity of well-annotated livestock video datasets and the substantial domain gap between large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Huimin Liu , Jing Gao , Daria Baran , AxelX Montout , Neill W Campbell , Andrew W Dowsey

While large scale pre-training has achieved great achievements in bridging the gap between vision and language, it still faces several challenges. First, the cost for pre-training is expensive. Second, there is no efficient way to handle…

Computation and Language · Computer Science 2021-09-23 Jue Wang , Haofan Wang , Jincan Deng , Weijia Wu , Debing Zhang

Conventional task-specific electrocardiogram (ECG) analysis models require large annotated datasets to train. Foundation models mitigate this burden by leveraging self-supervised pretraining; however, the scarcity of open-weight ECG…

Machine Learning · Computer Science 2025-06-02 Kaden McKeen , Sameer Masood , Augustin Toma , Barry Rubin , Bo Wang

EEG foundation models aim to learn reusable representations across heterogeneous paradigms, yet existing approaches often use uniform adaptation mechanisms and are typically reported under separate downstream fine-tuning protocols. In this…

Signal Processing · Electrical Eng. & Systems 2026-05-19 Wei Xiong , Jiangtong Li , Kun Zhu , Jie Li

Recent advancements for large-scale pre-training with neural signals such as electroencephalogram (EEG) have shown promising results, significantly boosting the development of brain-computer interfaces (BCIs) and healthcare. However, these…

Signal Processing · Electrical Eng. & Systems 2025-03-21 Wei-Bang Jiang , Yansen Wang , Bao-Liang Lu , Dongsheng Li

Electrocardiogram (ECG) analysis is foundational for cardiovascular disease diagnosis, yet the performance of deep learning models is often constrained by limited access to annotated data. Self-supervised contrastive learning has emerged as…

Machine Learning · Computer Science 2025-08-22 Yi Yuan , Joseph Van Duyn , Runze Yan , Zhuoyi Huang , Sulaiman Vesal , Sergey Plis , Xiao Hu , Gloria Hyunjung Kwak , Ran Xiao , Alex Fedorov

Echocardiography is a vital non-invasive modality for cardiac assessment, with left ventricular ejection fraction (LVEF) serving as a key indicator of heart function. Existing LVEF estimation methods depend on large-scale annotated video…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yao Du , Jiarong Guo , Xiaomeng Li