English
Related papers

Related papers: Quantum Multimodal Contrastive Learning Framework

200 papers

We propose a new representation learning solution for the classification of cognitive load based on Electroencephalogram (EEG). Our method integrates both time and frequency domains by first passing the raw EEG signals through the…

Human-Computer Interaction · Computer Science 2025-11-18 Prithila Angkan , Amin Jalali , Paul Hungler , Ali Etemad

Electroencephalography (EEG) is a neuroimaging technique that records brain neural activity with high temporal resolution. Unlike other methods, EEG does not require prohibitively expensive equipment and can be easily set up using…

Human-Computer Interaction · Computer Science 2024-10-01 Arash Akbarinia

We propose digital-analog quantum kernels for enhancing the detection of complex features in the classification of images. We consider multipartite-entangled analog blocks, stemming from native Ising interactions in neutral-atom quantum…

Self-supervised deep learning has accelerated 2D natural image analysis but remains difficult to translate into 3D MRI, where data are scarce and pre-trained 2D backbones cannot capture volumetric context. We present a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Liam Chalcroft , Jenny Crinion , Cathy J. Price , John Ashburner

Electroencephalography (EEG) signals, known for convenient non-invasive acquisition but low signal-to-noise ratio, have recently gained substantial attention due to the potential to decode natural images. This paper presents a…

Human-Computer Interaction · Computer Science 2024-04-05 Yonghao Song , Bingchuan Liu , Xiang Li , Nanlin Shi , Yijun Wang , Xiaorong Gao

Classification using variational quantum circuits is a promising frontier in quantum machine learning. Quantum supervised learning (QSL) applied to classical data using variational quantum circuits involves embedding the data into a quantum…

Quantum Physics · Physics 2026-03-16 Yujin Kim , Changjae Im , Taehyun Kim , Tak Hur , Daniel K. Park

Due to the abundant neurophysiological information in the electroencephalogram (EEG) signal, EEG signals integrated with deep learning methods have gained substantial traction across numerous real-world tasks. However, the development of…

Signal Processing · Electrical Eng. & Systems 2023-10-09 Weining Weng , Yang Gu , Qihui Zhang , Yingying Huang , Chunyan Miao , Yiqiang Chen

Quantum machine learning deals with leveraging quantum theory with classic machine learning algorithms. Current research efforts study the advantages of using quantum mechanics or quantum information theory to accelerate learning time or…

Quantum Physics · Physics 2025-09-03 Javier Orduz , Pablo Rivas , Erich Baker

Dual-Encoders is a promising mechanism for answer retrieval in question answering (QA) systems. Currently most conventional Dual-Encoders learn the semantic representations of questions and answers merely through matching score. Researchers…

Computation and Language · Computer Science 2022-06-08 Yanmeng Wang , Jun Bai , Ye Wang , Jianfei Zhang , Wenge Rong , Zongcheng Ji , Shaojun Wang , Jing Xiao

Medical datasets and especially biobanks, often contain extensive tabular data with rich clinical information in addition to images. In practice, clinicians typically have less data, both in terms of diversity and scale, but still wish to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Paul Hager , Martin J. Menten , Daniel Rueckert

Quantum machine learning is an emerging field that combines machine learning with advances in quantum technologies. Many works have suggested great possibilities of using near-term quantum hardware in supervised learning. Motivated by these…

Quantum Physics · Physics 2021-07-21 Nhat A. Nghiem , Samuel Yen-Chi Chen , Tzu-Chieh Wei

MoCo is effective for unsupervised image representation learning. In this paper, we propose VideoMoCo for unsupervised video representation learning. Given a video sequence as an input sample, we improve the temporal feature representations…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Tian Pan , Yibing Song , Tianyu Yang , Wenhao Jiang , Wei Liu

Limited availability of labeled physiological data often prohibits the use of powerful supervised deep learning models in the biomedical machine intelligence domain. We approach this problem and propose a novel encoding framework that…

Machine Learning · Computer Science 2023-06-13 Philipp Hallgarten , David Bethge , Ozan Özdenizci , Tobias Grosse-Puppendahl , Enkelejda Kasneci

Electroencephalography (EEG) is a prominent non-invasive neuroimaging technique providing insights into brain function. Unfortunately, EEG data exhibit a high degree of noise and variability across subjects hampering generalizable signal…

Machine Learning · Computer Science 2023-11-15 Anders Vestergaard Nørskov , Alexander Neergaard Zahid , Morten Mørup

In this paper, we introduce a novel Multi-Modal Contrastive Pre-training Framework that synergistically combines X-rays, electrocardiograms (ECGs), and radiology/cardiology reports. Our approach leverages transformers to encode these…

Artificial Intelligence · Computer Science 2024-10-24 Samrajya Thapa , Koushik Howlader , Subhankar Bhattacharjee , Wei le

Electrocardiogram (ECG) analysis is foundational for cardiovascular disease diagnosis, yet the performance of deep learning models is often constrained by limited access to annotated data. Self-supervised contrastive learning has emerged as…

Machine Learning · Computer Science 2025-08-22 Yi Yuan , Joseph Van Duyn , Runze Yan , Zhuoyi Huang , Sulaiman Vesal , Sergey Plis , Xiao Hu , Gloria Hyunjung Kwak , Ran Xiao , Alex Fedorov

The frequent interactions between quantum computing and machine learning revolutionize both fields. One prototypical achievement is the quantum auto-encoder (QAE), as the leading strategy to relieve the curse of dimensionality ubiquitous in…

Quantum Physics · Physics 2024-10-03 Yuxuan Du , Dacheng Tao

Image-text multimodal representation learning aligns data across modalities and enables important medical applications, e.g., image classification, visual grounding, and cross-modal retrieval. In this work, we establish a connection between…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Peiqi Wang , William M. Wells , Seth Berkowitz , Steven Horng , Polina Golland

The integration of human emotions into multimedia applications shows great potential for enriching user experiences and enhancing engagement across various digital platforms. Unlike traditional methods such as questionnaires, facial…

Human-Computer Interaction · Computer Science 2024-04-16 Qile Liu , Zhihao Zhou , Jiyuan Wang , Zhen Liang

Multimodal representation learning is a challenging task in which previous work mostly focus on either uni-modality pre-training or cross-modality fusion. In fact, we regard modeling multimodal representation as building a skyscraper, where…

Computation and Language · Computer Science 2024-08-15 Ronghao Lin , Haifeng Hu