English
Related papers

Related papers: Quantum Multimodal Contrastive Learning Framework

200 papers

Visual decoding from brain signals is a key challenge at the intersection of computer vision and neuroscience, requiring methods that bridge neural representations and computational models of vision. We introduce a tri-modal contrastive…

Machine Learning · Computer Science 2026-05-26 Zexuan Chen , Sichao Liu , Runhao Lu , Huichao Qi , Alexandra Woolgar , Xi Vincent Wang , Lihui Wang

The development of quantum computers has been the stimulus that enables the realization of Quantum Machine Learning (QML), an area that integrates the calculational framework of quantum mechanics with the adaptive properties of classical…

Computational Engineering, Finance, and Science · Computer Science 2025-09-04 Bhavna Bose , Saurav Verma

The development of quantum computational techniques has advanced greatly in recent years, parallel to the advancements in techniques for deep reinforcement learning. This work explores the potential for quantum computing to facilitate…

Quantum Physics · Physics 2020-08-31 Owen Lockwood , Mei Si

Classical autoencoders are widely used to learn features of input data. To improve the feature learning, classical masked autoencoders extend classical autoencoders to learn the features of the original input sample in the presence of…

Quantum Physics · Physics 2026-05-01 Emma Andrews , Prabhat Mishra

Continuous electroencephalography (EEG) is routinely used in neurocritical care to monitor seizures and other harmful brain activity, including rhythmic and periodic patterns that are clinically significant. Although deep learning methods…

Human-Computer Interaction · Computer Science 2026-01-05 Argha Kamal Samanta , Deepak Mewada , Monalisa Sarma , Debasis Samanta

Contrastive learning has become pivotal in unsupervised representation learning, with frameworks like Momentum Contrast (MoCo) effectively utilizing large negative sample sets to extract discriminative features. However, traditional…

Machine Learning · Computer Science 2025-01-29 Duy Hoang , Huy Ngo , Khoi Pham , Tri Nguyen , Gia Bao , Huy Phan

Cross-modal alignment Learning integrates information from different modalities like text, image, audio and video to create unified models. This approach develops shared representations and learns correlations between modalities, enabling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Bilal Faye , Hanane Azzag , Mustapha Lebbah

Multimodal large language models (MLLMs) have made significant progress in vision-language understanding, yet effectively aligning different modalities remains a fundamental challenge. We present a framework that unifies multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Wanpeng Zhang , Yicheng Feng , Hao Luo , Yijiang Li , Zihao Yue , Sipeng Zheng , Zongqing Lu

Electroencephalography (EEG)-based multimodal learning integrates brain signals with complementary modalities to improve mental state assessment, providing great clinical potential. The effectiveness of such paradigms largely depends on the…

Machine Learning · Computer Science 2026-05-12 Runhe Zhou , Shanglin Li , Guanxiang Huang , Xinliang Zhou , Qibin Zhao , Motoaki Kawanabe , Yi Ding , Cuntai Guan

Today, there have been many achievements in learning the association between voice and face. However, most previous work models rely on cosine similarity or L2 distance to evaluate the likeness of voices and faces following contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Chong Peng , Liqiang He , Dan Su

We present a new framework for imaging and sensing based on utilizing a quantum computer to coherently process quantum information in an electromagnetic field. We describe the framework, its potential to provide improvements in imaging and…

Quantum Physics · Physics 2026-02-06 Mohan Sarovar

This work investigates the application of quantum machine learning techniques for classical and quantum communication across different qubit channel models. By employing parameterized quantum circuits and a flexible channel noise model, we…

Quantum Physics · Physics 2023-07-14 Lakshika Rathi , Stephen DiAdamo , Alireza Shabani

Quantum machine learning (QML) has attracted growing interest with the rapid parallel advances in large-scale classical machine learning and quantum technologies. Similar to classical machine learning, QML models also face challenges…

Multimodal contrastive learning is a methodology for linking different data modalities; the canonical example is linking image and text data. The methodology is typically framed as the identification of a set of encoders, one for each…

Machine Learning · Statistics 2025-06-02 Ricardo Baptista , Andrew M. Stuart , Son Tran

The utilization of deep learning on electrocardiogram (ECG) analysis has brought the advanced accuracy and efficiency of cardiac healthcare diagnostics. By leveraging the capabilities of deep learning in semantic understanding, especially…

Signal Processing · Electrical Eng. & Systems 2024-10-25 Han Yu , Peikun Guo , Akane Sano

This work focuses on the limitations about the insufficient fitting capability of current quantum machine learning methods, which results from the over-reliance on a single data embedding strategy. We propose a novel quantum machine…

Quantum Physics · Physics 2025-04-01 Siyu Han , Lihan Jia , Lanzhe Guo

Recent advances in non-invasive EEG technology have broadened its application in emotion recognition, yielding a multitude of related datasets. Yet, deep learning models struggle to generalize across these datasets due to variations in…

Signal Processing · Electrical Eng. & Systems 2024-06-13 Yuan Liao , Yuhong Zhang , Shenghuan Wang , Xiruo Zhang , Yiling Zhang , Wei Chen , Yuzhe Gu , Liya Huang

Cross-platform verification, a critical undertaking in the realm of early-stage quantum computing, endeavors to characterize the similarity of two imperfect quantum devices executing identical algorithms, utilizing minimal measurements.…

Quantum Physics · Physics 2023-11-08 Yang Qian , Yuxuan Du , Zhenliang He , Min-hsiu Hsieh , Dacheng Tao

Quantum machine learning consists in taking advantage of quantum computations to generate classical data. A potential application of quantum machine learning is to harness the power of quantum computers for generating classical data, a…

Quantum machine learning is an approach that aims to improve the performance of machine learning methods by leveraging the properties of quantum computers. In quantum circuit learning (QCL), a supervised learning method that can be…