English
Related papers

Related papers: Contrastive and Multi-Task Learning on Noisy Brain…

200 papers

This paper proposes a single-stage training approach that semantically aligns three modalities - audio, visual, and text using a contrastive learning framework. Contrastive training has gained prominence for multimodal alignment, utilizing…

Sound · Computer Science 2025-05-21 Parthasaarathy Sudarsanam , Irene Martín-Morató , Tuomas Virtanen

How to decode human vision through neural signals has attracted a long-standing interest in neuroscience and machine learning. Modern contrastive learning and generative models improved the performance of visual decoding and reconstruction…

Human-Computer Interaction · Computer Science 2024-10-07 Dongyang Li , Chen Wei , Shiying Li , Jiachen Zou , Haoyang Qin , Quanying Liu

Robust and interpretable dementia diagnosis from noisy, non-stationary electroencephalography (EEG) is clinically essential yet remains challenging. To this end, we propose SeeGraph, a Sparse-Explanatory dynamic EEG-graph network that…

Signal Processing · Electrical Eng. & Systems 2026-03-19 Fengcheng Wu , Zhenxi Song , Guoyang Xu , Kaisong Hu , Zirui Wang , Yi Guo , Zhiguo Zhang

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Salma Haidar , José Oramas

Speech data collected in real-world scenarios often encounters two issues. First, multiple sources may exist simultaneously, and the number of sources may vary with time. Second, the existence of background noise in recording is inevitable.…

Sound · Computer Science 2020-05-21 Yuan-Kuei Wu , Chao-I Tuan , Hung-yi Lee , Yu Tsao

Background: Deep learning models have shown great success in automating tasks in sleep medicine by learning from carefully annotated Electroencephalogram (EEG) data. However, effectively utilizing a large amount of raw EEG remains a…

Signal Processing · Electrical Eng. & Systems 2023-02-14 Chaoqi Yang , Danica Xiao , M. Brandon Westover , Jimeng Sun

Electrocardiogram (ECG) signals are often degraded by various noise sources such as baseline wander, motion artifacts, and electromyographic interference, posing a major challenge in clinical settings. This paper presents a lightweight deep…

Signal Processing · Electrical Eng. & Systems 2025-11-18 Mahdi Pirayesh Shirazi Nejad , David Hicks , Matt Valentine , Ki H. Chon

Classification of sleep stages is essential for assessing sleep quality and diagnosing sleep disorders. However, manual inspection of EEG characteristics for each stage is time-consuming and prone to human error. Although machine learning…

A central problem in building effective sound event detection systems is the lack of high-quality, strongly annotated sound event datasets. For this reason, Task 4 of the DCASE 2024 challenge proposes learning from two heterogeneous…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-19 Florian Schmid , Paul Primus , Tobias Morocutti , Jonathan Greif , Gerhard Widmer

The integration of human emotions into multimedia applications shows great potential for enriching user experiences and enhancing engagement across various digital platforms. Unlike traditional methods such as questionnaires, facial…

Human-Computer Interaction · Computer Science 2024-04-16 Qile Liu , Zhihao Zhou , Jiyuan Wang , Zhen Liang

In real-world applications of noninvasive electroencephalography (EEG), specialized decoders often show limited generalizability across diverse tasks under subject-independent settings. One central challenge is that task-relevant EEG…

Artificial Intelligence · Computer Science 2026-04-21 Zhiyuan Ma , Zeyuan Li , Zihao Qiu , Jinhao Li , Lingqin Meng , Xinche Zhang , Yixuan Liu , Xinke Shen , Sen Song

Image noise and motion artifacts greatly affect the quality of brain MRI and negatively influence downstream medical image analysis. Previous studies often focus on 2D methods that process each volumetric MR image slice-by-slice, thus…

Image and Video Processing · Electrical Eng. & Systems 2024-03-14 Lintao Zhang , Mengqi Wu , Lihong Wang , David C. Steffens , Guy G. Potter , Mingxia Liu

Obtaining annotations for 3D medical images is expensive and time-consuming, despite its importance for automating segmentation tasks. Although multi-task learning is considered an effective method for training segmentation models using…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Junichiro Iwasawa , Yuichiro Hirano , Yohei Sugawara

Hyperspectral image (HSI) denoising is a crucial step in enhancing the quality of HSIs. Noise modeling methods can fit noise distributions to generate synthetic HSIs to train denoising networks. However, the noise in captured HSIs is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Yingkai Zhang , Tao Zhang , Jing Nie , Ying Fu

Recent studies demonstrate the use of a two-stage supervised framework to generate images that depict human perception to visual stimuli from EEG, referring to EEG-visual reconstruction. They are, however, unable to reproduce the exact…

Multimedia · Computer Science 2022-08-19 Zesheng Ye , Lina Yao , Yu Zhang , Sylvia Gustin

In the status quo, dementia is yet to be cured. Precise diagnosis prior to the onset of the symptoms can prevent the rapid progression of the emerging cognitive impairment. Recent progress has shown that Electroencephalography (EEG) is the…

This work investigates the predictive potential of bipolar electroencephalogram (EEG) recordings towards efficient prediction of poor neurological outcomes. A retrospective design using a hybrid deep learning approach is utilized to…

Signal Processing · Electrical Eng. & Systems 2023-10-09 Hemin Ali Qadir , Naimahmed Nesaragi , Per Steiner Halvorsen , Ilangko Balasingham

Electroencephalogram (EEG) signals have attracted significant attention from researchers due to their non-invasive nature and high temporal sensitivity in decoding visual stimuli. However, most recent studies have focused solely on the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Kaifan Zhang , Lihuo He , Xin Jiang , Wen Lu , Di Wang , Xinbo Gao

While end-to-end multi-channel electroencephalography (EEG) learning approaches have shown significant promise, their applicability is often constrained in neurological diagnostics, such as intracranial EEG resources. When provided with a…

Machine Learning · Computer Science 2024-10-16 Rikuto Kotoge , Zheng Chen , Tasuku Kimura , Yasuko Matsubara , Takufumi Yanagisawa , Haruhiko Kishima , Yasushi Sakurai

Recent advancements for large-scale pre-training with neural signals such as electroencephalogram (EEG) have shown promising results, significantly boosting the development of brain-computer interfaces (BCIs) and healthcare. However, these…

Signal Processing · Electrical Eng. & Systems 2025-03-21 Wei-Bang Jiang , Yansen Wang , Bao-Liang Lu , Dongsheng Li