中文
相关论文

相关论文: Transformer-based Self-supervised Multimodal Repre…

200 篇论文

Wearable sensors enable the continuous acquisition of high-resolution physiological waveforms, such as photoplethysmography and accelerometry, under free-living conditions. However, inferring health-related phenotypes from these signals…

MatSSL is a streamlined self-supervised learning (SSL) architecture that employs Gated Feature Fusion at each stage of the backbone to integrate multi-level representations effectively. Current micrograph analysis of metallic materials…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Hoang Hai Nam Nguyen , Phan Nguyen Duc Hieu , Ho Won Lee

Effective suppression of surface-related multiples is essential to prevent imaging artifacts and erroneous structural interpretations. While conventional approaches rely on accurate priors or subsurface model knowledge, and supervised…

地球物理 · 物理学 2026-05-01 Huan Song , Shijun Cheng , Huanhuan Tang , Wei Ouyang , Weijian Mao

Self-supervised learning (SSL) for clinical time series data has received significant attention in recent literature, since these data are highly rich and provide important information about a patient's physiological state. However, most…

机器学习 · 计算机科学 2023-07-21 Aniruddh Raghu , Payal Chandak , Ridwan Alam , John Guttag , Collin M. Stultz

The objective of this paper is to learn semantic representations for sleep stage classification from raw physiological time series. Although supervised methods have gained remarkable performance, they are limited in clinical situations due…

信号处理 · 电气工程与系统科学 2021-10-20 Hongjun Zhang , Jing Wang , Qinfeng Xiao , Jiaoxue Deng , Youfang Lin

Emotional states manifest as coordinated yet heterogeneous physiological responses across central and autonomic systems, posing a fundamental challenge for multimodal representation learning in affective computing. Learning such joint…

机器学习 · 计算机科学 2026-05-26 Deyang Zheng , Tianyi Zhang , Wenming Zheng , Shujian Yu

Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural…

信号处理 · 电气工程与系统科学 2023-11-15 Weidong Wang , Hongshu Liao , Lu Gan

Semi-supervised learning (SSL) is an efficient framework that can train models with both labeled and unlabeled data, but may generate ambiguous and non-distinguishable representations when lacking adequate labeled samples. With…

计算机视觉与模式识别 · 计算机科学 2022-08-08 Xinkai Yuan , Zilinghan Li , Gaoang Wang

Self-supervised learning (SSL) has empirically shown its data representation learnability in many downstream tasks. There are only a few theoretical works on data representation learnability, and many of those focus on final data…

机器学习 · 计算机科学 2024-01-09 Ruofeng Yang , Xiangyuan Li , Bo Jiang , Shuai Li

Due to the complex nature of human emotions and the diversity of emotion representation methods in humans, emotion recognition is a challenging field. In this research, three input modalities, namely text, audio (speech), and video, are…

人工智能 · 计算机科学 2024-02-13 Minoo Shayaninasab , Bagher Babaali

Semi-supervised learning (SSL) has been a powerful strategy to incorporate few labels in learning better representations. In this paper, we focus on a practical scenario that one aims to apply SSL when unlabeled data may contain…

计算机视觉与模式识别 · 计算机科学 2022-08-22 Jongjin Park , Sukmin Yun , Jongheon Jeong , Jinwoo Shin

The lack of labeled data is a major obstacle in many music information retrieval tasks such as melody extraction, where labeling is extremely laborious or costly. Semi-supervised learning (SSL) provides a solution to alleviate the issue by…

音频与语音处理 · 电气工程与系统科学 2020-08-17 Sangeun Kum , Jing-Hua Lin , Li Su , Juhan Nam

Self-supervised learning (SSL) has been investigated to generate task-agnostic representations across various domains. However, such investigation has not been conducted for detecting multiple mental disorders. The rationale behind the…

机器学习 · 计算机科学 2024-03-25 Rohan Kumar Gupta , Rohit Sinha

In large part due to their implicit semantic modeling, self-supervised learning (SSL) methods have significantly increased the performance of valence recognition in speech emotion recognition (SER) systems. Yet, their large size may often…

音频与语音处理 · 电气工程与系统科学 2023-09-20 Danilo de Oliveira , Navin Raj Prabhu , Timo Gerkmann

In this work, we explore Self-supervised Learning (SSL) as an auxiliary task to blend the texture-based local descriptors into feature modelling for efficient face analysis. Combining a primary task and a self-supervised auxiliary task is…

计算机视觉与模式识别 · 计算机科学 2024-11-06 Shukesh Reddy , Nishit Poddar , Srijan Das , Abhijit Das

Speech Emotion Recognition (SER) in real-world scenarios remains challenging due to severe class imbalance and the prevalence of spontaneous, natural speech. While recent approaches leverage self-supervised learning (SSL) representations…

音频与语音处理 · 电气工程与系统科学 2026-03-26 Lucas H. Ueda , João G. T. Lima , Paula D. P. Costa

Improving generalization is a major challenge in audio classification due to labeled data scarcity. Self-supervised learning (SSL) methods tackle this by leveraging unlabeled data to learn useful features for downstream classification…

音频与语音处理 · 电气工程与系统科学 2021-12-22 Melikasadat Emami , Dung Tran , Kazuhito Koishida

Wearable EEG devices have emerged as a promising alternative to polysomnography (PSG). As affordable and scalable solutions, their widespread adoption results in the collection of massive volumes of unlabeled data that cannot be analyzed by…

人机交互 · 计算机科学 2026-03-12 Emilio Estevan , María Sierra-Torralba , Eduardo López-Larraz , Luis Montesano

Automatic singing voice understanding tasks, such as singer identification, singing voice transcription, and singing technique classification, benefit from data-driven approaches that utilize deep learning techniques. These approaches work…

声音 · 计算机科学 2023-09-06 Yuya Yamamoto

Sleep staging is a clinically important task for diagnosing various sleep disorders, but remains challenging to deploy at scale because it because it is both labor-intensive and time-consuming. Supervised deep learning-based approaches can…

信号处理 · 电气工程与系统科学 2024-04-25 Sayeri Lala , Hanlin Goh , Christopher Sandino