中文
相关论文

相关论文: Transformer-based Self-supervised Multimodal Repre…

200 篇论文

Self-supervised learning (SSL) is a scalable way to learn general visual representations since it learns without labels. However, large-scale unlabeled datasets in the wild often have long-tailed label distributions, where we know little…

机器学习 · 计算机科学 2022-05-24 Hong Liu , Jeff Z. HaoChen , Adrien Gaidon , Tengyu Ma

Accurate classification of medical device risk levels is essential for regulatory oversight and clinical safety. We present a Transformer-based multimodal framework that integrates textual descriptions and visual information to predict…

机器学习 · 计算机科学 2025-05-02 Yu Han , Aaron Ceross , Jeroen H. M. Bergmann

Learning transferable data representations from abundant unlabeled data remains a central challenge in machine learning. Although numerous self-supervised learning methods have been proposed to address this challenge, a significant class of…

机器学习 · 统计学 2025-10-21 Chenguang Duan , Yuling Jiao , Huazhen Lin , Wensen Ma , Jerry Zhijian Yang

We focus on developing a novel scalable graph-based semi-supervised learning (SSL) method for a small number of labeled data and a large amount of unlabeled data. Due to the lack of labeled data and the availability of large-scale unlabeled…

机器学习 · 计算机科学 2019-12-06 Zitong Wang , Li Wang , Raymond Chan , Tieyong Zeng

Semi-Supervised Learning (SSL) approaches have been an influential framework for the usage of unlabeled data when there is not a sufficient amount of labeled data available over the course of training. SSL methods based on Convolutional…

计算机视觉与模式识别 · 计算机科学 2021-10-25 Fariborz Taherkhani , Hadi Kazemi , Ali Dabouei , Jeremy Dawson , Nasser M. Nasrabadi

We present a general methodology for using unlabeled data to design semi supervised learning (SSL) variants of the Empirical Risk Minimization (ERM) learning process. Focusing on generalized linear regression, we analyze of the…

机器学习 · 统计学 2022-03-08 Oren Yuval , Saharon Rosset

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

机器学习 · 计算机科学 2019-05-28 Jiaxing Wang , Yin Zheng , Xiaoshuang Chen , Junzhou Huang , Jian Cheng

Detecting medical conditions from speech acoustics is fundamentally a weakly-supervised learning problem: a single, often noisy, session-level label must be linked to nuanced patterns within a long, complex audio recording. This task is…

声音 · 计算机科学 2026-04-21 Xingyuan Li , Mengyue Wu

Structural health monitoring (SHM) has experienced significant advancements in recent decades, accumulating massive monitoring data. Data anomalies inevitably exist in monitoring data, posing significant challenges to their effective…

机器学习 · 计算机科学 2024-12-06 Mingyuan Zhou , Xudong Jian , Ye Xia , Zhilu Lai

Learning visual representations through self-supervision is an extremely challenging task as the network needs to sieve relevant patterns from spurious distractors without the active guidance provided by supervision. This is achieved…

计算机视觉与模式识别 · 计算机科学 2022-06-17 Fatemeh Saleh , Fuwen Tan , Adrian Bulat , Georgios Tzimiropoulos , Brais Martinez

Artificial intelligence (AI) is anticipated to play a pivotal role in 6G. However, a key challenge in developing AI-powered solutions is the extensive data collection and labeling efforts required to train supervised deep learning models.…

信号处理 · 电气工程与系统科学 2025-09-04 Ogechukwu Kanu , Ashkan Eshaghbeigi , Hatem Abou-Zeid

Objective. Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG), where labeling can be…

Self-supervised learning (SSL) offers a powerful way to learn robust, generalizable representations without labeled data. In music, where labeled data is scarce, existing SSL methods typically use generated supervision and multi-view…

声音 · 计算机科学 2024-11-06 Julia Wilkins , Sivan Ding , Magdalena Fuentes , Juan Pablo Bello

In biomedical studies, it is often desirable to characterize the interactive mode of multiple disease outcomes beyond their marginal risk. Ising model is one of the most popular choices serving for this purpose. Nevertheless, learning…

统计方法学 · 统计学 2023-11-28 Daiqing Wu , Molei Liu

We investigate the feasibility of inferring emotional states exclusively from physiological signals, thereby presenting a privacy-preserving alternative to conventional facial recognition techniques. We conduct a performance comparison of…

机器学习 · 计算机科学 2025-07-14 Md. Saif Hassan Onim , Travis S. Humble , Himanshu Thapliyal

Self-Supervised Learning (SSL) has been shown to learn useful and information-preserving representations. Neural Networks (NNs) are widely applied, yet their weight space is still not fully understood. Therefore, we propose to use SSL to…

机器学习 · 计算机科学 2022-12-15 Konstantin Schürholt , Dimche Kostadinov , Damian Borth

Semi-supervised learning (SSL) leverages abundant unlabeled data alongside limited labeled data to enhance learning. As vision foundation models (VFMs) increasingly serve as the backbone of vision applications, it remains unclear how SSL…

机器学习 · 计算机科学 2025-11-06 Ping Zhang , Zheda Mai , Quang-Huy Nguyen , Wei-Lun Chao

Unlabeled data learning has attracted considerable attention recently. However, it is still elusive to extract the expected high-level semantic feature with mere unsupervised learning. In the meantime, semi-supervised learning (SSL)…

计算机视觉与模式识别 · 计算机科学 2020-10-13 Tao Han , Junyu Gao , Yuan Yuan , Qi Wang

Self-supervised learning (SSL) has recently received significant attention due to its ability to train high-performance encoders purely on unlabeled data-often scraped from the internet. This data can still be sensitive and empirical…

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang