中文
相关论文

相关论文: An Efficient Contrastive Unimodal Pretraining Meth…

200 篇论文

There is an increasing number of medical use-cases where classification algorithms based on deep neural networks reach performance levels that are competitive with human medical experts. To alleviate the challenges of small dataset sizes,…

计算机视觉与模式识别 · 计算机科学 2021-06-28 Vignesh Srinivasan , Nils Strodthoff , Jackie Ma , Alexander Binder , Klaus-Robert Müller , Wojciech Samek

Foundation models in healthcare have largely adopted self supervised pretraining objectives inherited from natural language processing and computer vision, emphasizing reconstruction and large scale representation learning prior to…

机器学习 · 计算机科学 2026-03-24 Yang Zhang , Li Fan , Samuel Lawrence , Shi Li

Electronic Health Record (EHR) datasets from Intensive Care Units (ICU) contain a diverse set of data modalities. While prior works have successfully leveraged multiple modalities in supervised settings, we apply advanced self-supervised…

机器学习 · 计算机科学 2024-03-28 Fabian Baldenweg , Manuel Burger , Gunnar Rätsch , Rita Kuznetsova

Time-series analysis plays a pivotal role across a range of critical applications, from finance to healthcare, which involves various tasks, such as forecasting and classification. To handle the inherent complexities of time-series data,…

机器学习 · 计算机科学 2024-05-20 Jiawei Li , Jingshu Peng , Haoyang Li , Lei Chen

Machine unlearning is a complex process that necessitates the model to diminish the influence of the training data while keeping the loss of accuracy to a minimum. Despite the numerous studies on machine unlearning in recent years, the…

机器学习 · 计算机科学 2024-05-14 Zixin Wang , Kongyang Chen

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

计算机视觉与模式识别 · 计算机科学 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

Training and inference in deep neural networks (DNNs) has, due to a steady increase in architectural complexity and data set size, lead to the development of strategies for reducing time and space requirements of DNN training and inference,…

机器学习 · 计算机科学 2021-08-24 Lorenz Kummer

Contrastive learning has demonstrated promising performance in image and text domains either in a self-supervised or a supervised manner. In this work, we extend the supervised contrastive learning framework to clinical risk prediction…

机器学习 · 计算机科学 2021-10-12 Chengxi Zang , Fei Wang

Traditional supervised learning with deep neural networks requires a tremendous amount of labelled data to converge to a good solution. For 3D medical images, it is often impractical to build a large homogeneous annotated dataset for a…

Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is…

计算机视觉与模式识别 · 计算机科学 2022-09-02 András Kalapos , Bálint Gyires-Tóth

Contrastive pre-training on distant supervision has shown remarkable effectiveness in improving supervised relation extraction tasks. However, the existing methods ignore the intrinsic noise of distant supervision during the pre-training…

计算与语言 · 计算机科学 2023-02-13 Zhen Wan , Fei Cheng , Qianying Liu , Zhuoyuan Mao , Haiyue Song , Sadao Kurohashi

Recently the deep learning has shown its advantage in representation learning and clustering for time series data. Despite the considerable progress, the existing deep time series clustering approaches mostly seek to train the deep neural…

机器学习 · 计算机科学 2023-01-02 Ying Zhong , Dong Huang , Chang-Dong Wang

Medical datasets and especially biobanks, often contain extensive tabular data with rich clinical information in addition to images. In practice, clinicians typically have less data, both in terms of diversity and scale, but still wish to…

计算机视觉与模式识别 · 计算机科学 2023-03-31 Paul Hager , Martin J. Menten , Daniel Rueckert

Predicting the risk of in-hospital mortality from electronic health records (EHRs) has received considerable attention. Such predictions will provide early warning of a patient's health condition to healthcare professionals so that timely…

机器学习 · 计算机科学 2023-08-22 Yuxi Liu , Zhenhao Zhang , Shaowen Qin , Flora D. Salim , Antonio Jimeno Yepes

Learning discriminative representations of unlabelled data is a challenging task. Contrastive self-supervised learning provides a framework to learn meaningful representations using learned notions of similarity measures from simple pretext…

计算机视觉与模式识别 · 计算机科学 2023-01-04 Nicklas Boserup , Raghavendra Selvan

Distantly-Supervised Named Entity Recognition (DS-NER) effectively alleviates the data scarcity problem in NER by automatically generating training samples. Unfortunately, the distant supervision may induce noisy labels, thus undermining…

计算与语言 · 计算机科学 2022-12-14 Xiaoye Qu , Jun Zeng , Daizong Liu , Zhefeng Wang , Baoxing Huai , Pan Zhou

The surge in the significance of time series in digital health domains necessitates advanced methodologies for extracting meaningful patterns and representations. Self-supervised contrastive learning has emerged as a promising approach for…

机器学习 · 计算机科学 2025-09-25 Kevin Garcia , Cassandra Garza , Brooklyn Berry , Yifeng Gao

Methods based on supervised learning using annotations in an end-to-end fashion have been the state-of-the-art for classification problems. However, they may be limited in their generalization capability, especially in the low data regime.…

声音 · 计算机科学 2023-08-14 Ilyass Moummad , Nicolas Farrugia

We introduce a multimodal deep learning framework, Prescriptive Neural Networks (PNNs), that combines ideas from optimization and machine learning, and is, to the best of our knowledge, the first prescriptive method to handle multimodal…

机器学习 · 计算机科学 2025-01-27 Dimitris Bertsimas , Lisa Everest , Vasiliki Stoumpou

Analyzing electroencephalographic (EEG) time series can be challenging, especially with deep neural networks, due to the large variability among human subjects and often small datasets. To address these challenges, various strategies, such…

机器学习 · 计算机科学 2025-09-18 Niklas Grieger , Siamak Mehrkanoon , Stephan Bialonski