English
Related papers

Related papers: Optimizing contrastive learning for cortical foldi…

200 papers

The healthcare industry generates troves of unlabelled physiological data. This data can be exploited via contrastive learning, a self-supervised pre-training method that encourages representations of instances to be similar to one another.…

Machine Learning · Computer Science 2021-05-18 Dani Kiyasseh , Tingting Zhu , David A. Clifton

In this paper, we propose a novel contrastive learning based deep learning framework for patient similarity search using physiological signals. We use a contrastive learning based approach to learn similar embeddings of patients with…

Signal Processing · Electrical Eng. & Systems 2023-08-07 Subangkar Karmaker Shanto , Shoumik Saha , Atif Hasan Rahman , Mohammad Mehedy Masud , Mohammed Eunus Ali

We introduce a method that takes advantage of high-quality pretrained multimodal representations to explore fine-grained semantic networks in the human brain. Previous studies have documented evidence of functional localization in the…

Artificial Intelligence · Computer Science 2023-06-07 Cory Efird , Alex Murphy , Joel Zylberberg , Alona Fyshe

Recently, hyperbolic space has risen as a promising alternative for semi-supervised graph representation learning. Many efforts have been made to design hyperbolic versions of neural network operations. However, the inspiring geometric…

Machine Learning · Computer Science 2022-01-24 Jiahong Liu , Menglin Yang , Min Zhou , Shanshan Feng , Philippe Fournier-Viger

Person re-identification (re-ID) via 3D skeletons is an important emerging topic with many merits. Existing solutions rarely explore valuable body-component relations in skeletal structure or motion, and they typically lack the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Haocong Rao , Chunyan Miao

Neural networks exhibit severe brittleness to semantically irrelevant transformations. A mere 75ms electrocardiogram (ECG) phase shift degrades latent cosine similarity from 1.0 to 0.2, while sensor rotations collapse activity recognition…

Machine Learning · Computer Science 2025-11-20 Zhengyang Shen , Hua Tu , Mayue Shi

We present a new self-supervised paradigm on point cloud sequence understanding. Inspired by the discriminative and generative self-supervised methods, we design two tasks, namely point cloud sequence based Contrastive Prediction and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

Machine Learning · Computer Science 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

Image and Video Processing · Electrical Eng. & Systems 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

A cognitive model of human learning provides information about skills a learner must acquire to perform accurately in a task domain. Cognitive models of learning are not only of scientific interest, but are also valuable in adaptive online…

Machine Learning · Computer Science 2018-06-22 Devendra Singh Chaplot , Christopher MacLellan , Ruslan Salakhutdinov , Kenneth Koedinger

Convolutional networks have marked their place over the last few years as the best performing model for various visual tasks. They are, however, most suited for supervised learning from large amounts of labeled data. Previous attempts have…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Itay Hubara , Nir Ailon

Automated classification of human anatomy is an important prerequisite for many computer-aided diagnosis systems. The spatial complexity and variability of anatomy throughout the human body makes classification difficult. "Deep learning"…

Computer Vision and Pattern Recognition · Computer Science 2015-09-17 Holger R. Roth , Christopher T. Lee , Hoo-Chang Shin , Ari Seff , Lauren Kim , Jianhua Yao , Le Lu , Ronald M. Summers

Most deep neural networks (DNNs) based ultrasound (US) medical image analysis models use pretrained backbones (e.g., ImageNet) for better model generalization. However, the domain gap between natural and medical images causes an inevitable…

Computer Vision and Pattern Recognition · Computer Science 2021-09-03 Yixiong Chen , Chunhui Zhang , Li Liu , Cheng Feng , Changfeng Dong , Yongfang Luo , Xiang Wan

Medical image classification is one of the most important tasks for computer-aided diagnosis. Deep learning models, particularly convolutional neural networks, have been successfully used for disease classification from medical images,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Md. Atik Ahamed , Jin Chen , Abdullah-Al-Zubaer Imran

Cytoarchitectonic maps provide microstructural reference parcellations of the brain, describing its organization in terms of the spatial arrangement of neuronal cell bodies as measured from histological tissue sections. Recent work provided…

Image and Video Processing · Electrical Eng. & Systems 2021-06-02 Christian Schiffer , Katrin Amunts , Stefan Harmeling , Timo Dickscheid

Heterogeneous graphs (HGs) are composed of multiple types of nodes and edges, making it more effective in capturing the complex relational structures inherent in the real world. However, in real-world scenarios, labeled data is often…

Machine Learning · Computer Science 2025-08-20 Ruobing Jiang , Yacong Li , Haobing Liu , Yanwei Yu

In this work, we present Multi-Level Contrastive Learning for Dense Prediction Task (MCL), an efficient self-supervised method for learning region-level feature representation for dense prediction tasks. Our method is motivated by the three…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Qiushan Guo , Yizhou Yu , Yi Jiang , Jiannan Wu , Zehuan Yuan , Ping Luo

Unsupervised visual representation learning has gained much attention from the computer vision community because of the recent achievement of contrastive learning. Most of the existing contrastive learning frameworks adopt the instance…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Mingkai Zheng , Fei Wang , Shan You , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu