English
Related papers

Related papers: Contrastive Representation Learning for Whole Brai…

200 papers

Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yaoming Cai , Zijia Zhang , Yan Liu , Pedram Ghamisi , Kun Li , Xiaobo Liu , Zhihua Cai

The goal of contrastive learning based pre-training is to leverage large quantities of unlabeled data to produce a model that can be readily adapted downstream. Current approaches revolve around solving an image discrimination task: given…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Chenhongyi Yang , Lichao Huang , Elliot J. Crowley

Recent multimodal models such as Contrastive Language-Image Pre-training (CLIP) have shown remarkable ability to align visual and linguistic representations. However, domains where small visual differences carry large semantic significance,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hiroshi Sasaki

Deep neural networks have reached remarkable achievements in medical image processing tasks, specifically in classifying and detecting various diseases. However, when confronted with limited data, these networks face a critical…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Matina Mahdizadeh Sani , Ali Royat , Mahdieh Soleymani Baghshah

Medical image interpretation using deep learning has shown promise but often requires extensive expert-annotated datasets. To reduce this annotation burden, we develop an Image-Graph Contrastive Learning framework that pairs chest X-rays…

Image and Video Processing · Electrical Eng. & Systems 2024-05-17 Sameer Khanna , Daniel Michael , Marinka Zitnik , Pranav Rajpurkar

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Huasong Zhong , Jianlong Wu , Chong Chen , Jianqiang Huang , Minghua Deng , Liqiang Nie , Zhouchen Lin , Xian-Sheng Hua

Humans rely on effective representations to learn from few examples and abstract useful information from sensory data. Inducing such representations in machine learning models has been shown to improve their performance on various…

Machine Learning · Computer Science 2025-02-03 Raja Marjieh , Sreejan Kumar , Declan Campbell , Liyi Zhang , Gianluca Bencomo , Jake Snell , Thomas L. Griffiths

Network representation learning seeks to embed networks into a low-dimensional space while preserving the structural and semantic properties, thereby facilitating downstream tasks such as classification, trait prediction, edge…

Machine Learning · Statistics 2025-09-16 Zihan Dong , Xin Zhou , Ryumei Nakada , Lexin Li , Linjun Zhang

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

It is arguable that whether the single camera captured (monocular) image datasets are sufficient enough to train and test convolutional neural networks (CNNs) for imitating the biological neural network structures of the human brain. As…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Yigit Oktar , Diclehan Karakaya , Oguzhan Ulucan , Mehmet Turkan

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zhenyuan Lu

Feature extraction is crucial for human activity recognition (HAR) using body-worn movement sensors. Recently, learned representations have been used successfully, offering promising alternatives to manually engineered features. Our work…

Machine Learning · Computer Science 2020-12-11 Harish Haresamudram , Irfan Essa , Thomas Ploetz

Conditional Neural Processes~(CNPs) bridge neural networks with probabilistic inference to approximate functions of Stochastic Processes under meta-learning settings. Given a batch of non-{\it i.i.d} function instantiations, CNPs are…

Machine Learning · Computer Science 2022-03-28 Zesheng Ye , Lina Yao

Growing neuropsychological and neurophysiological evidence suggests that the visual cortex uses parts-based representations to encode, store and retrieve relevant objects. In such a scheme, objects are represented as a set of spatially…

Neurons and Cognition · Quantitative Biology 2015-03-13 Jenia Jitsev , Christoph von der Malsburg

Human brain anatomy and function display a combination of modular and hierarchical organization, suggesting the importance of both cohesive structures and variable resolutions in the facilitation of healthy cognitive processes. However,…

Neurons and Cognition · Quantitative Biology 2015-06-18 Christian Lohse , Danielle S. Bassett , Kelvin O. Lim , Jean M. Carlson

Recent research has suggested that the brain is more shallow than previously thought, challenging the traditionally assumed hierarchical structure of the ventral visual pathway. Here, we demonstrate that optimizing convolutional network…

Neural and Evolutionary Computing · Computer Science 2025-05-02 Lukas Kuhn , Sari Saba-Sadiya , Gemma Roig

Recent research in self-supervised contrastive learning of music representations has demonstrated remarkable results across diverse downstream tasks. However, a prevailing trend in existing methods involves representing equally-sized music…

Deep learning shows high potential for many medical image analysis tasks. Neural networks can work with full-size data without extensive preprocessing and feature generation and, thus, information loss. Recent work has shown that the…

We study self-supervised learning on graphs using contrastive methods. A general scheme of prior methods is to optimize two-view representations of input graphs. In many studies, a single graph-level representation is computed as one of the…

Machine Learning · Computer Science 2021-07-22 Xinyi Xu , Cheng Deng , Yaochen Xie , Shuiwang Ji