English
Related papers

Related papers: Self-Supervised Learning of Representations for Sp…

200 papers

Interpretability is a key issue when applying deep learning models to longitudinal brain MRIs. One way to address this issue is by visualizing the high-dimensional latent spaces generated by deep learning via self-organizing maps (SOM). SOM…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Jiahong Ouyang , Qingyu Zhao , Ehsan Adeli , Wei Peng , Greg Zaharchuk , Kilian M. Pohl

Semi-supervised clustering is an very important topic in machine learning and computer vision. The key challenge of this problem is how to learn a metric, such that the instances sharing the same label are more likely close to each other on…

Machine Learning · Computer Science 2015-01-27 Gang Chen

It has been widely recognized that the success of deep learning in image segmentation relies overwhelmingly on a myriad amount of densely annotated training data, which, however, are difficult to obtain due to the tremendous labor and…

Computer Vision and Pattern Recognition · Computer Science 2020-11-26 Yutong Xie , Jianpeng Zhang , Zehui Liao , Yong Xia , Chunhua Shen

Spatial reasoning on multi-view line drawings by state-of-the-art supervised deep networks is recently shown with puzzling low performances on the SPARE3D dataset. Based on the fact that self-supervised learning is helpful when a large…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Siyuan Xiang , Anbang Yang , Yanfei Xue , Yaoqing Yang , Chen Feng

Self-supervised learning (SSL) has great potential for molecular representation learning given the complexity of molecular graphs, the large amounts of unlabelled data available, the considerable cost of obtaining labels experimentally, and…

Machine Learning · Computer Science 2023-11-30 Yuankai Luo , Lei Shi , Veronika Thost

Self-supervised learning (SSL) is an emerging technique that has been successfully employed to train convolutional neural networks (CNNs) and graph neural networks (GNNs) for more transferable, generalizable, and robust representation…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Prarthana Bhattacharyya , Chengjie Huang , Krzysztof Czarnecki

Cell identification within the H&E slides is an essential prerequisite that can pave the way towards further pathology analyses including tissue classification, cancer grading, and phenotype prediction. However, performing such a task using…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Ramin Nakhli , Amirali Darbandsari , Hossein Farahani , Ali Bashashati

Self-supervised learning (SSL) is an approach to extract useful feature representations from unlabeled data, and enable fine-tuning on downstream tasks with limited labeled examples. Self-pretraining is a SSL approach that uses the curated…

Image and Video Processing · Electrical Eng. & Systems 2024-05-15 Jue Jiang , Aneesh Rangnekar , Harini Veeraraghavan

Understanding spatial location and relationships is a fundamental capability for modern artificial intelligence systems. Insights from human spatial cognition provide valuable guidance in this domain. Neuroscientific discoveries have…

Neural and Evolutionary Computing · Computer Science 2024-09-17 Boyang Li , Yulin Wu , Nuoxian Huang , Wenjia Zhang

Self-supervised graph representation learning (SSGRL) is a representation learning paradigm used to reduce or avoid manual labeling. An essential part of SSGRL is graph data augmentation. Existing methods usually rely on heuristics commonly…

Machine Learning · Computer Science 2024-12-25 Ahmed E. Samy , Zekarias T. Kefatoa , Sarunas Girdzijauskasa

Self-supervised learning (SSL) methods based on Siamese networks learn visual representations by aligning different views of the same image. The multi-crop strategy, which incorporates small local crops to global ones, enhances many SSL…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Pierre-François De Plaen , Abhishek Jha , Luc Van Gool , Tinne Tuytelaars , Marc Proesmans

Hyperbolic manifolds for visual representation learning allow for effective learning of semantic class hierarchies by naturally embedding tree-like structures with low distortion within a low-dimensional representation space. The highly…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Aiden Durrant , Georgios Leontidis

Self-supervised learning (SSL) has revolutionized visual representation learning, but has not achieved the robustness of human vision. A reason for this could be that SSL does not leverage all the data available to humans during learning.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Arthur Aubret , Céline Teulière , Jochen Triesch

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jorge Quesada , Ghassan AlRegib

We propose a novel deep learning method for local self-supervised representation learning that does not require labels nor end-to-end backpropagation but exploits the natural order in data instead. Inspired by the observation that…

Machine Learning · Computer Science 2020-01-28 Sindy Löwe , Peter O'Connor , Bastiaan S. Veeling

Self-supervised learning (SSL) has emerged as a powerful paradigm for representation learning by optimizing geometric objectives, such as invariance to augmentations, variance preservation, and feature decorrelation, without requiring…

Machine Learning · Statistics 2026-03-09 M. Hadi Sepanj , Benyamin Ghojogh , Saed Moradi , Paul Fieguth

The development of single-cell and spatial transcriptomics has revolutionized our capacity to investigate cellular properties, functions, and interactions in both cellular and spatial contexts. However, the analysis of single-cell and…

Genomics · Quantitative Biology 2024-12-09 Shuang Ge , Shuqing Sun , Huan Xu , Qiang Cheng , Zhixiang Ren

Controlling the internal representation space of a neural network is a desirable feature because it allows to generate new data in a supervised manner. In this paper we will show how this can be achieved while building a low-dimensional…

Machine Learning · Computer Science 2020-09-03 Francesco Mannella

Spiking neural networks (SNNs) exhibit temporal, sparse, and event-driven dynamics that make them appealing for efficient inference. However, extending these models to self-supervised regimes remains challenging because the discontinuities…

Emerging Technologies · Computer Science 2025-11-25 Chengwei Zhou , Gourav Datta