English
Related papers

Related papers: Maximum Manifold Capacity Representations in State…

200 papers

Self-supervised learning (SSL) has great potential for molecular representation learning given the complexity of molecular graphs, the large amounts of unlabelled data available, the considerable cost of obtaining labels experimentally, and…

Machine Learning · Computer Science 2023-11-30 Yuankai Luo , Lei Shi , Veronika Thost

Self-supervised learning (SSL) methods via joint embedding architectures have proven remarkably effective at capturing semantically rich representations with strong clustering properties, magically in the absence of label supervision.…

Machine Learning · Computer Science 2025-05-13 Xi Weng , Jianing An , Xudong Ma , Binhang Qi , Jie Luo , Xi Yang , Jin Song Dong , Lei Huang

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

In recent years, self-supervised learning has been studied to deal with the limitation of available labeled-dataset. Among the major components of self-supervised learning, the data augmentation pipeline is one key factor in enhancing the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Van-Nhiem Tran , Chi-En Huang , Shen-Hsuan Liu , Kai-Lin Yang , Timothy Ko , Yung-Hui Li

In the healthcare domain, Magnetic Resonance Imaging (MRI) assumes a pivotal role, as it employs Artificial Intelligence (AI) and Machine Learning (ML) methodologies to extract invaluable insights from imaging data. Nonetheless, the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-18 Al Amin , Kamrul Hasan , Saleh Zein-Sabatto , Deo Chimba , Liang Hong , Imtiaz Ahmed , Tariqul Islam

The millimeter wave (mmWave) multiuser multiple-input multiple-output (MU-MIMO) systems with discrete lens arrays (DLA) have received great attention due to their simple hardware implementation and excellent performance. In this work, we…

Information Theory · Computer Science 2021-01-06 Qiyu Hu , Yanzhen Liu , Yunlong Cai , Guanding Yu , Zhi Ding

Recently, deep clustering methods have gained momentum because of the high representational power of deep neural networks (DNNs) such as autoencoder. The key idea is that representation learning and clustering can reinforce each other: Good…

Machine Learning · Computer Science 2021-10-01 Wengang Guo , Kaiyan Lin , Wei Ye

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

Dimension reduction (DR) aims to learn low-dimensional representations of high-dimensional data with the preservation of essential information. In the context of manifold learning, we define that the representation after…

Machine Learning · Computer Science 2021-07-01 Siyuan Li , Haitao Lin , Zelin Zang , Lirong Wu , Jun Xia , Stan Z. Li

Semi-Supervised Learning (SSL) has become a preferred paradigm in many deep learning tasks, which reduces the need for human labor. Previous studies primarily focus on effectively utilising the labelled and unlabeled data to improve…

Machine Learning · Computer Science 2024-10-29 Qian Shao , Jiangrui Kang , Qiyuan Chen , Zepeng Li , Hongxia Xu , Yiwen Cao , Jiajuan Liang , Jian Wu

MatSSL is a streamlined self-supervised learning (SSL) architecture that employs Gated Feature Fusion at each stage of the backbone to integrate multi-level representations effectively. Current micrograph analysis of metallic materials…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hoang Hai Nam Nguyen , Phan Nguyen Duc Hieu , Ho Won Lee

One of the most critical aspects of multimodal Reinforcement Learning (RL) is the effective integration of different observation modalities. Having robust and accurate representations derived from these modalities is key to enhancing the…

Robotics · Computer Science 2024-06-21 Fotios Lygerakis , Vedant Dave , Elmar Rueckert

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

Recent work in Deep Learning has re-imagined the representation of data as functions mapping from a coordinate space to an underlying continuous signal. When such functions are approximated by neural networks this introduces a compelling…

Machine Learning · Statistics 2022-08-09 Jonathan Richard Schwarz , Yee Whye Teh

Large-scale volumetric medical images with annotation are rare, costly, and time prohibitive to acquire. Self-supervised learning (SSL) offers a promising pre-training and feature extraction solution for many downstream tasks, as it only…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Ke Yu , Li Sun , Junxiang Chen , Max Reynolds , Tigmanshu Chaudhary , Kayhan Batmanghelich

Self-supervised representation learning~(SSRL) has advanced considerably by exploiting the transformation invariance assumption under artificially designed data augmentations. While augmentation-based SSRL algorithms push the boundaries of…

Machine Learning · Computer Science 2024-03-22 Yi Sui , Tongzi Wu , Jesse C. Cresswell , Ga Wu , George Stein , Xiao Shi Huang , Xiaochen Zhang , Maksims Volkovs

This paper presents a new deep clustering (DC) method called manifold-aware DC (M-DC) that can enhance hyperspace utilization more effectively than the original DC. The original DC has a limitation in that a pair of two speakers has to be…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-17 Keitaro Tanaka , Ryosuke Sawata , Shusuke Takahashi

Clustering and dimensionality reduction have been crucial topics in machine learning and computer vision. Clustering high-dimensional data has been challenging for a long time due to the curse of dimensionality. For that reason, a more…

Machine Learning · Statistics 2026-04-16 Sida Liu , Yangzi Guo , Mingyuan Wang

Recent advances in self-supervised learning (SSL) using large models to learn visual representations from natural images are rapidly closing the gap between the results produced by fully supervised learning and those produced by SSL on…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Weiyao Wang , Byung-Hak Kim , Varun Ganapathi

Reinforcement Learning (RL) encompasses diverse paradigms, including model-based RL, policy-based RL, and value-based RL, each tailored to approximate the model, optimal policy, and optimal value function, respectively. This work…

Machine Learning · Computer Science 2024-12-10 Guhao Feng , Han Zhong