English
Related papers

Related papers: MET: Masked Encoding for Tabular Data

200 papers

Self-supervised learning (SSL) learns knowledge from a large amount of unlabeled data, and then transfers the knowledge to a specific problem with a limited number of labeled data. SSL has achieved promising results in various domains. This…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-08 Xian Li , Xiaofei Li

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

The lack of quality labeled data is one of the main bottlenecks for training Deep Learning models. As the task increases in complexity, there is a higher penalty for overfitting and unstable learning. The typical paradigm employed today is…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Priyam Mazumdar , Aiman Soliman , Volodymyr Kindratenko , Luigi Marini , Kenton McHenry

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-05-28 Jiaxing Wang , Yin Zheng , Xiaoshuang Chen , Junzhou Huang , Jian Cheng

Deep learning based semi-supervised learning (SSL) algorithms have led to promising results in recent years. However, they tend to introduce multiple tunable hyper-parameters, making them less practical in real SSL scenarios where the…

Machine Learning · Computer Science 2024-10-30 Yulin Wang , Jiayi Guo , Shiji Song , Gao Huang

Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Weiren Zhao , Lanfeng Zhong , Xin Liao , Wenjun Liao , Sichuan Zhang , Shaoting Zhang , Guotai Wang

Deep neural networks are capable of learning powerful representations to tackle complex vision tasks but expose undesirable properties like the over-fitting issue. To this end, regularization techniques like image augmentation are necessary…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Haohang Xu , Shuangrui Ding , Manqi Zhao , Dongsheng Jiang

Recently, wearable emotion recognition based on peripheral physiological signals has drawn massive attention due to its less invasive nature and its applicability in real-life scenarios. However, how to effectively fuse multimodal data…

Human-Computer Interaction · Computer Science 2023-04-03 Yujin Wu , Mohamed Daoudi , Ali Amad

The successes achieved by deep neural networks in computer vision tasks have led in recent years to the emergence of a new research area dubbed Multi-Dimensional Encoding (MDE). Methods belonging to this family aim to transform tabular data…

Machine Learning · Computer Science 2025-03-26 Paweł Zyblewski , Szymon Wojciechowski

Latest federated learning (FL) methods started to focus on how to use unlabeled data in clients for training due to users' privacy concerns, high labeling costs, or lack of expertise. However, current Federated…

Machine Learning · Computer Science 2023-03-22 Nan Yang , Xuanyu Chen , Charles Z. Liu , Dong Yuan , Wei Bao , Lizhen Cui

Self-Supervised Learning (SSL) is an important paradigm for learning representations from unlabelled data, and SSL with neural networks has been highly successful in practice. However current theoretical analysis of SSL is mostly restricted…

Machine Learning · Computer Science 2023-09-06 Pascal Esser , Satyaki Mukherjee , Debarghya Ghoshdastidar

Recent state-of-the-art semi-supervised learning (SSL) methods use a combination of image-based transformations and consistency regularization as core components. Such methods, however, are limited to simple transformations such as…

Computer Vision and Pattern Recognition · Computer Science 2020-07-17 Chia-Wen Kuo , Chih-Yao Ma , Jia-Bin Huang , Zsolt Kira

Multiview Self-Supervised Learning (MSSL) is based on learning invariances with respect to a set of input transformations. However, invariance partially or totally removes transformation-related information from the representations, which…

Machine Learning · Computer Science 2023-11-20 Xavier Suau , Federico Danieli , T. Anderson Keller , Arno Blaas , Chen Huang , Jason Ramapuram , Dan Busbridge , Luca Zappella

Self-supervised learning (SSL) has great potential for molecular representation learning given the complexity of molecular graphs, the large amounts of unlabelled data available, the considerable cost of obtaining labels experimentally, and…

Machine Learning · Computer Science 2023-11-30 Yuankai Luo , Lei Shi , Veronika Thost

Semi-supervised learning (SSL) has shown its effectiveness in learning effective 3D representation from a small amount of labelled data while utilizing large unlabelled data. Traditional semi-supervised approaches rely on the fundamental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Sneha Paul , Zachary Patterson , Nizar Bouguila

Our work introduces SAVeD (Semantically Aware Version Detection), a contrastive learning-based framework for identifying versions of structured datasets without relying on metadata, labels, or integration-based assumptions. SAVeD addresses…

Machine Learning · Computer Science 2026-01-13 Artem Frenk , Roee Shraga

Most semi-supervised learning (SSL) models entail complex structures and iterative training processes as well as face difficulties in interpreting their predictions to users. To address these issues, this paper proposes a new interpretable…

Neural and Evolutionary Computing · Computer Science 2023-06-26 Farhad Pourpanah , Chee Peng Lim , Ali Etemad , Q. M. Jonathan Wu

This study explores the application of self-supervised learning (SSL) to the task of motion forecasting, an area that has not yet been extensively investigated despite the widespread success of SSL in computer vision and natural language…

Robotics · Computer Science 2023-08-22 Jie Cheng , Xiaodong Mei , Ming Liu

Self-supervised Learning (SSL) is a machine learning algorithm for pretraining Deep Neural Networks (DNNs) without requiring manually labeled data. The central idea of this learning technique is based on an auxiliary stage aka pretext task…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Noah Barrett , Zahra Sadeghi , Stan Matwin

Tabular data synthesis is crucial for addressing privacy and security concerns in industries reliant on tabular data. While recent advancements adopt large language models (LLMs) for realistic tabular data generation, their long training…

Machine Learning · Computer Science 2025-02-18 Zilong Zhao , Robert Birke , Lydia Chen