中文
相关论文

相关论文: Deep Learning with Tabular Data: A Self-supervised…

200 篇论文

We propose TabTransformer, a novel deep tabular data modeling architecture for supervised and semi-supervised learning. The TabTransformer is built upon self-attention based Transformers. The Transformer layers transform the embeddings of…

机器学习 · 计算机科学 2020-12-15 Xin Huang , Ashish Khetan , Milan Cvitkovic , Zohar Karnin

We propose a novel high-performance and interpretable canonical deep tabular data learning architecture, TabNet. TabNet uses sequential attention to choose which features to reason from at each decision step, enabling interpretability and…

机器学习 · 计算机科学 2020-12-10 Sercan O. Arik , Tomas Pfister

Recent work on deep learning for tabular data demonstrates the strong performance of deep tabular models, often bridging the gap between gradient boosted decision trees and neural networks. Accuracy aside, a major advantage of neural models…

Deep neural networks are typically trained under a supervised learning framework where a model learns a single task using labeled data. Instead of relying solely on labeled data, practitioners can harness unlabeled or related data to…

机器学习 · 计算机科学 2020-07-03 Huanru Henry Mao

Tabular data, structured as rows and columns, is among the most prevalent data types in machine learning classification and regression applications. Models for learning from tabular data have continuously evolved, with Deep Neural Networks…

机器学习 · 计算机科学 2025-04-24 Jun-Peng Jiang , Si-Yang Liu , Hao-Run Cai , Qile Zhou , Han-Jia Ye

Tabular data, widely used in industries like healthcare, finance, and transportation, presents unique challenges for deep learning due to its heterogeneous nature and lack of spatial structure. This survey reviews the evolution of deep…

机器学习 · 计算机科学 2024-10-17 Shriyank Somvanshi , Subasish Das , Syed Aaqib Javed , Gian Antariksa , Ahmed Hossain

Since we can leverage a large amount of unlabeled data without any human supervision to train a model and transfer the knowledge to target tasks, self-supervised learning is a de-facto component for the recent success of deep learning in…

计算与语言 · 计算机科学 2021-03-12 Donggyu Kim , Seanie Lee

There is an increasing interest in the application of deep learning architectures to tabular data. One of the state-of-the-art solutions is TabTransformer which incorporates an attention mechanism to better track relationships between…

机器学习 · 计算机科学 2022-01-04 Radostin Cholakov , Todor Kolev

Self-supervised representation learning methods have achieved significant success in computer vision and natural language processing, where data samples exhibit explicit spatial or semantic dependencies. However, applying these methods to…

Deep learning (DL) models for tabular data problems (e.g. classification, regression) are currently receiving increasingly more attention from researchers. However, despite the recent efforts, the non-DL algorithms based on gradient-boosted…

机器学习 · 计算机科学 2023-10-27 Yury Gorishniy , Ivan Rubachev , Nikolay Kartashev , Daniil Shlenskii , Akim Kotelnikov , Artem Babenko

Tabular data remains one of the most prevalent data types across a wide range of real-world applications, yet effective representation learning for this domain poses unique challenges due to its irregular patterns, heterogeneous feature…

机器学习 · 计算机科学 2025-01-08 Weijieying Ren , Tianxiang Zhao , Yuqing Huang , Vasant Honavar

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

机器学习 · 计算机科学 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

Pre-training is prevalent in deep learning for vision and text data, leveraging knowledge from other datasets to enhance downstream tasks. However, for tabular data, the inherent heterogeneity in attribute and label spaces across datasets…

机器学习 · 计算机科学 2025-02-13 Han-Jia Ye , Qi-Le Zhou , Huai-Hong Yin , De-Chuan Zhan , Wei-Lun Chao

Traditional methods for tabular classification usually rely on supervised learning from scratch, which requires extensive training data to determine model parameters. However, a novel approach called Prior-Data Fitted Networks (TabPFN) has…

机器学习 · 计算机科学 2024-06-12 Quangao Liu , Wei Yang , Chen Liang , Longlong Pang , Zhuozhang Zou

Tabular deep-learning methods require embedding numerical and categorical input features into high-dimensional spaces before processing them. Existing methods deal with this heterogeneous nature of tabular data by employing separate…

机器学习 · 计算机科学 2025-02-18 Boshko Koloski , Andrei Margeloiu , Xiangjian Jiang , Blaž Škrlj , Nikola Simidjievski , Mateja Jamnik

Supervised deep learning is most commonly applied to difficult problems defined on large and often extensively curated datasets. Here we demonstrate the ability of deep representation learning to address problems of classification and…

机器学习 · 计算机科学 2022-11-30 Benjamin L. Badger

This work presents a novel approach to tabular data prediction leveraging graph structure learning and graph neural networks. Despite the prevalence of tabular data in real-world applications, traditional deep learning methods often…

机器学习 · 计算机科学 2023-05-26 Jay Chiehen Liao , Cheng-Te Li

Despite the prevalence and significance of tabular data across numerous industries and fields, it has been relatively underexplored in the realm of deep learning. Even today, neural networks are often overshadowed by techniques such as…

机器学习 · 计算机科学 2024-07-19 Andreas Voskou , Charalambos Christoforou , Sotirios Chatzis

Tabular data is prevalent in many critical domains, yet it is often challenging to acquire in large quantities. This scarcity usually results in poor performance of machine learning models on such data. Data augmentation, a common strategy…

机器学习 · 计算机科学 2024-07-30 Andrei Margeloiu , Adrián Bazaga , Nikola Simidjievski , Pietro Liò , Mateja Jamnik

Although deep learning models have had great success in natural language processing and computer vision, we do not observe comparable improvements in the case of tabular data, which is still the most common data type used in biological,…

机器学习 · 计算机科学 2025-04-28 Witold Wydmański , Ulvi Movsum-zada , Jacek Tabor , Marek Śmieja
‹ 上一页 1 2 3 10 下一页 ›