English
Related papers

Related papers: Tab-Attention: Self-Attention-based Stacked Genera…

200 papers

A few models have tried to tackle the link prediction problem, also known as knowledge graph completion, by embedding knowledge graphs in comparably lower dimensions. However, the state-of-the-art results are attained at the cost of…

Machine Learning · Computer Science 2022-11-29 Peyman Baghershahi , Reshad Hosseini , Hadi Moradi

Healthcare providers are increasingly using machine learning to predict patient outcomes to make meaningful interventions. However, despite innovations in this area, deep learning models often struggle to match performance of shallow linear…

Machine Learning · Computer Science 2020-12-18 Rohan S. Kodialam , Rebecca Boiarsky , Justin Lim , Neil Dixit , Aditya Sai , David Sontag

Deep learning has achieved remarkable success in bearing fault diagnosis. However, its performance oftentimes deteriorates when dealing with highly imbalanced or long-tailed data, while such cases are prevalent in industrial settings…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Wei-En Yu , Jinwei Sun , Shiping Zhang , Xiaoge Zhang , Jing-Xiao Liao

Fine-tuning a pre-trained deep neural network has become a successful paradigm in various machine learning tasks. However, such a paradigm becomes particularly challenging with tabular data when there are discrepancies between the feature…

Machine Learning · Computer Science 2023-10-24 Qi-Le Zhou , Han-Jia Ye , Le-Ye Wang , De-Chuan Zhan

Most user-related data can be represented as a sequence of events associated with a timestamp and a collection of categorical labels. For example, the purchased basket of goods and the time of buying fully characterize the event of the…

Machine Learning · Computer Science 2024-10-29 Elizaveta Kovtun , Galina Boeva , Andrey Shulga , Alexey Zaytsev

The neural attention mechanism has been incorporated into deep neural networks to achieve state-of-the-art performance in various domains. Most such models use multi-head self-attention which is appealing for the ability to attend to…

Machine Learning · Computer Science 2021-10-26 Shujian Zhang , Xinjie Fan , Huangjie Zheng , Korawat Tanwisuth , Mingyuan Zhou

Stance detection is the view towards a specific target by a given context (\textit{e.g.} tweets, commercial reviews). Target-related knowledge is often needed to assist stance detection models in understanding the target well and making…

Computation and Language · Computer Science 2024-03-29 Ming Yan , Joey Tianyi Zhou , Ivor W. Tsang

Learning from Label Proportion (LLP) is a weakly supervised learning scenario in which training data is organized into predefined bags of instances, disclosing only the class label proportions per bag. This paradigm is essential for user…

Machine Learning · Computer Science 2024-08-14 Jialiang Wang , Ning Zhang , Shimin Di , Ruidong Wang , Lei Chen

Although attention mechanisms have become fundamental components of deep learning models, they are vulnerable to perturbations, which may degrade the prediction performance and model interpretability. Adversarial training (AT) for attention…

Computation and Language · Computer Science 2022-12-27 Shunsuke Kitada , Hitoshi Iyatomi

With the development of the financial industry, credit default prediction, as an important task in financial risk management, has received increasing attention. Traditional credit default prediction methods mostly rely on machine learning…

Risk Management · Quantitative Finance 2024-12-25 Yuhan Wang , Zhen Xu , Yue Yao , Jinsong Liu , Jiating Lin

Despite progress, deep neural networks still suffer performance declines under distribution shifts between training and test domains, leading to a substantial decrease in Quality of Experience (QoE) for applications. Existing test-time…

Machine Learning · Computer Science 2025-06-10 Qinting Jiang , Chuyang Ye , Dongyan Wei , Bingli Wang , Yuan Xue , Jingyan Jiang , Zhi Wang

Biased attributes, spuriously correlated with target labels in a dataset, can problematically lead to neural networks that learn improper shortcuts for classifications and limit their capabilities for out-of-distribution (OOD)…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jinyung Hong , Eun Som Jeon , Changhoon Kim , Keun Hee Park , Utkarsh Nath , Yezhou Yang , Pavan Turaga , Theodore P. Pavlic

Despite groundbreaking success in image and text learning, deep learning has not achieved significant improvements against traditional machine learning (ML) when it comes to tabular data. This performance gap underscores the need for…

Machine Learning · Computer Science 2024-01-10 Shourav B. Rabbani , Ivan V. Medri , Manar D. Samad

Semi-supervised learning (SSL), thanks to the significant reduction of data annotation costs, has been an active research topic for large-scale 3D scene understanding. However, the existing SSL-based methods suffer from severe training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Mengtian Li , Shaohui Lin , Zihan Wang , Yunhang Shen , Baochang Zhang , Lizhuang Ma

Data imbalance is easily found in annotated data when the observations of certain continuous label values are difficult to collect for regression tasks. When they come to molecule and polymer property predictions, the annotated graph…

Machine Learning · Computer Science 2023-05-23 Gang Liu , Tong Zhao , Eric Inae , Tengfei Luo , Meng Jiang

Label distribution learning (LDL) differs from multi-label learning which aims at representing the polysemy of instances by transforming single-label values into descriptive degrees. Unfortunately, the feature space of the label…

Machine Learning · Computer Science 2022-10-26 Weiyi Cong , Zhuoran Zheng , Xiuyi Jia

Self-attention has greatly contributed to the success of the widely used Transformer architecture by enabling learning from data with long-range dependencies. In an effort to improve performance, a gated attention model that leverages a…

Machine Learning · Computer Science 2026-02-03 Viet Nguyen , Tuan Minh Pham , Thinh Cao , Tan Dinh , Huy Nguyen , Nhat Ho , Alessandro Rinaldo

Tabular data sets with varying missing values are prepared for machine learning using an arbitrary imputation strategy. Synthetic values generated by imputation models often raise concerns regarding data quality and the reliability of…

Machine Learning · Computer Science 2026-01-28 Manar D. Samad , Kazi Fuad B. Akhter , Shourav B. Rabbani , Ibna Kowsar

Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting performance limitation. To this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Zhihao Peng , Hui Liu , Yuheng Jia , Junhui Hou

Currently, most food recognition relies on deep learning for category classification. However, these approaches struggle to effectively distinguish between visually similar food samples, highlighting the pressing need to address…

Machine Learning · Computer Science 2024-03-20 Guohang Zhuang , Yue Hu , Tianxing Yan , JiaZhan Gao