English
Related papers

Related papers: Why Tabular Foundation Models Should Be a Research…

200 papers

In recent years, foundation models (FMs) such as large language models (LLMs) and latent diffusion models (LDMs) have profoundly impacted diverse sectors, including music. This comprehensive review examines state-of-the-art (SOTA)…

Large Language Models (LLMs) are catalyzing a paradigm shift in scientific discovery, evolving from task-specific automation tools into increasingly autonomous agents and fundamentally redefining research processes and human-AI…

Computation and Language · Computer Science 2025-09-18 Tianshi Zheng , Zheye Deng , Hong Ting Tsang , Weiqi Wang , Jiaxin Bai , Zihao Wang , Yangqiu Song

Text summarization research has undergone several significant transformations with the advent of deep neural networks, pre-trained language models (PLMs), and recent large language models (LLMs). This survey thus provides a comprehensive…

Computation and Language · Computer Science 2024-06-18 Haopeng Zhang , Philip S. Yu , Jiawei Zhang

With the accumulation of data at an unprecedented rate, its potential to fuel scientific discovery is growing exponentially. This position paper urges the Machine Learning (ML) community to exploit the capabilities of large generative…

Computation and Language · Computer Science 2024-02-22 Bodhisattwa Prasad Majumder , Harshit Surana , Dhruv Agarwal , Sanchaita Hazra , Ashish Sabharwal , Peter Clark

Large language models (LLMs) are a class of language models that have demonstrated outstanding performance across a range of natural language processing (NLP) tasks and have become a highly sought-after research area, because of their…

Digital Libraries · Computer Science 2023-04-06 Lizhou Fan , Lingyao Li , Zihui Ma , Sanggyu Lee , Huizi Yu , Libby Hemphill

Tabular data is the most commonly used form of data in industry. Gradient Boosting Trees, Support Vector Machine, Random Forest, and Logistic Regression are typically used for classification tasks on tabular data. DNN models using…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Baohua Sun , Lin Yang , Wenhan Zhang , Michael Lin , Patrick Dong , Charles Young , Jason Dong

Large language models (LLMs) are powerful artificial intelligence (AI) tools transforming how research is conducted. However, their use in research has been met with skepticism, due to concerns about hallucinations, biases and potential…

Artificial Intelligence · Computer Science 2025-07-08 Ruian Ke , Ruy M. Ribeiro

Large language models (LLMs) are rapidly replacing help forums like StackOverflow, and are especially helpful for non-professional programmers and end users. These users are often interested in data-centric tasks, such as spreadsheet…

Tabular data is often hidden in text, particularly in medical diagnostic reports. Traditional machine learning (ML) models designed to work with tabular data, cannot effectively process information in such form. On the other hand, large…

Machine Learning · Computer Science 2023-06-09 Aleksa Bisercic , Mladen Nikolic , Mihaela van der Schaar , Boris Delibasic , Pietro Lio , Andrija Petrovic

Transformer-based tabular foundation models have recently demonstrated promising in-context learning (ICL) performance on structured data, emerging as competitive alternatives to gradient-boosted trees. However, the fairness implications of…

Machine Learning · Computer Science 2026-01-06 Patrik Kenfack , Samira Ebrahimi Kahou , Ulrich Aïvodji

Personalization of Large Language Models (LLMs) has recently become increasingly important with a wide range of applications. Despite the importance and recent progress, most existing works on personalized LLMs have focused either entirely…

Graph plays a significant role in representing and analyzing complex relationships in real-world applications such as citation networks, social networks, and biological data. Recently, Large Language Models (LLMs), which have achieved…

Machine Learning · Computer Science 2024-04-25 Yuhan Li , Zhixun Li , Peisong Wang , Jia Li , Xiangguo Sun , Hong Cheng , Jeffrey Xu Yu

Tabular data is the most widely used data format in machine learning (ML). While tree-based methods outperform DL-based methods in supervised learning, recent literature reports that self-supervised learning with Transformer-based models…

Machine Learning · Computer Science 2023-05-23 Soma Onishi , Shoya Meguro

Digital technologies have long been explored as a complement to standard procedure in mental health research and practice, ranging from the management of electronic health records to app-based interventions. The recent emergence of large…

The Web is a rich source of structured data in the form of tables, from product catalogs and knowledge bases to scientific datasets. However, the heterogeneity of the structure and semantics of these tables makes it challenging to build a…

Computation and Language · Computer Science 2026-02-19 Inwon Kang , Parikshit Ram , Yi Zhou , Horst Samulowitz , Oshani Seneviratne

The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Akash Ghosh , Arkadeep Acharya , Sriparna Saha , Vinija Jain , Aman Chadha

Despite the prevalence of images and texts in machine learning, tabular data remains widely used across various domains. Existing deep learning models, such as convolutional neural networks and transformers, perform well however demand…

Machine Learning · Computer Science 2024-06-26 Md Atik Ahamed , Qiang Cheng

The rapid growth of Large Language Models (LLMs) has been a driving force in transforming various domains, reshaping the artificial general intelligence landscape. However, the increasing computational and memory demands of these models…

Computation and Language · Computer Science 2024-04-22 Tianyu Ding , Tianyi Chen , Haidong Zhu , Jiachen Jiang , Yiqi Zhong , Jinxin Zhou , Guangzhi Wang , Zhihui Zhu , Ilya Zharkov , Luming Liang

Large Language Models (LLMs) are reshaping the landscape of computer science research, driving significant shifts in research priorities across diverse conferences and fields. This study provides a comprehensive analysis of the publication…

Digital Libraries · Computer Science 2025-04-24 Zhiqiu Xia , Lang Zhu , Bingzhe Li , Feng Chen , Qiannan Li , Chunhua Liao , Feiyi Wang , Hang Liu

The importance of research teams' diversity for the progress of science is highlighted extensively. Despite the seemingly hegemonic role of hypothesis testing in modern quantitative research, little attention has been devoted to the…

Digital Libraries · Computer Science 2024-10-01 Andres F. Castro Torres , Aliakbar Akbaritabar