English
Related papers

Related papers: Position: Foundation Models for Tabular Data withi…

200 papers

Current Large Language Models (LLMs) exhibit limited ability to understand table structures and to apply precise numerical reasoning, which is crucial for tasks such as table question answering (TQA) and table-based fact verification (TFV).…

Computation and Language · Computer Science 2025-07-11 Xinyuan Lu , Liangming Pan , Yubo Ma , Preslav Nakov , Min-Yen Kan

Large language models (LLMs) are increasingly exposed to data contamination, i.e., performance gains driven by prior exposure of test datasets rather than generalization. However, in the context of tabular data, this problem is largely…

Computation and Language · Computer Science 2026-03-31 Matteo Silvestri , Fabiano Veglianti , Flavio Giorgi , Fabrizio Silvestri , Gabriele Tolomei

Recent advances in multimodal large language models (MLLMs) highlight the need for benchmarks that rigorously evaluate structured chart comprehension. Chart grounding refers to the bidirectional alignment between a chart's visual appearance…

Artificial Intelligence · Computer Science 2026-02-02 Xinhang Li , Jingbo Zhou , Pengfei Luo , Yixiong Xiao , Tong Xu

Tabular data forms the backbone of high-stakes decision systems in finance, healthcare, and beyond. Yet industrial tabular datasets are inherently difficult: high-dimensional, riddled with missing entries, and rarely labeled at scale. While…

Machine Learning · Computer Science 2026-05-13 Bo Zheng , Yudong Chen , Zihua Xiong , Shuai Fang , Peidong He , Yang Yang , Sheng Guo

Compositional generalization remains a foundational weakness of modern neural networks, limiting their robustness and applicability in domains requiring out-of-distribution reasoning. A central, yet unverified, assumption in neuro-symbolic…

Artificial Intelligence · Computer Science 2026-04-30 Mahnoor Shahid , Hannes Rothe

Large language models now solve many benchmark math problems at near-expert levels, yet this progress has not fully translated into reliable performance in real-world applications. We study this gap through contextual mathematical…

Artificial Intelligence · Computer Science 2026-04-06 Bowen Cao , Dongdong Zhang , Yixia Li , Junpeng Liu , Shijue Huang , Chufan Shi , Hongyuan Lu , Yaokang Wu , Guanhua Chen , Wai Lam , Furu Wei

Tabular deep-learning methods require embedding numerical and categorical input features into high-dimensional spaces before processing them. Existing methods deal with this heterogeneous nature of tabular data by employing separate…

Machine Learning · Computer Science 2025-02-18 Boshko Koloski , Andrei Margeloiu , Xiangjian Jiang , Blaž Škrlj , Nikola Simidjievski , Mateja Jamnik

Tabular data underpins decisions across science, industry, and public services. Despite rapid progress, advances in deep learning have not fully carried over to the tabular domain, where gradient-boosted decision trees (GBDTs) remain a…

Machine Learning · Computer Science 2025-11-21 David Bonet , Marçal Comajoan Cara , Alvaro Calafell , Daniel Mas Montserrat , Alexander G. Ioannidis

Semi-structured tables are ubiquitous. There has been a variety of tasks that aim to automatically interpret, augment, and query tables. Current methods often require pretraining on tables or special model architecture design, are…

Computation and Language · Computer Science 2024-04-08 Tianshu Zhang , Xiang Yue , Yifei Li , Huan Sun

Knowledge graphs can represent information about the real-world using entities and their relations in a structured and semantically rich manner and they enable a variety of downstream applications such as question-answering, recommendation…

Computation and Language · Computer Science 2023-05-16 Hanieh Khorashadizadeh , Nandana Mihindukulasooriya , Sanju Tiwari , Jinghua Groppe , Sven Groppe

Foundation models pretrained on diverse data at scale have demonstrated extraordinary capabilities in a wide range of vision and language tasks. When such models are deployed in real world environments, they inevitably interface with other…

Artificial Intelligence · Computer Science 2023-03-08 Sherry Yang , Ofir Nachum , Yilun Du , Jason Wei , Pieter Abbeel , Dale Schuurmans

Causal discovery from observational data is fundamental to scientific fields like biology, where controlled experiments are often impractical. However, existing methods, including constraint-based (e.g., PC, causalMGM) and score-based…

Machine Learning · Computer Science 2025-10-14 Zhenjiang Fan , Zengyi Qin , Yuanning Zheng , Bo Xiong , Summer Han

Multimodal Large Language Models (MLLMs) have demonstrated remarkable reasoning capabilities across modalities such as images and text. However, tabular data, despite being a critical real-world modality, remains relatively underexplored in…

Computation and Language · Computer Science 2026-03-26 Kun-Yang Yu , Zhi Zhou , Shi-Yu Tian , Xiao-Wen Yang , Zi-Yi Jia , Ming Yang , Zi-Jian Cheng , Lan-Zhe Guo , Yu-Feng Li

Recent table representation learning and data discovery methods tackle table union search (TUS) within data lakes, which involves identifying tables that can be unioned with a given query table to enrich its content. These methods are…

Information Retrieval · Computer Science 2025-05-29 Allaa Boutaleb , Bernd Amann , Hubert Naacke , Rafael Angarita

GRAFT is a structured multimodal benchmark designed to probe how well LLMs handle instruction following, visual reasoning, and tasks requiring tight visual textual alignment. The dataset is built around programmatically generated charts and…

Artificial Intelligence · Computer Science 2025-12-03 Abhigya Verma , Sriram Puttagunta , Seganrasan Subramanian , Sravan Ramachandran

Large Language Models (LLMs) excel in natural language tasks, but less is known about their reasoning capabilities over tabular data. Prior analyses devise evaluation strategies that poorly reflect an LLM's realistic performance on tabular…

Artificial Intelligence · Computer Science 2025-11-05 Cornelius Wolff , Madelon Hulsebos

Existing efforts in building GUI agents heavily rely on the availability of robust commercial Vision-Language Models (VLMs) such as GPT-4o and GeminiProVision. Practitioners are often reluctant to use open-source VLMs due to their…

Computation and Language · Computer Science 2024-10-31 Zhiyong Wu , Zhenyu Wu , Fangzhi Xu , Yian Wang , Qiushi Sun , Chengyou Jia , Kanzhi Cheng , Zichen Ding , Liheng Chen , Paul Pu Liang , Yu Qiao

Tabular data is prevalent in real-world machine learning applications, and new models for supervised learning of tabular data are frequently proposed. Comparative studies assessing the performance of models typically consist of…

Machine Learning · Computer Science 2024-12-19 Andrej Tschalzev , Sascha Marton , Stefan Lüdtke , Christian Bartelt , Heiner Stuckenschmidt

Link prediction is a fundamental task in graph machine learning with widespread applications such as recommendation systems, drug discovery, knowledge graphs, etc. In the foundation model era, how to develop universal link prediction…

Machine Learning · Computer Science 2026-02-10 Tianyin Liao , Chunyu Hu , Yicheng Sui , Xingxuan Zhang , Peng Cui , Jianxin Li , Ziwei Zhang

Structured, procedural reasoning is essential for Large Language Models (LLMs), especially in mathematics. While post-training methods have improved LLM performance, they still fall short in capturing deep procedural logic on complex tasks.…

Artificial Intelligence · Computer Science 2025-08-27 Zhichao Yang , Zhaoxin Fan , Gen Li , Yuanze Hu , Xinyu Wang , Ye Qiu , Xin Wang , Yifan Sun , Wenjun Wu
‹ Prev 1 4 5 6 7 8 10 Next ›