English
Related papers

Related papers: TableGPT2: A Large Multimodal Model with Tabular D…

200 papers

Multi-modal large language models have demonstrated impressive performances on most vision-language tasks. However, the model generally lacks the understanding capabilities for specific domain data, particularly when it comes to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yucheng Han , Chi Zhang , Xin Chen , Xu Yang , Zhibin Wang , Gang Yu , Bin Fu , Hanwang Zhang

Tabular datasets play a crucial role in various applications. Thus, developing efficient, effective, and widely compatible prediction algorithms for tabular data is important. Currently, two prominent model types, Gradient Boosted Decision…

Machine Learning · Computer Science 2024-07-16 Jiahuan Yan , Jintai Chen , Qianxing Wang , Danny Z. Chen , Jian Wu

The ability to train generative models that produce realistic, safe and useful tabular data is essential for data privacy, imputation, oversampling, explainability or simulation. However, generating tabular data is not straightforward due…

Machine Learning · Computer Science 2025-09-18 G. Charbel N. Kindji , Lina Maria Rojas-Barahona , Elisa Fromont , Tanguy Urvoy

The advent of large language models (LLMs) like GPT-4 has catalyzed the exploration of multi-task learning (MTL), in which a single model demonstrates proficiency across diverse tasks. Task arithmetic has emerged as a cost-effective…

Computation and Language · Computer Science 2024-06-28 Yuyan Zhou , Liang Song , Bingning Wang , Weipeng Chen

In natural language processing (NLP), the focus has shifted from encoder-only tiny language models like BERT to decoder-only large language models(LLMs) such as GPT-3. However, LLMs' practical application in the financial sector has…

Information Retrieval · Computer Science 2025-07-08 Xuan Xu , Fufang Wen , Beilin Chu , Zhibing Fu , Qinhong Lin , Jiaqi Liu , Binjie Fei , Yu Li , Linna Zhou , Zhongliang Yang

This work reframes the Text-to-SQL task as a pathway for teaching large language models (LLMs) to reason over and manipulate tabular data--moving beyond the traditional focus on query generation. We propose a two-stage framework that…

Computation and Language · Computer Science 2025-05-05 Josefa Lia Stoisser , Marc Boubnovski Martell , Julien Fauqueur

Recent advancements in tabular deep learning have demonstrated exceptional practical performance, yet the field often lacks a clear understanding of why these techniques actually succeed. To address this gap, our paper highlights the…

Machine Learning · Computer Science 2025-09-05 Nikolay Kartashev , Ivan Rubachev , Artem Babenko

The Natural Language to Visualization (NL2Vis) task aims to transform natural-language descriptions into visual representations for a grounded table, enabling users to gain insights from vast amounts of data. Recently, many deep…

Databases · Computer Science 2024-04-29 Yang Wu , Yao Wan , Hongyu Zhang , Yulei Sui , Wucai Wei , Wei Zhao , Guandong Xu , Hai Jin

We present TransactionGPT (TGPT), a foundation model for consumer transaction data within one of the world's largest payment networks. TGPT is designed to understand and generate transaction trajectories while simultaneously supporting a…

While traditional tree-based ensemble methods have long dominated tabular tasks, deep neural networks and emerging foundation models have challenged this primacy, yet no consensus exists on a universally superior paradigm. Existing…

Emerging multimodal large language models (MLLMs) exhibit great potential for chart question answering (CQA). Recent efforts primarily focus on scaling up training datasets (i.e., charts, data tables, and question-answer (QA) pairs) through…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xingchen Zeng , Haichuan Lin , Yilin Ye , Wei Zeng

Large Language Models (LLMs) like GPT and LLaMA are revolutionizing the AI industry with their sophisticated capabilities. Training these models requires vast GPU clusters and significant computing time, posing major challenges in terms of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-30 Jiangfei Duan , Shuo Zhang , Zerui Wang , Lijuan Jiang , Wenwen Qu , Qinghao Hu , Guoteng Wang , Qizhen Weng , Hang Yan , Xingcheng Zhang , Xipeng Qiu , Dahua Lin , Yonggang Wen , Xin Jin , Tianwei Zhang , Peng Sun

Multimodal tables i.e. tabular layouts interleaved with charts, maps, icons, and color encodings are ubiquitous in real applications yet remain difficult for Multimodal Large Language Models (MLLMs). Despite advances in text and image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Prasham Titiya , Jainil Trivedi , Chitta Baral , Vivek Gupta

Recent large language models (LLMs) have advanced table understanding capabilities but rely on converting tables into text sequences. While multimodal large language models (MLLMs) enable direct visual processing, they face limitations in…

Computation and Language · Computer Science 2025-02-26 Bohao Yang , Yingji Zhang , Dong Liu , André Freitas , Chenghua Lin

Large language models have exhibited exceptional performance on various Natural Language Processing (NLP) tasks, leveraging techniques such as the pre-training, and instruction fine-tuning. Despite these advances, their effectiveness in…

Computation and Language · Computer Science 2023-06-19 Guangyu Wang , Guoxing Yang , Zongxin Du , Longjun Fan , Xiaohu Li

In talent management systems, critical information often resides in complex tabular formats, presenting significant retrieval challenges for conventional language models. These challenges are pronounced when processing Talent documentation…

Artificial Intelligence · Computer Science 2025-07-02 Varun Mannam , Fang Wang , Chaochun Liu , Xin Chen

The success of ChatGPT has recently attracted numerous efforts to replicate it, with instruction-tuning strategies being a key factor in achieving remarkable results. Instruction-tuning not only significantly enhances the model's…

Computation and Language · Computer Science 2023-03-28 Yunjie Ji , Yong Deng , Yan Gong , Yiping Peng , Qiang Niu , Lei Zhang , Baochang Ma , Xiangang Li

Tables stored in databases and tables which are present in web pages and articles account for a large part of semi-structured data that is available on the internet. It then becomes pertinent to develop a modeling approach with large…

Computation and Language · Computer Science 2023-10-03 Soumajyoti Sarkar , Leonard Lausen

Chart question answering (ChartQA) tasks play a critical role in interpreting and extracting insights from visualization charts. While recent advancements in multimodal large language models (MLLMs) like GPT-4o have shown promise in…

Computation and Language · Computer Science 2024-11-07 Yifan Wu , Lutao Yan , Leixian Shen , Yunhai Wang , Nan Tang , Yuyu Luo

Decoder-only LLMs have shown impressive performance in MT due to their ability to learn from extensive datasets and generate high-quality translations. However, LLMs often struggle with the nuances and style required for…

Computation and Language · Computer Science 2024-09-11 Inacio Vieira , Will Allred , Séamus Lankford , Sheila Castilho , Andy Way