English
Related papers

Related papers: TableLlama: Towards Open Large Generalist Models f…

200 papers

Structured data sources, such as tables, graphs, and databases, are ubiquitous knowledge sources. Despite the demonstrated capabilities of large language models (LLMs) on plain text, their proficiency in interpreting and utilizing…

Computation and Language · Computer Science 2024-10-08 Alex Zhuang , Ge Zhang , Tianyu Zheng , Xinrun Du , Junjie Wang , Weiming Ren , Stephen W. Huang , Jie Fu , Xiang Yue , Wenhu Chen

Tabular data are crucial in many fields and their understanding by large language models (LLMs) under high parameter efficiency paradigm is important. However, directly applying parameter-efficient fine-tuning (PEFT) techniques to tabular…

Computation and Language · Computer Science 2025-06-30 Xinyi He , Yihao Liu , Mengyu Zhou , Yeye He , Haoyu Dong , Shi Han , Zejian Yuan , Dongmei Zhang

While most generative models show achievements in image data generation, few are developed for tabular data generation. Recently, due to success of large language models (LLM) in diverse tasks, they have also been used for tabular data…

Machine Learning · Computer Science 2024-10-30 Dang Nguyen , Sunil Gupta , Kien Do , Thin Nguyen , Svetha Venkatesh

Large Language Models (LLMs) achieve impressive performance in a wide range of tasks, even if they are often trained with the only objective of chatting fluently with users. Among other skills, LLMs show emergent abilities in mathematical…

Computation and Language · Computer Science 2024-06-12 Flavio Petruzzellis , Alberto Testolin , Alessandro Sperduti

Large Language Models (LLMs), while being increasingly dominant on a myriad of knowledge-intensive activities, have only had limited success understanding lengthy table-text mixtures, such as academic papers and financial reports. Recent…

Computation and Language · Computer Science 2024-12-16 Yikang Pan , Yi Zhu , Rand Xie , Yizhi Liu

Pretrained language models have become the standard approach for many NLP tasks due to strong performance, but they are very expensive to train. We propose a simple and efficient learning framework, TLM, that does not rely on large-scale…

Computation and Language · Computer Science 2022-07-25 Xingcheng Yao , Yanan Zheng , Xiaocong Yang , Zhilin Yang

The ability of Large Language Models (LLMs) to generate structured outputs that follow arbitrary schemas is crucial to a wide range of downstream tasks that require diverse structured representations of results such as information…

Computation and Language · Computer Science 2025-11-25 James Y. Huang , Wenxuan Zhou , Nan Xu , Fei Wang , Qin Liu , Sheng Zhang , Hoifung Poon , Muhao Chen

Tables are prevalent in real-world databases, requiring significant time and effort for humans to analyze and manipulate. The advancements in large language models (LLMs) have made it possible to interact with tables using natural language…

Large language models (LLMs) demonstrate remarkable ability to comprehend, reason, and generate following nature language instructions. However, the development of LLMs has been primarily focused on high-resource languages, such as English,…

Recent literature has shown that large language models (LLMs) are generally excellent few-shot reasoners to solve text reasoning tasks. However, the capability of LLMs on table reasoning tasks is yet to be explored. In this paper, we aim at…

Computation and Language · Computer Science 2023-01-24 Wenhu Chen

Table processing, a key task in natural language processing, has significantly benefited from recent advancements in language models (LMs). However, the capabilities of LMs in table-to-text generation, which transforms structured data into…

Computation and Language · Computer Science 2024-10-18 Sahar Iravani , Tim . O . F Conrad

Advances in Large Language Models (LLMs) have led to significant interest in their potential to support human experts across a range of domains, including public health. In this work we present automated evaluations of LLMs for public…

Table understanding is key to addressing challenging downstream tasks such as table-based question answering and fact verification. Recent works have focused on leveraging Chain-of-Thought and question decomposition to solve complex…

Computation and Language · Computer Science 2025-08-26 Thi-Nhung Nguyen , Hoang Ngo , Dinh Phung , Thuy-Trang Vu , Dat Quoc Nguyen

Multi-modal large language models have demonstrated impressive performances on most vision-language tasks. However, the model generally lacks the understanding capabilities for specific domain data, particularly when it comes to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Yucheng Han , Chi Zhang , Xin Chen , Xu Yang , Zhibin Wang , Gang Yu , Bin Fu , Hanwang Zhang

Tabular data have been playing a vital role in diverse real-world fields, including healthcare, finance, etc. With the recent success of Large Language Models (LLMs), early explorations of extending LLMs to the domain of tabular data have…

Machine Learning · Computer Science 2025-12-11 Hangting Ye , Jinmeng Li , He Zhao , Dandan Guo , Yi Chang

Table reasoning, which aims to generate the corresponding answer to the question following the user requirement according to the provided table, and optionally a text description of the table, effectively improving the efficiency of…

Computation and Language · Computer Science 2024-02-14 Xuanliang Zhang , Dingzirui Wang , Longxu Dou , Qingfu Zhu , Wanxiang Che

Large language models have emerged as a promising approach towards achieving general-purpose AI agents. The thriving open-source LLM community has greatly accelerated the development of agents that support human-machine dialogue interaction…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zhenfei Yin , Jiong Wang , Jianjian Cao , Zhelun Shi , Dingning Liu , Mukai Li , Lu Sheng , Lei Bai , Xiaoshui Huang , Zhiyong Wang , Jing Shao , Wanli Ouyang

Large Language Models (LLMs) have exhibited remarkable capabilities in understanding and interacting with natural language across various sectors. However, their effectiveness is limited in specialized areas requiring high accuracy, such as…

Computation and Language · Computer Science 2024-01-04 Xianjun Yang , Junfeng Gao , Wenxin Xue , Erik Alexandersson

Large Language Models (LLMs) have demonstrated remarkable performance across various natural language tasks, marking significant strides towards general artificial intelligence. While general artificial intelligence is leveraged by…

Computation and Language · Computer Science 2023-10-31 Yizhe Yang , Huashan Sun , Jiawei Li , Runheng Liu , Yinghao Li , Yuhang Liu , Heyan Huang , Yang Gao

Table Question Answering (TQA) aims to answer natural language questions about tabular data, often accompanied by additional contexts such as text passages. The task spans diverse settings, varying in table representation, question/answer…

Computation and Language · Computer Science 2026-04-21 Wei Zhou , Bolei Ma , Annemarie Friedrich , Mohsen Mesgar