English

Towards Better Serialization of Tabular Data for Few-shot Classification with Large Language Models

Machine Learning 2023-12-22 v2 Artificial Intelligence Computation and Language

Abstract

We present a study on the integration of Large Language Models (LLMs) in tabular data classification, emphasizing an efficient framework. Building upon existing work done in TabLLM (arXiv:2210.10723), we introduce three novel serialization techniques, including the standout LaTeX serialization method. This method significantly boosts the performance of LLMs in processing domain-specific datasets, Our method stands out for its memory efficiency and ability to fully utilize complex data structures. Through extensive experimentation, including various serialization approaches like feature combination and importance, we demonstrate our work's superiority in accuracy and efficiency over traditional models.

Keywords

Cite

@article{arxiv.2312.12464,
  title  = {Towards Better Serialization of Tabular Data for Few-shot Classification with Large Language Models},
  author = {Sukriti Jaitly and Tanay Shah and Ashish Shugani and Razik Singh Grewal},
  journal= {arXiv preprint arXiv:2312.12464},
  year   = {2023}
}

Comments

4 pages, 2 figures

R2 v1 2026-06-28T13:56:38.175Z