English
Related papers

Related papers: DataFrame QA: A Universal LLM Framework on DataFra…

200 papers

Traditional Semantic Table Interpretation (STI) methods rely primarily on the underlying table data to create semantic annotations. This year's SemTab challenge introduced the ``Metadata to KG'' track, which focuses on performing STI by…

Computation and Language · Computer Science 2024-09-24 Margherita Martorana , Xueli Pan , Benno Kruit , Tobias Kuhn , Jacco van Ossenbruggen

The advent of large language models (LLMs) has unlocked great opportunities in complex data management tasks, particularly in question answering (QA) over complicated multi-table relational data. Despite significant progress, systematically…

Artificial Intelligence · Computer Science 2024-12-02 Zipeng Qiu , You Peng , Guangxin He , Binhang Yuan , Chen Wang

We analyze the behaviors of open large language models (LLMs) on the task of data-to-text (D2T) generation, i.e., generating coherent and relevant text from structured data. To avoid the issue of LLM training data contamination with…

Computation and Language · Computer Science 2024-06-07 Zdeněk Kasner , Ondřej Dušek

The quality of datasets plays an increasingly crucial role in the research and development of modern artificial intelligence (AI). Despite the proliferation of open dataset platforms nowadays, data quality issues, such as incomplete…

Artificial Intelligence · Computer Science 2025-05-28 Benhao Huang , Yingzhuo Yu , Jin Huang , Xingjian Zhang , Jiaqi Ma

Knowledge Graph Question Answering (KGQA) is a crucial task in natural language processing that requires reasoning over knowledge graphs (KGs) to answer natural language questions. Recent methods utilizing large language models (LLMs) have…

Computation and Language · Computer Science 2025-06-12 Xiujun Zhou , Pingjian Zhang , Deyou Tang

This study delves into the capabilities and limitations of Large Language Models (LLMs) in the challenging domain of conditional question-answering. Utilizing the Conditional Question Answering (CQA) dataset and focusing on generative…

Computation and Language · Computer Science 2023-12-05 Syed-Amad Hussain , Parag Pravin Dakle , SaiKrishna Rallabandi , Preethi Raghavan

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding and generation across various domains, including medicine. We present a comprehensive evaluation of GPT-4, a state-of-the-art LLM, on…

Computation and Language · Computer Science 2023-04-13 Harsha Nori , Nicholas King , Scott Mayer McKinney , Dean Carignan , Eric Horvitz

Large language model (LLM)-based tools such as ChatGPT seem useful for classical programming assignments. The more specialized the field, the more likely they lack reliability because of the lack of data to train them. In the case of…

Computation and Language · Computer Science 2025-03-10 Yaiza Aragonés-Soria , Manuel Oriol

Recent studies have widely investigated backdoor attacks on Large Language Models (LLMs) by inserting harmful question-answer (QA) pairs into their training data. However, we revisit existing attacks and identify two critical limitations:…

Computation and Language · Computer Science 2025-10-07 Jiawei Kong , Hao Fang , Xiaochen Yang , Kuofeng Gao , Bin Chen , Shu-Tao Xia , Ke Xu , Han Qiu

Table Question Answering (TQA) aims to answer natural language questions about tabular data, often accompanied by additional contexts such as text passages. The task spans diverse settings, varying in table representation, question/answer…

Computation and Language · Computer Science 2026-04-21 Wei Zhou , Bolei Ma , Annemarie Friedrich , Mohsen Mesgar

The rapid advancement of large language models (LLMs) such as GPT-3, PaLM, and Llama has significantly transformed natural language processing, showcasing remarkable capabilities in understanding and generating language. However, a…

Computation and Language · Computer Science 2026-05-15 Yifan Zhang

Visual Question Answering (VQA) is the task of answering a question about an image and requires processing multimodal input and reasoning to obtain the answer. Modular solutions that use declarative representations within the reasoning…

Artificial Intelligence · Computer Science 2024-10-15 Thomas Eiter , Jan Hadl , Nelson Higuera , Johannes Oetsch

This paper presents our system for SemEval-2025 Task 8: DataBench, Question-Answering over Tabular Data. The primary objective of this task is to perform question answering on given tabular datasets from diverse domains under two subtasks:…

Computation and Language · Computer Science 2025-08-04 Atakan Site , Emre Hakan Erdemir , Gülşen Eryiğit

Open-domain question answering (QA) is the tasl of identifying answers to natural questions from a large corpus of documents. The typical open-domain QA system starts with information retrieval to select a subset of documents from the…

Computation and Language · Computer Science 2020-09-03 Sina J. Semnani , Manish Pandey

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

Computation and Language · Computer Science 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Nowadays, the explosion of unstructured data presents immense analytical value. Leveraging the remarkable capability of large language models (LLMs) in extracting attributes of structured tables from unstructured data, researchers are…

Open-Domain Question Answering (ODQA) aims to answer questions without explicitly providing specific background documents. This task becomes notably challenging in a zero-shot setting where no data is available to train tailored…

Computation and Language · Computer Science 2024-03-29 Junlong Li , Jinyuan Wang , Zhuosheng Zhang , Hai Zhao

Instruction tuning large language models (LLMs) remains a challenging task, owing to the complexity of hyperparameter selection and the difficulty involved in evaluating the tuned models. To determine the optimal hyperparameters, an…

Computation and Language · Computer Science 2024-05-27 Yidong Wang , Zhuohao Yu , Zhengran Zeng , Linyi Yang , Cunxiang Wang , Hao Chen , Chaoya Jiang , Rui Xie , Jindong Wang , Xing Xie , Wei Ye , Shikun Zhang , Yue Zhang

Structured data question answering (QA), including table QA, Knowledge Graph (KG) QA, and temporal KG QA, is a pivotal research area. Advances in large language models (LLMs) have driven significant progress in unified structural QA…

Computation and Language · Computer Science 2025-11-18 Yushan Zhu , Wen Zhang , Long Jin , Mengshu Sun , Ling Zhong , Zhiqiang Liu , Juan Li , Lei Liang , Chong Long , Chao Deng , Junlan Feng

Large Language Models (LLMs) have made significant progress in recent years, achieving remarkable results in question-answering tasks (QA). However, they still face two major challenges: hallucination and outdated information after the…