English
Related papers

Related papers: LyS at SemEval 2025 Task 8: Zero-Shot Code Generat…

200 papers

This paper presents our system for SemEval-2025 Task 8: DataBench, Question-Answering over Tabular Data. The primary objective of this task is to perform question answering on given tabular datasets from diverse domains under two subtasks:…

Computation and Language · Computer Science 2025-08-04 Atakan Site , Emre Hakan Erdemir , Gülşen Eryiğit

This paper presents a system developed for SemEval 2025 Task 8: Question Answering (QA) over tabular data. Our approach integrates several key components: text-to-SQL and text-to-code generation modules, a self-correction mechanism, and a…

Computation and Language · Computer Science 2025-06-17 Nikolas Evkarpidi , Elena Tutubalina

In this paper we expose our approach to solve the \textit{SemEval 2025 Task 8: Question-Answering over Tabular Data} challenge. Our strategy leverages Python code generation with LLMs to interact with the table and get the answer to the…

This study investigates the performance of the zero-shot method in classifying data using three large language models, alongside two models with large input token sizes and the two pre-trained models on legal data. Our main dataset comes…

Computation and Language · Computer Science 2024-06-25 Hoorieh Sabzevari , Mohammadmostafa Rostamkhani , Sauleh Eetemadi

In this paper, we present our submission to SemEval-2025 Task 8: Question Answering over Tabular Data. This task, evaluated on the DataBench dataset, assesses Large Language Models' (LLMs) ability to answer natural language questions over…

Computation and Language · Computer Science 2025-08-04 Andreas Evangelatos , Giorgos Filandrianos , Maria Lymperaiou , Athanasios Voulodimos , Giorgos Stamou

With the rapid development in Transformer-based language models, the reading comprehension tasks on short documents and simple questions have been largely addressed. Long documents, specifically the scientific documents that are densely…

Information Retrieval · Computer Science 2025-03-05 Wanting Wang

Large Language Models (LLMs) have demonstrated remarkable abilities across various tasks, leveraging advanced reasoning. Yet, they struggle with task-oriented prompts due to a lack of specific prior knowledge of the task answers. The…

Software Engineering · Computer Science 2024-09-26 Chung-Yu Wang , Alireza DaghighFarsoodeh , Hung Viet Pham

Recent breakthroughs in large language models (LLMs) have opened the door to in-depth investigation of their potential in tabular data modeling. However, effectively utilizing advanced LLMs in few-shot and even zero-shot scenarios is still…

Machine Learning · Computer Science 2025-08-14 Peng Wang , Dongsheng Wang , He Zhao , Hangting Ye , Dandan Guo , Yi Chang

We explore the use of large language models (LLMs) for zero-shot semantic parsing. Semantic parsing involves mapping natural language utterances to task-specific meaning representations. Language models are generally trained on the publicly…

Computation and Language · Computer Science 2022-12-22 Dheeraj Mekala , Jason Wolfe , Subhro Roy

Error detection (ED) in tabular data is crucial yet challenging due to diverse error types and the need for contextual understanding. Traditional ED methods often rely heavily on manual criteria and labels, making them labor-intensive.…

Machine Learning · Computer Science 2025-04-09 Wei Ni , Kaihang Zhang , Xiaoye Miao , Xiangyu Zhao , Yangyang Wu , Yaoshu Wang , Jianwei Yin

We propose a simple method to generate multilingual question and answer pairs on a large scale through the use of a single generative model. These synthetic samples can be used to improve the zero-shot performance of multilingual QA models…

Computation and Language · Computer Science 2021-06-01 Siamak Shakeri , Noah Constant , Mihir Sanjay Kale , Linting Xue

This paper presents the participation of team QUST in Task 8 SemEval 2024. We first performed data augmentation and cleaning on the dataset to enhance model training efficiency and accuracy. In the monolingual task, we evaluated traditional…

Computation and Language · Computer Science 2024-02-20 Xiaoman Xu , Xiangrun Li , Taihang Wang , Jianxiang Tian , Ye Jiang

This paper presents an empirical study of a multi-model zero-shot pipeline for knowledge graph construction and exploitation, executed entirely through local inference on consumer-grade hardware. We propose a reproducible evaluation…

Artificial Intelligence · Computer Science 2026-04-14 Pierre Jourlin

This paper describes the KCLarity team's participation in CLARITY, a shared task at SemEval 2026 on classifying ambiguity and evasion techniques in political discourse. We investigate two modelling formulations: (i) directly predicting the…

Computation and Language · Computer Science 2026-04-15 Archie Sage , Salvatore Greco

Current social science efforts automatically populate event databases of "who did what to whom?" tuples, by applying event extraction (EE) to text such as news. The event databases are used to analyze sociopolitical dynamics between actor…

Computation and Language · Computer Science 2024-06-04 Erica Cai , Brendan O'Connor

Efficient processing of tabular data is important in various industries, especially when working with datasets containing a large number of columns. Large language models (LLMs) have demonstrated their ability on several tasks through…

Machine Learning · Computer Science 2024-08-22 Ashlesha Akella , Abhijit Manatkar , Brij Chavda , Hima Patel

Automatically inducing high quality knowledge graphs from a given collection of documents still remains a challenging problem in AI. One way to make headway for this problem is through advancements in a related task known as slot filling.…

Computation and Language · Computer Science 2021-09-15 Michael Glass , Gaetano Rossiello , Md Faisal Mahbub Chowdhury , Alfio Gliozzo

In this paper, we propose a novel prompting approach aimed at enhancing the ability of Large Language Models (LLMs) to generate accurate Python code. Specifically, we introduce a prompt template designed to improve the quality and…

Software Engineering · Computer Science 2025-06-16 Rogelio Cruz , Jonatan Contreras , Francisco Guerrero , Ezequiel Rodriguez , Carlos Valdez , Citlali Carrillo

Question Answering over Tabular Data (Table QA) presents unique challenges due to the diverse structure, size, and data types of real-world tables. The SemEval 2025 Task 8 (DataBench) introduced a benchmark composed of large-scale,…

Computation and Language · Computer Science 2025-09-12 Rishit Tyagi , Mohit Gupta , Rahul Bouri

Due to the textual and repetitive nature of many Requirements Engineering (RE) artefacts, Large Language Models (LLMs) have proven useful to automate their generation and processing. In this paper, we discuss a possible approach for…

Software Engineering · Computer Science 2026-04-27 Anna Arnaudo , Riccardo Coppola , Maurizio Morisio , Flavio Giobergia , Andrea Bioddo , Angelo Bongiorno , Luca Dadone
‹ Prev 1 2 3 10 Next ›