English
Related papers

Related papers: ITUNLP at SemEval-2025 Task 8: Question-Answering …

200 papers

While most generative models show achievements in image data generation, few are developed for tabular data generation. Recently, due to success of large language models (LLM) in diverse tasks, they have also been used for tabular data…

Machine Learning · Computer Science 2024-10-30 Dang Nguyen , Sunil Gupta , Kien Do , Thin Nguyen , Svetha Venkatesh

We present SemEval-2025 Task 5: LLMs4Subjects, a shared task on automated subject tagging for scientific and technical records in English and German using the GND taxonomy. Participants developed LLM-based systems to recommend top-k…

Computation and Language · Computer Science 2025-05-26 Jennifer D'Souza , Sameer Sadruddin , Holger Israel , Mathias Begoin , Diana Slawig

In this paper, we propose a novel prompting approach aimed at enhancing the ability of Large Language Models (LLMs) to generate accurate Python code. Specifically, we introduce a prompt template designed to improve the quality and…

Software Engineering · Computer Science 2025-06-16 Rogelio Cruz , Jonatan Contreras , Francisco Guerrero , Ezequiel Rodriguez , Carlos Valdez , Citlali Carrillo

In this work, we evaluate 10 open-source instructed LLMs on four representative code comprehension and generation tasks. We have the following main findings. First, for the zero-shot setting, instructed LLMs are very competitive on code…

Computation and Language · Computer Science 2023-08-03 Zhiqiang Yuan , Junwei Liu , Qiancheng Zi , Mingwei Liu , Xin Peng , Yiling Lou

Large language models (LLMs) have shown remarkable capabilities in code translation, yet their performance deteriorates in low-resource programming domains such as Fortran and emerging frameworks like CUDA, where high-quality parallel data…

Programming Languages · Computer Science 2025-12-04 Le Chen , Nuo Xu , Winson Chen , Bin Lei , Pei-Hung Lin , Dunzhi Zhou , Rajeev Thakur , Caiwen Ding , Ali Jannesari , Chunhua Liao

Recent work has shown that fine-tuning large language models (LLMs) on large-scale instruction-following datasets substantially improves their performance on a wide range of NLP tasks, especially in the zero-shot setting. However, even…

Computation and Language · Computer Science 2023-05-19 Kai Zhang , Bernal Jiménez Gutiérrez , Yu Su

Tabular data is prevalent across various industries, necessitating significant time and effort for users to understand and manipulate for their information-seeking purposes. The advancements in large language models (LLMs) have shown…

Computation and Language · Computer Science 2023-11-01 Yilun Zhao , Haowei Zhang , Shengyun Si , Linyong Nan , Xiangru Tang , Arman Cohan

As the Large Language Model (LLM) gains widespread adoption, increasing attention has been given to the challenge of making LLM forget non-compliant data memorized during its pre-training. Machine Unlearning focuses on efficiently erasing…

Computation and Language · Computer Science 2025-08-19 Yujian Sun , Tian Li

Large Language models (LLMs) have achieved encouraging results in tabular data generation. However, existing approaches require fine-tuning, which is computationally expensive. This paper explores an alternative: prompting a fixed LLM with…

Machine Learning · Computer Science 2025-02-25 Liancheng Fang , Aiwei Liu , Hengrui Zhang , Henry Peng Zou , Weizhi Zhang , Philip S. Yu

The task of condensing large chunks of textual information into concise and structured tables has gained attention recently due to the emergence of Large Language Models (LLMs) and their potential benefit for downstream tasks, such as text…

Computation and Language · Computer Science 2024-12-06 Zheye Deng , Chunkit Chan , Weiqi Wang , Yuxi Sun , Wei Fan , Tianshi Zheng , Yauwai Yim , Yangqiu Song

Reliable data quality is crucial for downstream analysis of tabular datasets, yet rule-based validation often struggles with inefficiency, human intervention, and high computational costs. We present a three-stage framework that combines…

Software Engineering · Computer Science 2025-09-23 Ashlesha Akella , Akshar Kaul , Krishnasuri Narayanam , Sameep Mehta

Table Question Answering (TableQA) poses a significant challenge for large language models (LLMs) because conventional linearization of tables often disrupts the two-dimensional relationships intrinsic to structured data. Existing methods,…

Computation and Language · Computer Science 2026-02-03 Seho Pyo , Jiheon Seok , Jaejin Lee

Large Language Models (LLMs) have demonstrated strong capabilities in transforming text descriptions or tables to data visualizations via instruction-tuning methods. However, it is not straightforward to apply these methods directly for a…

Computation and Language · Computer Science 2025-08-28 Akriti Jain , Pritika Ramu , Aparna Garimella , Apoorv Saxena

The generation of large, high-quality datasets for code understanding and generation remains a significant challenge, particularly when aligning decompiled binaries with their original source code. To address this, we present CodableLLM, a…

Software Engineering · Computer Science 2025-07-31 Dylan Manuel , Paul Rad

Generating realistic synthetic tabular data presents a critical challenge in machine learning. It adds another layer of complexity when this data contain class imbalance problems. This paper presents a novel token-aware data imputation…

Machine Learning · Computer Science 2025-06-05 Shreenidhi Srinivasan , Lydia Manikonda

We present our submission to the Task 5 of SemEval-2025 that aims to aid librarians in assigning subject tags to the library records by producing a list of likely relevant tags for a given document. We frame the task as an information…

Computation and Language · Computer Science 2025-05-01 Aleksei Dorkin , Kairit Sirts

Understanding how news narratives frame entities is crucial for studying media's impact on societal perceptions of events. In this paper, we evaluate the zero-shot capabilities of large language models (LLMs) in classifying framing roles.…

Computation and Language · Computer Science 2025-04-30 Enfa Fane , Mihai Surdeanu , Eduardo Blanco , Steven R. Corman

This paper presents DataSciBench, a comprehensive benchmark for evaluating Large Language Model (LLM) capabilities in data science. Recent related benchmarks have primarily focused on single tasks, easily obtainable ground truth, and…

Computation and Language · Computer Science 2025-02-20 Dan Zhang , Sining Zhoubian , Min Cai , Fengzu Li , Lekang Yang , Wei Wang , Tianjiao Dong , Ziniu Hu , Jie Tang , Yisong Yue

Table reasoning, including tabular QA and fact verification, often depends on annotated data or complex data augmentation, limiting flexibility and generalization. LLMs, despite their versatility, often underperform compared to simple…

Artificial Intelligence · Computer Science 2025-11-19 Yiran Rex Ma

We introduce LeetCodeDataset, a high-quality benchmark for evaluating and training code-generation models, addressing two key challenges in LLM research: the lack of reasoning-focused coding benchmarks and self-contained training testbeds.…

Machine Learning · Computer Science 2025-04-22 Yunhui Xia , Wei Shen , Yan Wang , Jason Klein Liu , Huifeng Sun , Siyue Wu , Jian Hu , Xiaolong Xu