中文
相关论文

相关论文: ITUNLP at SemEval-2025 Task 8: Question-Answering …

200 篇论文

While most generative models show achievements in image data generation, few are developed for tabular data generation. Recently, due to success of large language models (LLM) in diverse tasks, they have also been used for tabular data…

机器学习 · 计算机科学 2024-10-30 Dang Nguyen , Sunil Gupta , Kien Do , Thin Nguyen , Svetha Venkatesh

We present SemEval-2025 Task 5: LLMs4Subjects, a shared task on automated subject tagging for scientific and technical records in English and German using the GND taxonomy. Participants developed LLM-based systems to recommend top-k…

计算与语言 · 计算机科学 2025-05-26 Jennifer D'Souza , Sameer Sadruddin , Holger Israel , Mathias Begoin , Diana Slawig

In this paper, we propose a novel prompting approach aimed at enhancing the ability of Large Language Models (LLMs) to generate accurate Python code. Specifically, we introduce a prompt template designed to improve the quality and…

In this work, we evaluate 10 open-source instructed LLMs on four representative code comprehension and generation tasks. We have the following main findings. First, for the zero-shot setting, instructed LLMs are very competitive on code…

计算与语言 · 计算机科学 2023-08-03 Zhiqiang Yuan , Junwei Liu , Qiancheng Zi , Mingwei Liu , Xin Peng , Yiling Lou

Large language models (LLMs) have shown remarkable capabilities in code translation, yet their performance deteriorates in low-resource programming domains such as Fortran and emerging frameworks like CUDA, where high-quality parallel data…

编程语言 · 计算机科学 2025-12-04 Le Chen , Nuo Xu , Winson Chen , Bin Lei , Pei-Hung Lin , Dunzhi Zhou , Rajeev Thakur , Caiwen Ding , Ali Jannesari , Chunhua Liao

Recent work has shown that fine-tuning large language models (LLMs) on large-scale instruction-following datasets substantially improves their performance on a wide range of NLP tasks, especially in the zero-shot setting. However, even…

计算与语言 · 计算机科学 2023-05-19 Kai Zhang , Bernal Jiménez Gutiérrez , Yu Su

Tabular data is prevalent across various industries, necessitating significant time and effort for users to understand and manipulate for their information-seeking purposes. The advancements in large language models (LLMs) have shown…

计算与语言 · 计算机科学 2023-11-01 Yilun Zhao , Haowei Zhang , Shengyun Si , Linyong Nan , Xiangru Tang , Arman Cohan

As the Large Language Model (LLM) gains widespread adoption, increasing attention has been given to the challenge of making LLM forget non-compliant data memorized during its pre-training. Machine Unlearning focuses on efficiently erasing…

计算与语言 · 计算机科学 2025-08-19 Yujian Sun , Tian Li

Large Language models (LLMs) have achieved encouraging results in tabular data generation. However, existing approaches require fine-tuning, which is computationally expensive. This paper explores an alternative: prompting a fixed LLM with…

机器学习 · 计算机科学 2025-02-25 Liancheng Fang , Aiwei Liu , Hengrui Zhang , Henry Peng Zou , Weizhi Zhang , Philip S. Yu

The task of condensing large chunks of textual information into concise and structured tables has gained attention recently due to the emergence of Large Language Models (LLMs) and their potential benefit for downstream tasks, such as text…

计算与语言 · 计算机科学 2024-12-06 Zheye Deng , Chunkit Chan , Weiqi Wang , Yuxi Sun , Wei Fan , Tianshi Zheng , Yauwai Yim , Yangqiu Song

Reliable data quality is crucial for downstream analysis of tabular datasets, yet rule-based validation often struggles with inefficiency, human intervention, and high computational costs. We present a three-stage framework that combines…

软件工程 · 计算机科学 2025-09-23 Ashlesha Akella , Akshar Kaul , Krishnasuri Narayanam , Sameep Mehta

Table Question Answering (TableQA) poses a significant challenge for large language models (LLMs) because conventional linearization of tables often disrupts the two-dimensional relationships intrinsic to structured data. Existing methods,…

计算与语言 · 计算机科学 2026-02-03 Seho Pyo , Jiheon Seok , Jaejin Lee

Large Language Models (LLMs) have demonstrated strong capabilities in transforming text descriptions or tables to data visualizations via instruction-tuning methods. However, it is not straightforward to apply these methods directly for a…

计算与语言 · 计算机科学 2025-08-28 Akriti Jain , Pritika Ramu , Aparna Garimella , Apoorv Saxena

The generation of large, high-quality datasets for code understanding and generation remains a significant challenge, particularly when aligning decompiled binaries with their original source code. To address this, we present CodableLLM, a…

软件工程 · 计算机科学 2025-07-31 Dylan Manuel , Paul Rad

Generating realistic synthetic tabular data presents a critical challenge in machine learning. It adds another layer of complexity when this data contain class imbalance problems. This paper presents a novel token-aware data imputation…

机器学习 · 计算机科学 2025-06-05 Shreenidhi Srinivasan , Lydia Manikonda

We present our submission to the Task 5 of SemEval-2025 that aims to aid librarians in assigning subject tags to the library records by producing a list of likely relevant tags for a given document. We frame the task as an information…

计算与语言 · 计算机科学 2025-05-01 Aleksei Dorkin , Kairit Sirts

Understanding how news narratives frame entities is crucial for studying media's impact on societal perceptions of events. In this paper, we evaluate the zero-shot capabilities of large language models (LLMs) in classifying framing roles.…

计算与语言 · 计算机科学 2025-04-30 Enfa Fane , Mihai Surdeanu , Eduardo Blanco , Steven R. Corman

This paper presents DataSciBench, a comprehensive benchmark for evaluating Large Language Model (LLM) capabilities in data science. Recent related benchmarks have primarily focused on single tasks, easily obtainable ground truth, and…

计算与语言 · 计算机科学 2025-02-20 Dan Zhang , Sining Zhoubian , Min Cai , Fengzu Li , Lekang Yang , Wei Wang , Tianjiao Dong , Ziniu Hu , Jie Tang , Yisong Yue

Table reasoning, including tabular QA and fact verification, often depends on annotated data or complex data augmentation, limiting flexibility and generalization. LLMs, despite their versatility, often underperform compared to simple…

人工智能 · 计算机科学 2025-11-19 Yiran Rex Ma

We introduce LeetCodeDataset, a high-quality benchmark for evaluating and training code-generation models, addressing two key challenges in LLM research: the lack of reasoning-focused coding benchmarks and self-contained training testbeds.…

机器学习 · 计算机科学 2025-04-22 Yunhui Xia , Wei Shen , Yan Wang , Jason Klein Liu , Huifeng Sun , Siyue Wu , Jian Hu , Xiaolong Xu