English
Related papers

Related papers: LyS at SemEval 2025 Task 8: Zero-Shot Code Generat…

200 papers

Although large language models(LLMs) show amazing capabilities, among various exciting applications discovered for LLMs fall short in other low-resource languages. Besides, most existing methods depend on large-scale dialogue corpora and…

Computation and Language · Computer Science 2024-08-19 Yongkang Liu , Feng Shi , Daling Wang , Yifei Zhang , Hinrich Schütze

This paper introduces a code generator designed for node-level optimized, extreme-scalable, matrix-free finite element operators on hybrid tetrahedral grids. It optimizes the local evaluation of bilinear forms through various techniques…

Computational Engineering, Finance, and Science · Computer Science 2024-04-15 Fabian Böhm , Daniel Bauer , Nils Kohl , Christie Alappat , Dominik Thönnes , Marcus Mohr , Harald Köstler , Ulrich Rüde

Incorporating external knowledge to Visual Question Answering (VQA) has become a vital practical need. Existing methods mostly adopt pipeline approaches with different components for knowledge matching and extraction, feature learning,…

Artificial Intelligence · Computer Science 2021-10-19 Zhuo Chen , Jiaoyan Chen , Yuxia Geng , Jeff Z. Pan , Zonggang Yuan , Huajun Chen

The claim matching (CM) task can benefit an automated fact-checking pipeline by putting together claims that can be resolved with the same fact-check. In this work, we are the first to explore zero-shot and few-shot learning approaches to…

Computation and Language · Computer Science 2025-03-04 Dina Pisarevskaya , Arkaitz Zubiaga

We discuss the design and software implementation of a nuclear data evaluation pipeline applied for a fully reproducible evaluation of neutron-induced cross sections of $^{56}$Fe above the resolved resonance region using the nuclear model…

Data Analysis, Statistics and Probability · Physics 2021-05-07 Georg Schnabel , Henrik Sjöstrand , Joachim Hansson , Dimitri Rochman , Arjan Koning , Roberto Capote

This study evaluates the performance of Large Language Models (LLMs) on SemEval-2020 Task 4 dataset, focusing on commonsense validation and explanation. Our methodology involves evaluating multiple LLMs, including LLaMA3-70B, Gemma2-9B, and…

Computation and Language · Computer Science 2025-02-25 Rawand Alfugaha , Mohammad AL-Smadi

Table Question Answering (TableQA) poses a significant challenge for large language models (LLMs) because conventional linearization of tables often disrupts the two-dimensional relationships intrinsic to structured data. Existing methods,…

Computation and Language · Computer Science 2026-02-03 Seho Pyo , Jiheon Seok , Jaejin Lee

With the growing use of Large Language Model (LLM)-based Question-Answering (QA) systems in education, it is critical to evaluate their performance across individual pipeline components. In this work, we introduce {\model}, a modular…

Computation and Language · Computer Science 2025-12-01 Meenakshi Mittal , Rishi Khare , Mihran Miroyan , Chancharik Mitra , Narges Norouzi

Medical image segmentation is vital for clinical diagnosis, yet current deep learning methods often demand extensive expert effort, i.e., either through annotating large training datasets or providing prompts at inference time for each new…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Xingjian Li , Qifeng Wu , Adithya S. Ubaradka , Yiran Ding , Colleen Que , Runmin Jiang , Jianhua Xing , Tianyang Wang , Min Xu

We consider a zero-shot semantic parsing task: parsing instructions into compositional logical forms, in domains that were not seen during training. We present a new dataset with 1,390 examples from 7 application domains (e.g. a calendar or…

Computation and Language · Computer Science 2019-11-21 Ofer Givoli , Roi Reichart

Prompting strategies affect LLM reasoning performance, but their role in chart-based QA remains underexplored. We present a systematic evaluation of four widely used prompting paradigms (Zero-Shot, Few-Shot, Zero-Shot Chain-of-Thought, and…

Computation and Language · Computer Science 2026-03-25 Ruthuparna Naikar , Ying Zhu

In this paper, we propose Docprompt for document question answering tasks with powerful zero-shot and few-shot performance. We proposed a novel weakly supervised data generation method, a novel multl-stage training method and a novel…

Computation and Language · Computer Science 2023-09-01 Sijin Wu , Dan Zhang , Teng Hu , Shikun Feng

SemEval-2024 Task 8 is focused on multigenerator, multidomain, and multilingual black-box machine-generated text detection. Such a detection is important for preventing a potential misuse of large language models (LLMs), the newest of which…

Computation and Language · Computer Science 2024-06-18 Michal Spiegel , Dominik Macko

Query expansion, pivotal in search engines, enhances the representation of user information needs with additional terms. While existing methods expand queries using retrieved or generated contextual documents, each approach has notable…

Information Retrieval · Computer Science 2024-03-29 Pengyue Jia , Yiding Liu , Xiangyu Zhao , Xiaopeng Li , Changying Hao , Shuaiqiang Wang , Dawei Yin

Reliable data quality is crucial for downstream analysis of tabular datasets, yet rule-based validation often struggles with inefficiency, human intervention, and high computational costs. We present a three-stage framework that combines…

Software Engineering · Computer Science 2025-09-23 Ashlesha Akella , Akshar Kaul , Krishnasuri Narayanam , Sameep Mehta

We cast a suite of information extraction tasks into a text-to-triple translation framework. Instead of solving each task relying on task-specific datasets and models, we formalize the task as a translation between task-specific input text…

Computation and Language · Computer Science 2021-09-24 Chenguang Wang , Xiao Liu , Zui Chen , Haoyun Hong , Jie Tang , Dawn Song

Code generation is important in software engineering, and Reinforcement Learning with Verifiable Rewards (RLVR) is a powerful paradigm to improve it through execution-based feedback. However, most RLVR pipelines rely on human-curated tests,…

Software Engineering · Computer Science 2026-04-10 Lishui Fan , Mouxiang Chen , Tingwei Zhu , Kui Liu , Xin Xia , Shanping Li , Zhongxin Liu

Understanding complex multimodal documents remains challenging due to their structural inconsistencies and limited training data availability. We introduce \textit{DocsRay}, a training-free document understanding system that integrates…

Machine Learning · Computer Science 2025-08-01 Hyeon Seong Jeong , Sangwoo Jo , Byeong Hyun Yoon , Yoonseok Heo , Haedong Jeong , Taehoon Kim

Large language models (LLMs) have significantly advanced autonomous agents, particularly in zero-shot tool usage, also known as function calling. This research delves into enhancing the function-calling capabilities of LLMs by exploring…

Computation and Language · Computer Science 2024-12-05 Yi-Chang Chen , Po-Chun Hsu , Chan-Jan Hsu , Da-shan Shiu

Zero-shot information extraction (IE) aims to build IE systems from the unannotated text. It is challenging due to involving little human intervention. Challenging but worthwhile, zero-shot IE reduces the time and effort that data labeling…

Computation and Language · Computer Science 2024-05-28 Xiang Wei , Xingyu Cui , Ning Cheng , Xiaobin Wang , Xin Zhang , Shen Huang , Pengjun Xie , Jinan Xu , Yufeng Chen , Meishan Zhang , Yong Jiang , Wenjuan Han