English
Related papers

Related papers: LyS at SemEval 2025 Task 8: Zero-Shot Code Generat…

200 papers

This paper summarizes Team SCaLAR's work on SemEval-2024 Task 5: Legal Argument Reasoning in Civil Procedure. To address this Binary Classification task, which was daunting due to the complexity of the Legal Texts involved, we propose a…

Computation and Language · Computer Science 2024-07-03 M Manvith Prabhu , Haricharana Srinivasa , Anand Kumar M

Understanding how news narratives frame entities is crucial for studying media's impact on societal perceptions of events. In this paper, we evaluate the zero-shot capabilities of large language models (LLMs) in classifying framing roles.…

Computation and Language · Computer Science 2025-04-30 Enfa Fane , Mihai Surdeanu , Eduardo Blanco , Steven R. Corman

We describe our system for SemEval-2026 Task 8 (MTRAGEval), participating in Task A (Retrieval) across four English-language domains. Our approach employs a three-stage pipeline: (1) query rewriting via a LoRA-fine-tuned Qwen 2.5 7B model…

Computation and Language · Computer Science 2026-05-13 David-Maximilian Caraman , Gheorghe Cosmin Silaghi

Automated code generation is gaining significant importance in intelligent computer programming and system deployment. However, current approaches often face challenges in computational efficiency and lack robust mechanisms for code parsing…

Software Engineering · Computer Science 2025-06-24 Muntasir Adnan , Zhiwei Xu , Carlos C. N. Kuhn

Hybrid tabular-textual question answering (QA) requires reasoning from heterogeneous information, and the types of reasoning are mainly divided into numerical reasoning and span extraction. Current numerical reasoning methods…

Computation and Language · Computer Science 2023-10-16 Tengxun Zhang , Hongfei Xu , Josef van Genabith , Deyi Xiong , Hongying Zan

Large language models (LLMs) are very proficient text generators. We leverage this capability of LLMs to generate task-specific data via zero-shot prompting and promote cross-lingual transfer for low-resource target languages. Given…

Computation and Language · Computer Science 2024-07-16 Barah Fazili , Ashish Sunil Agrawal , Preethi Jyothi

The BioNLP ACL'24 Shared Task on Streamlining Discharge Documentation aims to reduce the administrative burden on clinicians by automating the creation of critical sections of patient discharge letters. This paper presents our approach…

Computation and Language · Computer Science 2024-06-28 Rui Guo , Greg Farnan , Niall McLaughlin , Barry Devereux

We introduce a large language model (LLM) based approach to answer complex questions requiring multi-hop numerical reasoning over financial reports. While LLMs have exhibited remarkable performance on various natural language and reasoning…

Computation and Language · Computer Science 2023-11-28 Karmvir Singh Phogat , Chetan Harsha , Sridhar Dasaratha , Shashishekar Ramakrishna , Sai Akhil Puranam

Building a semantic parser quickly in a new domain is a fundamental challenge for conversational interfaces, as current semantic parsers require expensive supervision and lack the ability to generalize to new domains. In this paper, we…

Computation and Language · Computer Science 2018-09-25 Jonathan Herzig , Jonathan Berant

This work proposes a training-free approach for the detection of LLMs-generated codes, mitigating the risks associated with their indiscriminate usage. To the best of our knowledge, our research is the first to investigate zero-shot…

Computation and Language · Computer Science 2023-10-10 Xianjun Yang , Kexun Zhang , Haifeng Chen , Linda Petzold , William Yang Wang , Wei Cheng

Today, large language models (LLMs) are taught to use new tools by providing a few demonstrations of the tool's usage. Unfortunately, demonstrations are hard to acquire, and can result in undesirable biased usage if the wrong demonstration…

Computation and Language · Computer Science 2023-08-02 Cheng-Yu Hsieh , Si-An Chen , Chun-Liang Li , Yasuhisa Fujii , Alexander Ratner , Chen-Yu Lee , Ranjay Krishna , Tomas Pfister

Zero-shot Visual Question Answering (VQA) is a prominent vision-language task that examines both the visual and textual understanding capability of systems in the absence of training data. Recently, by converting the images into captions,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yunshi Lan , Xiang Li , Xin Liu , Yang Li , Wei Qin , Weining Qian

In this work, we address question answering (QA) over a hybrid of tabular and textual data that are very common content on the Web (e.g. SEC filings), where discrete reasoning capabilities are often required. Recently, large language models…

Computation and Language · Computer Science 2024-10-01 Fengbin Zhu , Ziyang Liu , Fuli Feng , Chao Wang , Moxin Li , Tat-Seng Chua

This work investigates the use of natural language to enable zero-shot model adaptation to new tasks. We use text and metadata from social commenting platforms as a source for a simple pretraining task. We then provide the language model…

Computation and Language · Computer Science 2019-12-24 Raul Puri , Bryan Catanzaro

We describe the University of Amsterdam Intelligent Data Engineering Lab team's entry for the SemEval-2024 Task 6 competition. The SHROOM-INDElab system builds on previous work on using prompt programming and in-context learning with large…

Computation and Language · Computer Science 2024-04-08 Bradley P. Allen , Fina Polat , Paul Groth

In this paper, we focus on task-specific question answering (QA). To this end, we introduce a method for generating exhaustive and high-quality training data, which allows us to train compact (e.g., run on a mobile device), task-specific QA…

Computation and Language · Computer Science 2024-01-25 Hai X. Pham , Isma Hadji , Xinnuo Xu , Ziedune Degutyte , Jay Rainey , Evangelos Kazakos , Afsaneh Fazly , Georgios Tzimiropoulos , Brais Martinez

Recent studies have demonstrated the great potential of Large Language Models (LLMs) serving as zero-shot relevance rankers. The typical approach involves making comparisons between pairs or lists of documents. Although effective, these…

Information Retrieval · Computer Science 2023-11-06 Weiwei Sun , Zheng Chen , Xinyu Ma , Lingyong Yan , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren

Despite progress in automated fact-checking, most systems require a significant amount of labeled training data, which is expensive. In this paper, we propose a novel zero-shot method, which instead of operating directly on the claim and…

Computation and Language · Computer Science 2023-12-20 Zhangdie Yuan , Andreas Vlachos

Constructing large-scale datasets for the GitHub issue resolution task is crucial for both training and evaluating the software engineering capabilities of Large Language Models (LLMs). However, the existing GitHub issue resolution data…

Software Engineering · Computer Science 2026-01-06 Lianghong Guo , Yanlin Wang , Caihua Li , Wei Tao , Pengyu Yang , Jiachi Chen , Haoyu Song , Duyu Tang , Zibin Zheng

The Large Language Models (LLMs) exhibit remarkable ability to generate fluent content across a wide spectrum of user queries. However, this capability has raised concerns regarding misinformation and personal information leakage. In this…