English
Related papers

Related papers: How well do Large Language Models Recognize Instru…

200 papers

Recent work has shown that fine-tuning large language models (LLMs) on large-scale instruction-following datasets substantially improves their performance on a wide range of NLP tasks, especially in the zero-shot setting. However, even…

Computation and Language · Computer Science 2023-05-19 Kai Zhang , Bernal Jiménez Gutiérrez , Yu Su

This paper investigates various approaches using Large Language Models (LLMs) to identify gaps and misconceptions in students' self-explanations of specific instructional material, in our case explanations of code examples. This research is…

Computers and Society · Computer Science 2025-01-22 Priti Oli , Rabin Banjade , Andrew M. Olney , Vasile Rus

Instruction-tuned Language Models (ILMs) have become essential components of modern AI systems, demonstrating exceptional versatility across natural language and reasoning tasks. Among their most impactful applications is code generation,…

Software Engineering · Computer Science 2026-02-18 Zaiyu Cheng , Antonio Mastropaolo

Large Vision-Language Models (VLMs) are increasingly being regarded as foundation models that can be instructed to solve diverse tasks by prompting, without task-specific training. We examine the seemingly obvious question: how to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Niccolo Avogaro , Thomas Frick , Mattia Rigotti , Andrea Bartezzaghi , Filip Janicki , Cristiano Malossi , Konrad Schindler , Roy Assaf

The emerging zero-shot capabilities of Large Language Models (LLMs) have led to their applications in areas extending well beyond natural language processing tasks. In reinforcement learning, while LLMs have been extensively used in…

Large Language Models (LLMs) have remarkable capabilities across NLP tasks. However, their performance in multilingual contexts, especially within the mental health domain, has not been thoroughly explored. In this paper, we evaluate…

Computation and Language · Computer Science 2026-02-03 Nishat Raihan , Sadiya Sayara Chowdhury Puspo , Ana-Maria Bucur , Stevie Chancellor , Marcos Zampieri

Large language models (LLMs) are known to effectively perform tasks by simply observing few exemplars. However, in low-resource languages, obtaining such hand-picked exemplars can still be challenging, where unsupervised techniques may be…

Computation and Language · Computer Science 2024-07-22 Xuan-Phi Nguyen , Sharifah Mahani Aljunied , Shafiq Joty , Lidong Bing

Large language models (LLMs) are widely used as zero-shot and few-shot classifiers, where task behaviour is largely controlled through prompting. A growing number of works have observed that LLMs are sensitive to prompt variations, with…

Computation and Language · Computer Science 2026-02-05 Branislav Pecher , Michal Spiegel , Robert Belanec , Jan Cegin

Finetuning language models on a collection of datasets phrased as instructions has been shown to improve model performance and generalization to unseen tasks. In this paper we explore instruction finetuning with a particular focus on (1)…

While Large Language Models (LLMs) are fundamentally next-token prediction systems, their practical applications extend far beyond this basic function. From natural language processing and text generation to conversational assistants and…

Computation and Language · Computer Science 2025-03-10 Vishakha Agrawal , Archie Chaudhury , Shreya Agrawal

Large Language Models (LLMs) can reason over natural-language inputs, but their role in intrusion detection without fine-tuning remains uncertain. This study evaluates a prompt-only approach on UNSW-NB15 by converting each network flow to a…

Cryptography and Security · Computer Science 2025-10-28 Mohammad Abdul Rehman , Syed Imad Ali Shah , Abbas Anwar , Noor Islam

We explore the feasibility of large language models (LLMs) in detecting subtle expressions of micro-behaviors in team conversations using transcripts collected during simulated space missions. Specifically, we examine zero-shot…

Computation and Language · Computer Science 2025-07-01 Ankush Raut , Projna Paromita , Sydney Begerowski , Suzanne Bell , Theodora Chaspari

The use of Large Language Models (LLMs) has drawn growing interest within the scientific community. LLMs can handle large volumes of textual data and support methods for evidence synthesis. Although recent studies highlight the potential of…

Software Engineering · Computer Science 2026-02-12 Cauã Ferreira Barros , Marcos Kalinowski , Mohamad Kassab , Valdemar Vicente Graciano Neto

Large Language Models (LLMs), originally developed for natural language processing (NLP), have demonstrated the potential to generalize across modalities and domains. With their in-context learning (ICL) capabilities, LLMs can perform…

Artificial Intelligence · Computer Science 2025-08-26 Nikolaos Pavlidis , Vasilis Perifanis , Symeon Symeonidis , Pavlos S. Efraimidis

Recent advancements in the field of Natural Language Processing, particularly the development of large-scale language models that are pretrained on vast amounts of knowledge, are creating novel opportunities within the realm of Knowledge…

Computation and Language · Computer Science 2023-10-06 Anisa Rula , Jennifer D'Souza

The rapid integration of Large Language Models (LLMs) into software engineering practice is reshaping how software testing activities are performed. LLMs are increasingly used to support software testing. Consequently, software testing…

Software Engineering · Computer Science 2026-03-30 Peng Yang , Yunfeng Zhu , Chao Chang , Shengcheng Yu , Zhenyu Chen , Yong Tang

Despite widespread deployment of Large Language Models, systematic evaluation of instruction-following capabilities remains challenging. While comprehensive benchmarks exist, focused assessments that quickly diagnose specific instruction…

Computation and Language · Computer Science 2025-10-23 Richard J. Young , Brandon Gillins , Alice M. Matthews

Understanding how news narratives frame entities is crucial for studying media's impact on societal perceptions of events. In this paper, we evaluate the zero-shot capabilities of large language models (LLMs) in classifying framing roles.…

Computation and Language · Computer Science 2025-04-30 Enfa Fane , Mihai Surdeanu , Eduardo Blanco , Steven R. Corman

Large language models (LLMs) are very proficient text generators. We leverage this capability of LLMs to generate task-specific data via zero-shot prompting and promote cross-lingual transfer for low-resource target languages. Given…

Computation and Language · Computer Science 2024-07-16 Barah Fazili , Ashish Sunil Agrawal , Preethi Jyothi

Large language models (LLMs) have demonstrated remarkable capabilities in code-related tasks, particularly in automated program repair. However, the effectiveness of such repairs is highly dependent on the performance of upstream fault…

Software Engineering · Computer Science 2025-10-24 YingJian Xiao , RongQun Hu , WeiWei Gong , HongWei Li , AnQuan Jie