English
Related papers

Related papers: A Simple and Effective Framework for Strict Zero-S…

200 papers

Large language models (LLMs) provide powerful means to leverage prior knowledge for predictive modeling when data is limited. In this work, we demonstrate how LLMs can use their compressed world knowledge to generate intrinsically…

We study the application of large language models to zero-shot and few-shot classification of tabular data. We prompt the large language model with a serialization of the tabular data to a natural-language string, together with a short…

Computation and Language · Computer Science 2023-03-20 Stefan Hegselmann , Alejandro Buendia , Hunter Lang , Monica Agrawal , Xiaoyi Jiang , David Sontag

Large language models (LLMs) are increasingly used as automated judges to evaluate recommendation systems, search engines, and other subjective tasks, where relying on human evaluators can be costly, time-consuming, and unscalable. LLMs…

Computation and Language · Computer Science 2025-02-10 Gerrit J. J. van den Burg , Gen Suzuki , Wei Liu , Murat Sensoy

Current developments in large language models (LLMs) have enabled impressive zero-shot capabilities across various natural language tasks. An interesting application of these systems is in the automated assessment of natural language…

Computation and Language · Computer Science 2024-02-07 Adian Liusie , Potsawee Manakul , Mark J. F. Gales

Zero-shot inference is a powerful paradigm that enables the use of large pretrained models for downstream classification tasks without further training. However, these models are vulnerable to inherited biases that can impact their…

Machine Learning · Computer Science 2024-02-13 Dyah Adila , Changho Shin , Linrong Cai , Frederic Sala

We propose a novel zero-shot document ranking approach based on Large Language Models (LLMs): the Setwise prompting approach. Our approach complements existing prompting approaches for LLM-based zero-shot ranking: Pointwise, Pairwise, and…

Information Retrieval · Computer Science 2024-05-31 Shengyao Zhuang , Honglei Zhuang , Bevan Koopman , Guido Zuccon

Large Language Models revolutionized NLP and showed dramatic performance improvements across several tasks. In this paper, we investigated the role of such language models in text classification and how they compare with other approaches…

Computation and Language · Computer Science 2025-02-21 Sowmya Vajjala , Shwetali Shimangaud

Large language models have recently reached near-parity with classical planners on well-known planning domains, yet this competence relies on world-knowledge exploitation rather than genuine symbolic reasoning. Goal recognition is a…

Artificial Intelligence · Computer Science 2026-05-18 Kin Max Piamolini Gusmão , Nathan Gavenski , Nir Oren , Felipe Meneguzzi

We introduce a large language model (LLM) based approach to answer complex questions requiring multi-hop numerical reasoning over financial reports. While LLMs have exhibited remarkable performance on various natural language and reasoning…

Computation and Language · Computer Science 2023-11-28 Karmvir Singh Phogat , Chetan Harsha , Sridhar Dasaratha , Shashishekar Ramakrishna , Sai Akhil Puranam

Large Language Models (LLMs) have shown useful applications in a variety of tasks, including data wrangling. In this paper, we investigate the use of an off-the-shelf LLM for schema matching. Our objective is to identify semantic…

Databases · Computer Science 2024-07-17 Marcel Parciak , Brecht Vandevoort , Frank Neven , Liesbet M. Peeters , Stijn Vansummeren

Large language models (LLMs) struggle with precise length control, particularly in zero-shot settings. We conduct a comprehensive study evaluating LLMs' length control capabilities across multiple measures and propose practical methods to…

Computation and Language · Computer Science 2025-02-12 Fabian Retkowski , Alexander Waibel

Large Language Models (LLMs) have demonstrated remarkable capabilities in handling long texts and have almost perfect performance in traditional retrieval tasks. However, their performance significantly degrades when it comes to numerical…

Computation and Language · Computer Science 2024-12-05 Yijiong Yu

Understanding how news narratives frame entities is crucial for studying media's impact on societal perceptions of events. In this paper, we evaluate the zero-shot capabilities of large language models (LLMs) in classifying framing roles.…

Computation and Language · Computer Science 2025-04-30 Enfa Fane , Mihai Surdeanu , Eduardo Blanco , Steven R. Corman

This paper presents novel benchmarks for evaluating vision-language models (VLMs) in zero-shot recognition, focusing on granularity and specificity. Although VLMs excel in tasks like image captioning, they face challenges in open-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhenlin Xu , Yi Zhu , Tiffany Deng , Abhay Mittal , Yanbei Chen , Manchen Wang , Paolo Favaro , Joseph Tighe , Davide Modolo

Traditional dataset retrieval systems rely on metadata for indexing, rather than on the underlying data values. However, high-quality metadata creation and enrichment often require manual annotations, which is a labour-intensive and…

Databases · Computer Science 2024-09-09 Margherita Martorana , Tobias Kuhn , Lise Stork , Jacco van Ossenbruggen

Large Language Models (LLMs) have shown impressive zero-shot performance across a variety of Natural Language Processing tasks, including document re-ranking. However, their effectiveness degrades on unseen tasks and domains, largely due to…

Information Retrieval · Computer Science 2025-05-02 Marco Braga , Pranav Kasela , Alessandro Raganato , Gabriella Pasi

Large Language Models (LLMs), with their remarkable ability to tackle challenging and unseen reasoning problems, hold immense potential for tabular learning, that is vital for many real-world applications. In this paper, we propose a novel…

Machine Learning · Computer Science 2024-05-07 Sungwon Han , Jinsung Yoon , Sercan O Arik , Tomas Pfister

Today's large language models (LLMs) typically train on short text segments (e.g., <4K tokens) due to the quadratic complexity of their Transformer architectures. As a result, their performance suffers drastically on inputs longer than…

Computation and Language · Computer Science 2024-06-26 Chi Han , Qifan Wang , Hao Peng , Wenhan Xiong , Yu Chen , Heng Ji , Sinong Wang

Domain-specific knowledge can significantly contribute to addressing a wide variety of vision tasks. However, the generation of such knowledge entails considerable human labor and time costs. This study investigates the potential of Large…

The emerging zero-shot capabilities of Large Language Models (LLMs) have led to their applications in areas extending well beyond natural language processing tasks. In reinforcement learning, while LLMs have been extensively used in…