English
Related papers

Related papers: Rationale-guided Prompting for Knowledge-based Vis…

200 papers

In recent years, large pre-trained language models (LLMs) have demonstrated the ability to follow instructions and perform novel tasks from a few examples. The possibility to parameterise an LLM through such in-context examples widens their…

Machine Learning · Computer Science 2023-05-10 Imanol Schlag , Sainbayar Sukhbaatar , Asli Celikyilmaz , Wen-tau Yih , Jason Weston , Jürgen Schmidhuber , Xian Li

Large Language Models (LLMs) are important tools for reasoning and problem-solving, while they often operate passively, answering questions without actively discovering new ones. This limitation reduces their ability to simulate human-like…

Computational Engineering, Finance, and Science · Computer Science 2025-09-26 Hong Su

Pre-trained language models (LMs) are able to perform complex reasoning without explicit fine-tuning. To understand how pre-training with a next-token prediction objective contributes to the emergence of such reasoning capability, we…

Machine Learning · Computer Science 2024-06-24 Xinyi Wang , Alfonso Amayuelas , Kexun Zhang , Liangming Pan , Wenhu Chen , William Yang Wang

The capabilities and limitations of Large Language Models have been sketched out in great detail in recent years, providing an intriguing yet conflicting picture. On the one hand, LLMs demonstrate a general ability to solve problems. On the…

Pretrained large language models (LLMs) are increasingly utilized across a wide range of natural language processing (NLP) tasks due to their impressive capabilities as few-shot learners. Recent techniques, such as chain-of-thought (CoT)…

Machine Learning · Computer Science 2024-12-02 Kamesh R

The increasing scale of large language models (LLMs) brings emergent abilities to various complex tasks requiring reasoning, such as arithmetic and commonsense reasoning. It is known that the effective design of task-specific prompts is…

Computation and Language · Computer Science 2024-07-23 Shizhe Diao , Pengcheng Wang , Yong Lin , Rui Pan , Xiang Liu , Tong Zhang

Large language models (LLMs) have unveiled remarkable reasoning capabilities by exploiting chain-of-thought (CoT) prompting, which generates intermediate reasoning chains to serve as the rationale for deriving the answer. However, current…

Computation and Language · Computer Science 2024-02-21 Anni Zou , Zhuosheng Zhang , Hai Zhao , Xiangru Tang

Large Language Models (LLMs) have demonstrated amazing capabilities in language generation, text comprehension, and knowledge reasoning. While a single powerful model can already handle multiple tasks, relying on a single perspective can…

Computation and Language · Computer Science 2024-06-12 Zining Qin , Chenhao Wang , Huiling Qin , Weijia Jia

Natural Language Explanation (NLE) aims to elucidate the decision-making process by providing detailed, human-friendly explanations in natural language. It helps demystify the decision-making processes of large vision-language models…

Computation and Language · Computer Science 2024-12-10 Patrick Amadeus Irawan , Genta Indra Winata , Samuel Cahyawijaya , Ayu Purwarianti

Prevailing large language models (LLMs) are capable of human responses simulation through its unprecedented content generation and reasoning abilities. However, it is not clear whether and how to leverage LLMs to simulate field experiments.…

Artificial Intelligence · Computer Science 2024-08-20 Yaoyu Chen , Yuheng Hu , Yingda Lu

Reinforcement learning (RL) has proven highly effective in eliciting the reasoning capabilities of large language models (LLMs). Inspired by this success, recent studies have explored applying similar techniques to vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Yan Chen , Long Li , Teng Xi , Long Zeng , Jingdong Wang

Reasoning-oriented Large Language Models (LLMs) have achieved remarkable progress with Chain-of-Thought (CoT) prompting, yet they remain fundamentally limited by a \emph{blind self-thinking} paradigm: performing extensive internal reasoning…

Computation and Language · Computer Science 2026-05-29 Xin Chen , Feng Jiang , Yiqian Zhang , Hardy Chen , Shuo Yan , Wenya Xie , Min Yang , Shujian Huang

Large language models (LLMs) have proven to be highly effective for solving complex reasoning tasks. Surprisingly, their capabilities can often be improved by iterating on previously generated solutions. In this context, a reasoning plan…

Artificial Intelligence · Computer Science 2025-12-05 MohammadHossein Bateni , Vincent Cohen-Addad , Yuzhou Gu , Silvio Lattanzi , Simon Meierhans , Christopher Mohri

Large language models (LLMs) often struggle with complex mathematical tasks, prone to "hallucinating" incorrect answers due to their reliance on statistical patterns. This limitation is further amplified in average Small LangSLMs with…

Large language models (LLMs) have achieved remarkable performance in natural language understanding and generation tasks. However, they often suffer from limitations such as difficulty in incorporating new knowledge, generating…

Artificial Intelligence · Computer Science 2024-03-05 Yilin Wen , Zifeng Wang , Jimeng Sun

Understanding human intents from multimodal signals is critical for analyzing human behaviors and enhancing human-machine interactions in real-world scenarios. However, existing methods exhibit limitations in their modality-level reliance,…

Multimedia · Computer Science 2025-09-03 Qianrui Zhou , Hua Xu , Yifan Wang , Xinzhi Dong , Hanlei Zhang

Text-rich VQA, namely Visual Question Answering based on text recognition in the images, is a cross-modal task that requires both image comprehension and text recognition. In this work, we focus on investigating the advantages and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Xuejing Liu , Wei Tang , Xinzhe Ni , Jinghui Lu , Rui Zhao , Zechao Li , Fei Tan

This paper presents a novel approach termed Layer-of-Thoughts Prompting (LoT), which utilizes constraint hierarchies to filter and refine candidate responses to a given query. By integrating these constraints, our method enables a…

Computation and Language · Computer Science 2024-10-17 Wachara Fungwacharakorn , Nguyen Ha Thanh , May Myo Zin , Ken Satoh

A recent approach to neurosymbolic reasoning is to explicitly combine the strengths of large language models (LLMs) and symbolic solvers to tackle complex reasoning tasks. However, current approaches face significant limitations, including…

Artificial Intelligence · Computer Science 2026-01-08 Benjamin Callewaert , Simon Vandevelde , Joost Vennekens

We present LinkQ, a system that leverages a large language model (LLM) to facilitate knowledge graph (KG) query construction through natural language question-answering. Traditional approaches often require detailed knowledge of a graph…

Computation and Language · Computer Science 2025-02-11 Harry Li , Gabriel Appleby , Ashley Suh