English
Related papers

Related papers: Language Models Still Struggle to Zero-shot Reason…

200 papers

Prediction in language has traditionally been studied using simple designs in which neural responses to expected and unexpected words are compared in a categorical fashion. However, these designs have been contested as being `prediction…

Neurons and Cognition · Quantitative Biology 2019-09-11 Micha Heilbron , Benedikt Ehinger , Peter Hagoort , Floris P. de Lange

Large language models have recently shown promising progress in mathematical reasoning when fine-tuned with human-generated sequences walking through a sequence of solution steps. However, the solution sequences are not formally structured…

Machine Learning · Computer Science 2022-12-07 Andrew J. Nam , Mengye Ren , Chelsea Finn , James L. McClelland

Do large language models (LLMs) display rational reasoning? LLMs have been shown to contain human biases due to the data they have been trained on; whether this is reflected in rational reasoning remains less clear. In this paper, we answer…

Computation and Language · Computer Science 2024-02-16 Olivia Macmillan-Scott , Mirco Musolesi

Logical reasoning consistently plays a fundamental and significant role in the domains of knowledge engineering and artificial intelligence. Recently, Large Language Models (LLMs) have emerged as a noteworthy innovation in natural language…

Computation and Language · Computer Science 2024-09-17 Fangzhi Xu , Qika Lin , Jiawei Han , Tianzhe Zhao , Jun Liu , Erik Cambria

The performance of Large language models (LLMs) across a broad range of domains has been impressive but have been critiqued as not being able to reason about their process and conclusions derived. This is to explain the conclusions draw,…

Computation and Language · Computer Science 2024-10-30 Rob Sullivan , Nelly Elsayed

Large Language Models (LLMs) are important tools for reasoning and problem-solving, while they often operate passively, answering questions without actively discovering new ones. This limitation reduces their ability to simulate human-like…

Computational Engineering, Finance, and Science · Computer Science 2025-09-26 Hong Su

The causal capabilities of large language models (LLMs) are a matter of significant debate, with critical implications for the use of LLMs in societally impactful domains such as medicine, science, law, and policy. We conduct a "behavorial"…

Artificial Intelligence · Computer Science 2024-08-21 Emre Kıcıman , Robert Ness , Amit Sharma , Chenhao Tan

Language Models have ushered a new age of AI gaining traction within the NLP community as well as amongst the general population. AI's ability to make predictions, generations and its applications in sensitive decision-making scenarios,…

Computation and Language · Computer Science 2023-11-28 Ananya Malik

Targeted syntactic evaluations of language models ask whether models show stable preferences for syntactically acceptable content over minimal-pair unacceptable inputs. Most targeted syntactic evaluation datasets ask models to make these…

Computation and Language · Computer Science 2022-12-20 Koustuv Sinha , Jon Gauthier , Aaron Mueller , Kanishka Misra , Keren Fuentes , Roger Levy , Adina Williams

As language models are increasingly deployed as autonomous agents in high-stakes settings, ensuring that they reliably follow user-defined rules has become a critical safety concern. To this end, we study whether language models exhibit…

Machine Learning · Computer Science 2025-08-28 Dylan Sam , Alexander Robey , Andy Zou , Matt Fredrikson , J. Zico Kolter

Large Language Models (LLMs) increasingly show reasoning rationales alongside their answers, turning "reasoning" into a user-interface element. While step-by-step rationales are typically associated with model performance, how they…

Human-Computer Interaction · Computer Science 2026-03-10 Xin Sun , Shu Wei , Jos A Bosch , Isao Echizen , Saku Sugawara , Abdallah El Ali

Recent advancements in Large Language Models (LLMs) have demonstrated remarkable capabilities in various domains. However, effective decision-making relies heavily on strong reasoning abilities. Reasoning is the foundation for…

Computation and Language · Computer Science 2025-06-30 Dana Alsagheer , Yang Lu , Abdulrahman Kamal , Omar Kamal , Mohammad Kamal , Nada Mansour , Cosmo Yang Wu , Rambiba Karanjai , Sen Li , Weidong Shi

Modelling and understanding time remains a challenge in contemporary video understanding models. With language emerging as a key driver towards powerful generalization, it is imperative for foundational video-language models to have a sense…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Piyush Bagad , Makarand Tapaswi , Cees G. M. Snoek

While Large Language Models have been used to produce interpretable stock forecasts, they mainly focus on analyzing textual reports but not historical price data, also known as Technical Analysis. This task is challenging as it switches…

Statistical Finance · Quantitative Finance 2026-03-03 Kelvin J. L. Koa , Jan Chen , Yunshan Ma , Huanhuan Zheng , Tat-Seng Chua

Causal learning is the cognitive process of developing the capability of making causal inferences based on available information, often guided by normative principles. This process is prone to errors and biases, such as the illusion of…

Large language models (LLMs) have recently shown remarkable performance in language tasks and beyond. However, due to their limited inherent causal reasoning ability, LLMs still face challenges in handling tasks that require robust causal…

Computation and Language · Computer Science 2025-03-13 Xin Li , Zhuo Cai , Shoujin Wang , Kun Yu , Fang Chen

Recent advances in multimodal time series learning underscore a paradigm shift from analytics centered on basic patterns toward advanced time series understanding and reasoning. However, existing multimodal time series datasets mostly…

Temporal reasoning is pivotal for Large Language Models (LLMs) to comprehend the real world. However, existing works neglect the real-world challenges for temporal reasoning: (1) intensive temporal information, (2) fast-changing event…

Artificial Intelligence · Computer Science 2025-10-09 Shaohang Wei , Wei Li , Feifan Song , Wen Luo , Tianyi Zhuang , Haochen Tan , Zhijiang Guo , Houfeng Wang

Providing plausible responses to why questions is a challenging but critical goal for language based human-machine interaction. Explanations are challenging in that they require many different forms of abstract knowledge and reasoning.…

Computation and Language · Computer Science 2019-06-05 Allen Nie , Erin D. Bennett , Noah D. Goodman

Large Language Models (LLMs) have emerged as powerful tools for generating coherent text, understanding context, and performing reasoning tasks. However, they struggle with temporal reasoning, which requires processing time-related…

Machine Learning · Computer Science 2025-06-02 Adrián Bazaga , Rexhina Blloshmi , Bill Byrne , Adrià de Gispert
‹ Prev 1 4 5 6 7 8 10 Next ›