English
Related papers

Related papers: Thinking LLMs: General Instruction Following with …

200 papers

Reasoning is an important task for large language models (LLMs). Among all the reasoning paradigms, inductive reasoning is one of the fundamental types, which is characterized by its particular-to-general thinking process and the…

Computation and Language · Computer Science 2026-04-14 Kedi Chen , Dezhao Ruan , Yuhao Dan , Yaoting Wang , Siyu Yan , Xuecheng Wu , Yinqi Zhang , Qin Chen , Jie Zhou , Liang He , Biqing Qi , Linyang Li , Qipeng Guo , Xiaoming Shi , Wei Zhang

Large language models (LLMs) exhibit strong reasoning abilities, often attributed to few-shot or zero-shot chain-of-thought (CoT) prompting. While effective, these methods require labor-intensive prompt engineering, raising the question of…

Computation and Language · Computer Science 2025-03-19 Hyunbin Jin , Je Won Yeom , Seunghyun Bae , Taesup Kim

Analogical reasoning -- the capacity to identify and map structural relationships between different domains -- is fundamental to human cognition and learning. Recent studies have shown that large language models (LLMs) can sometimes match…

Computation and Language · Computer Science 2025-11-21 Sam Musker , Alex Duchnowski , Raphaël Millière , Ellie Pavlick

Large language models (LLMs) are increasingly optimized for long reasoning, under the assumption that more reasoning leads to better performance. However, emerging evidence suggests that longer responses can sometimes degrade accuracy…

Computation and Language · Computer Science 2025-05-02 Jinyan Su , Jennifer Healey , Preslav Nakov , Claire Cardie

Large language models (LLMs) are increasingly used as automated judges to evaluate recommendation systems, search engines, and other subjective tasks, where relying on human evaluators can be costly, time-consuming, and unscalable. LLMs…

Computation and Language · Computer Science 2025-02-10 Gerrit J. J. van den Burg , Gen Suzuki , Wei Liu , Murat Sensoy

Large language models (LLMs) are increasingly evaluated on reasoning tasks, yet their logical abilities remain contested. To address this, we study LLMs' reasoning in a well-defined fragment of logic: syllogistic reasoning. We cast the…

Computation and Language · Computer Science 2026-01-27 Leonardo Bertolazzi , Manuel Vargas Guzmán , Raffaella Bernardi , Maciej Malicki , Jakub Szymanik

Pre-trained language models (LMs) are able to perform complex reasoning without explicit fine-tuning. To understand how pre-training with a next-token prediction objective contributes to the emergence of such reasoning capability, we…

Machine Learning · Computer Science 2024-06-24 Xinyi Wang , Alfonso Amayuelas , Kexun Zhang , Liangming Pan , Wenhu Chen , William Yang Wang

Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs)…

Information Retrieval · Computer Science 2026-02-16 Kehan Zheng , Deyao Hong , Qian Li , Jun Zhang , Huan Yu , Jie Jiang , Hongning Wang

Recent advances in reasoning Large Language Models (LLMs) have primarily relied on upfront thinking, where reasoning occurs before final answer. However, this approach suffers from critical limitations in code generation, where upfront…

Software Engineering · Computer Science 2026-04-28 Xue Jiang , Tianyu Zhang , Ge Li , Mengyang Liu , Taozhi Chen , Zhenhua Xu , Binhua Li , Wenpin Jiao , Zhi Jin , Yongbin Li , Yihong Dong

Inspired by the exceptional general intelligence of Large Language Models (LLMs), researchers have begun to explore their application in pioneering the next generation of recommender systems - systems that are conversational, explainable,…

Information Retrieval · Computer Science 2024-08-06 Wensheng Lu , Jianxun Lian , Wei Zhang , Guanghua Li , Mingyang Zhou , Hao Liao , Xing Xie

Studies have underscored how, regardless of the recent breakthrough and swift advances in AI research, even state-of-the-art Large Language models (LLMs) continue to struggle when performing logical and mathematical reasoning. The results…

Artificial Intelligence · Computer Science 2024-12-20 Federico Castagna , Isabel Sassoon , Simon Parsons

This paper investigates the role of explicit thinking process in rule-based reinforcement fine-tuning (RFT) for MLLMs. We first propose CLS-RL for MLLM image classification, using verifiable rewards for fine-tuning. Experiments show CLS-RL…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Ming Li , Jike Zhong , Shitian Zhao , Yuxiang Lai , Haoquan Zhang , Wang Bill Zhu , Kaipeng Zhang

Large Reasoning Models (LRMs) are powerful, but they still suffer from inefficient and off-target reasoning. Currently, training-free methods are limited to either rigid heuristics or descriptive, non-actionable analyses. In this paper, we…

Artificial Intelligence · Computer Science 2025-10-15 Sunzhu Li , Zhiyu Lin , Shuling Yang , Jiale Zhao , Wei Chen

Large Language Models (LLMs) are rapidly surpassing human knowledge in many domains. While improving these models traditionally relies on costly human data, recent self-rewarding mechanisms (Yuan et al., 2024) have shown that LLMs can…

Computation and Language · Computer Science 2024-07-31 Tianhao Wu , Weizhe Yuan , Olga Golovneva , Jing Xu , Yuandong Tian , Jiantao Jiao , Jason Weston , Sainbayar Sukhbaatar

Theory of Mind (ToM) reasoning entails recognizing that other individuals possess their own intentions, emotions, and thoughts, which is vital for guiding one's own thought processes. Although large language models (LLMs) excel in tasks…

Computation and Language · Computer Science 2024-06-11 Maryam Amirizaniani , Elias Martin , Maryna Sivachenko , Afra Mashhadi , Chirag Shah

Despite the success of large language models (LLMs) in various natural language processing (NLP) tasks, the stored knowledge in these models may inevitably be incomplete, out-of-date, or incorrect. This motivates the need to utilize…

Computation and Language · Computer Science 2023-01-03 Hangfeng He , Hongming Zhang , Dan Roth

Evaluating reasoning ability in Large Language Models (LLMs) is important for advancing artificial intelligence, as it transcends mere linguistic task performance. It involves understanding whether these models truly understand information,…

Artificial Intelligence · Computer Science 2025-10-29 Benjamin Grando Moreira

Large Language Models (LLMs) have succeeded remarkably in various natural language processing (NLP) tasks, yet their reasoning capabilities remain a fundamental challenge. While LLMs exhibit impressive fluency and factual recall, their…

Computation and Language · Computer Science 2025-05-29 Avinash Patil , Aryan Jadon

Large language models (LLMs) can perform a wide range of tasks by following natural language instructions, without the necessity of task-specific fine-tuning. Unfortunately, the performance of LLMs is greatly influenced by the quality of…

Computation and Language · Computer Science 2023-10-23 Zhihan Zhang , Shuohang Wang , Wenhao Yu , Yichong Xu , Dan Iter , Qingkai Zeng , Yang Liu , Chenguang Zhu , Meng Jiang

Collaborative information from user-item interactions is a fundamental source of signal in successful recommender systems. Recently, researchers have attempted to incorporate this knowledge into large language model-based recommender…

Information Retrieval · Computer Science 2026-03-24 Shahrooz Pouryousef , Ali Montazeralghaem