English
Related papers

Related papers: Learning to Reason for Long-Form Story Generation

200 papers

Large Language Models (LLMs) have demonstrated impressive real-world utility, exemplifying artificial useful intelligence (AUI). However, their ability to reason adaptively and robustly -- the hallmarks of artificial general intelligence…

Machine Learning · Computer Science 2025-08-27 Seungwook Han , Jyothish Pari , Samuel J. Gershman , Pulkit Agrawal

Large language models (LLMs) have recently demonstrated impressive performance on complex, multi-step reasoning tasks, especially when post-trained with outcome-rewarded reinforcement learning Guo et al. 2025. However, it has been observed…

Artificial Intelligence · Computer Science 2026-04-01 Luoxin Chen , Yichi Zhou , Huishuai Zhang

Reasoning is an important task for large language models (LLMs). Among all the reasoning paradigms, inductive reasoning is one of the fundamental types, which is characterized by its particular-to-general thinking process and the…

Computation and Language · Computer Science 2026-04-14 Kedi Chen , Dezhao Ruan , Yuhao Dan , Yaoting Wang , Siyu Yan , Xuecheng Wu , Yinqi Zhang , Qin Chen , Jie Zhou , Liang He , Biqing Qi , Linyang Li , Qipeng Guo , Xiaoming Shi , Wei Zhang

Making legal knowledge accessible to non-experts is crucial for enhancing general legal literacy and encouraging civic participation in democracy. However, legal documents are often challenging to understand for people without legal…

Computation and Language · Computer Science 2024-07-03 Hang Jiang , Xiajie Zhang , Robert Mahari , Daniel Kessler , Eric Ma , Tal August , Irene Li , Alex 'Sandy' Pentland , Yoon Kim , Deb Roy , Jad Kabbara

Multimodal large language models (MLLMs) have rapidly advanced from perception tasks to complex multi-step reasoning, yet reinforcement learning with verifiable rewards (RLVR) often leads to spurious reasoning since only the final-answer…

Computation and Language · Computer Science 2026-04-21 Mengzhao Jia , Zhihan Zhang , Ignacio Cases , Zheyuan Liu , Meng Jiang , Peng Qi

Prompting techniques such as chain-of-thought have established themselves as a popular vehicle for improving the outputs of large language models (LLMs). For code generation, however, their exact mechanics and efficacy are under-explored.…

Computation and Language · Computer Science 2025-04-09 Kunhao Zheng , Juliette Decugis , Jonas Gehring , Taco Cohen , Benjamin Negrevergne , Gabriel Synnaeve

Although Large Language Models (LLMs) exhibit advanced reasoning ability, conventional alignment remains largely dominated by outcome reward models (ORMs) that judge only final answers. Process Reward Models(PRMs) address this gap by…

Computation and Language · Computer Science 2026-04-30 Congmin Zheng , Jiachen Zhu , Zhuoying Ou , Yuxiang Chen , Kangning Zhang , Rong Shan , Zeyu Zheng , Mengyue Yang , Jianghao Lin , Yong Yu , Weinan Zhang

Large language models (LLMs) often hallucinate in long-form generation. Existing approaches mainly improve factuality through post-hoc revision or reinforcement learning (RL) with correctness-based rewards, but they do not teach the model…

Computation and Language · Computer Science 2026-04-15 Xin Liu , Lu Wang

Large language models (LLMs) have shown impressive promise in code generation, yet their progress remains limited by the shortage of large-scale datasets that are both diverse and well-aligned with human reasoning. Most existing resources…

Machine Learning · Computer Science 2025-10-28 Amal Abed , Ivan Lukic , Jörg K. H. Franke , Frank Hutter

Recent advances in large language models (LLMs) have made reasoning a central benchmark for evaluating intelligence. While prior surveys focus on efficiency by examining how to shorten reasoning chains or reduce computation, this view…

Artificial Intelligence · Computer Science 2026-04-01 Chao Wu , Baoheng Li , Mingchen Gao , Yu Tian , Zhenyi Wang

Reasoning is an essential skill to enable Large Language Models (LLMs) to interact with the world. As tasks become more complex, they demand increasingly sophisticated and diverse reasoning capabilities for sequential decision-making,…

Artificial Intelligence · Computer Science 2025-04-25 Christopher Zhang Cui , Xingdi Yuan , Ziang Xiao , Prithviraj Ammanabrolu , Marc-Alexandre Côté

Large Language Models (LLMs) are versatile, yet they often falter in tasks requiring deep and reliable reasoning due to issues like hallucinations, limiting their applicability in critical scenarios. This paper introduces a rigorously…

Computation and Language · Computer Science 2023-11-21 Saizhuo Wang , Zhihan Liu , Zhaoran Wang , Jian Guo

Reasoning about time and temporal relations is an integral aspect of human cognition, essential for perceiving the world and navigating our experiences. Though large language models (LLMs) have demonstrated impressive performance in many…

Computation and Language · Computer Science 2024-11-19 Xinliang Frederick Zhang , Nick Beauchamp , Lu Wang

Generative language models (LMs) are increasingly used for document class-prediction tasks and promise enormous improvements in cost and efficiency. Existing research often examines simple classification tasks, but the capability of LMs to…

Computation and Language · Computer Science 2023-10-31 Rosamond Thalken , Edward H. Stiglitz , David Mimno , Matthew Wilkens

Large Language Models (LLMs) have shown remarkable performance in various basic natural language tasks. For completing the complex task, we still need a plan for the task to guide LLMs to generate the specific solutions step by step. LLMs…

Computation and Language · Computer Science 2023-12-14 Yiduo Guo , Yaobo Liang , Chenfei Wu , Wenshan Wu , Dongyan Zhao , Nan Duan

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising paradigm for enhancing reasoning in Large Language Models (LLMs). However, existing reward formulations typically treat exploration and consolidation as a…

Machine Learning · Computer Science 2026-05-15 Wenze Lin , Zhen Yang , Xitai Jiang , Xiaoteng Ma , Gao Huang

The recent rise of reasoning-tuned Large Language Models (LLMs)--which generate chains of thought (CoTs) before giving the final answer--has attracted significant attention and offers new opportunities for gaining insights into human label…

Computation and Language · Computer Science 2025-09-25 Beiduo Chen , Yang Janet Liu , Anna Korhonen , Barbara Plank

Pre-trained language models (PLMs) fail to generate long-form narrative text because they do not consider global structure. As a result, the generated texts are often incohesive, repetitive, or lack content. Recent work in story generation…

Computation and Language · Computer Science 2022-06-08 Yiping Jin , Vishakha Kadam , Dittaya Wanvarie

Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive judgments? Existing evaluations emphasize problem-solving accuracy, overlooking the fragmented…

Computation and Language · Computer Science 2026-05-12 Conrad Borchers , Jill-Jênn Vie , Roger Azevedo

Neural language model-based approaches to automated story generation suffer from two important limitations. First, language model-based story generators generally do not work toward a given goal or ending. Second, they often lose coherence…

Computation and Language · Computer Science 2021-12-08 Louis Castricato , Spencer Frazier , Jonathan Balloch , Nitya Tarakad , Mark Riedl