中文
相关论文

相关论文: KORGym: A Dynamic Game Platform for LLM Reasoning …

200 篇论文

Language serves as a vehicle for conveying thought, enabling communication among individuals. The ability to distinguish between diverse concepts, identify fairness and injustice, and comprehend a range of legal notions fundamentally relies…

计算与语言 · 计算机科学 2023-11-23 Ha-Thanh Nguyen , Wachara Fungwacharakorn , Ken Satoh

Conditional layout generation aims to automatically generate visually appealing and semantically coherent layouts from user-defined constraints. While recent methods based on generative models have shown promising results, they typically…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Hengyu Shi , Junhao Su , Tianyang Han , Junfeng Luo , Jialin Gao

Large language models (LLMs) have demonstrated exceptional performance in reasoning tasks such as mathematics and coding, matching or surpassing human capabilities. However, these impressive reasoning abilities face significant challenges…

计算与语言 · 计算机科学 2026-01-26 Yichuan Ma , Linyang Li , Yongkang Chen , Peiji Li , Jiasheng Ye , Qipeng Guo , Dahua Lin , Kai Chen

Large language models (LLMs) have demonstrated remarkable advances in reasoning capabilities. However, their performance remains constrained by limited access to explicit and structured domain knowledge. Retrieval-Augmented Generation (RAG)…

计算与语言 · 计算机科学 2025-10-20 Junlin Wu , Xianrui Zhong , Jiashuo Sun , Bolian Li , Bowen Jin , Jiawei Han , Qingkai Zeng

Vision-language reinforcement learning (RL) has primarily focused on narrow domains (e.g. geometry or chart reasoning). This leaves broader training scenarios and resources underexplored, limiting the exploration and learning of Vision…

While existing benchmarks probe the reasoning abilities of large language models (LLMs) across diverse domains, they predominantly assess passive reasoning, providing models with all the information needed to reach a solution. By contrast,…

机器学习 · 计算机科学 2025-06-11 Zhanke Zhou , Xiao Feng , Zhaocheng Zhu , Jiangchao Yao , Sanmi Koyejo , Bo Han

Large reasoning models (LRMs) have recently shown promise in solving complex math problems when optimized with Reinforcement Learning (RL). But conventional approaches rely on outcome-only rewards that provide sparse feedback, resulting in…

机器学习 · 计算机科学 2025-08-01 Tao He , Rongchuan Mu , Lizi Liao , Yixin Cao , Ming Liu , Bing Qin

Large language models have advanced from single-turn question answering to deep research systems that iteratively decompose research questions, invoke retrieval tools, and synthesize information across multiple rounds. Evaluating such…

人工智能 · 计算机科学 2026-02-18 Hao Shen , Hang Yang , Zhouhong Gu , Weili Han

While large language models (LLMs) have demonstrated impressive capabilities across various natural language processing tasks by acquiring rich factual knowledge from their broad training data, their ability to synthesize and logically…

计算与语言 · 计算机科学 2024-07-31 Tianshi Zheng , Jiaxin Bai , Yicheng Wang , Tianqing Fang , Yue Guo , Yauwai Yim , Yangqiu Song

The rapid advancement of Multimodal Large Language Models (MLLMs) has been accompanied by the development of various benchmarks to evaluate their capabilities. However, the true nature of these evaluations and the extent to which they…

计算与语言 · 计算机科学 2024-10-17 Botian Jiang , Lei Li , Xiaonan Li , Zhaowei Li , Xiachong Feng , Lingpeng Kong , Qi Liu , Xipeng Qiu

We present GLM-4.1V-Thinking, GLM-4.5V, and GLM-4.6V, a family of vision-language models (VLMs) designed to advance general-purpose multimodal understanding and reasoning. In this report, we share our key findings in the development of the…

Long-form legal reasoning remains a key challenge for large language models (LLMs) in spite of recent advances in test-time scaling. To address this, we introduce LEXam, a novel benchmark derived from 340 law exams spanning 116 law school…

As evaluation designs of large language models may shape our trajectory toward artificial general intelligence, comprehensive and forward-looking assessment is essential. Existing benchmarks primarily assess static knowledge, while…

计算与语言 · 计算机科学 2025-08-07 Jiayin Wang , Zhiquang Guo , Weizhi Ma , Min Zhang

We present RPGBench, the first benchmark designed to evaluate large language models (LLMs) as text-based role-playing game (RPG) engines. RPGBench comprises two core tasks: Game Creation (GC) and Game Simulation (GS). In GC, an LLM must…

计算与语言 · 计算机科学 2025-02-04 Pengfei Yu , Dongming Shen , Silin Meng , Jaewon Lee , Weisu Yin , Andrea Yaoyun Cui , Zhenlin Xu , Yi Zhu , Xingjian Shi , Mu Li , Alex Smola

Large language models (LLMs) are in the ascendancy for research in drug discovery, offering unprecedented opportunities to reshape drug research by accelerating hypothesis generation, optimizing candidate prioritization, and enabling more…

机器学习 · 计算机科学 2026-04-06 Tianyu Liu , Sihan Jiang , Fan Zhang , Kunyang Sun , Teresa Head-Gordon , Hongyu Zhao

Recent multimodal large language models (MLLMs) have advanced video understanding, yet most still "think about videos" ie once a video is encoded, reasoning unfolds entirely in text, treating visual input as a static context. This passive…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Hanoona Rasheed , Mohammed Zumri , Muhammad Maaz , Ming-Hsuan Yang , Fahad Shahbaz Khan , Salman Khan

Contemporary progress in large language models (LLMs) has revealed notable inferential capacities via reinforcement learning (RL) employing verifiable reward, facilitating the development of O1 and R1-like reasoning models. Directly…

机器学习 · 计算机科学 2025-10-21 Zexu Sun , Yongcheng Zeng , Erxue Min , Heyang Gao , Bokai Ji , Xu Chen

We present the Multilingual Reasoning Gym, an extension of Reasoning Gym (Stojanovski et al., 2025), that procedurally generates verifiable reasoning problems across 14 languages. We translate templates for 94 tasks with native-speaker…

计算与语言 · 计算机科学 2026-03-12 Konstantin Dobler , Simon Lehnerer , Federico Scozzafava , Jonathan Janke , Mohamed Ali

Large language models (LLMs) have demonstrated considerable reasoning abilities in various tasks such as mathematics and coding. However, recent studies indicate that even the best models lack true comprehension of their reasoning…

人工智能 · 计算机科学 2025-07-08 Pinzheng Wang , Juntao Li , Zecheng Tang , Haijia Gui , Min zhang

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in…

计算与语言 · 计算机科学 2023-05-29 Jie Huang , Kevin Chen-Chuan Chang