English
Related papers

Related papers: OpenDeepThink: Parallel Reasoning via Bradley-Terr…

200 papers

Tool-calling empowers Large Language Models (LLMs) to interact with external environments. However, current methods often struggle to handle massive and noisy candidate tools in long-context tool-calling tasks, limiting their real-world…

Computation and Language · Computer Science 2026-03-13 Kunfeng Chen , Qihuang Zhong , Juhua Liu , Bo Du , Dacheng Tao

Advanced reasoning in large language models has achieved remarkable performance on challenging tasks, but the prevailing long-context reasoning paradigm faces critical limitations: quadratic computational scaling with sequence length,…

Computation and Language · Computer Science 2026-02-26 Yuchen Yan , Yongliang Shen , Yang Liu , Jin Jiang , Mengdi Zhang , Jian Shao , Yueting Zhuang

We introduce OpenVLThinker, one of the first open-source large vision-language models (LVLMs) to exhibit sophisticated chain-of-thought reasoning, achieving notable performance gains on challenging visual reasoning tasks. While text-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yihe Deng , Hritik Bansal , Fan Yin , Nanyun Peng , Wei Wang , Kai-Wei Chang

Recent advances in Chain-of-Thought (CoT) prompting have substantially improved the reasoning capabilities of large language models (LLMs), but have also introduced their computational efficiency as a new attack surface. In this paper, we…

Cryptography and Security · Computer Science 2025-11-17 Shuaitong Liu , Renjue Li , Lijia Yu , Lijun Zhang , Zhiming Liu , Gaojie Jin

As large language models (LLMs) take on greater roles in high-stakes decisions, alignment with human values is essential. Reliance on proprietary APIs limits reproducibility and broad participation. We study whether local open-source…

Artificial Intelligence · Computer Science 2025-11-18 Ephraiem Sarabamoun

Recent advances in reasoning-focused large language models (LLMs) mark a shift from general LLMs toward models designed for complex decision-making, a crucial aspect in medicine. However, their performance in specialized domains like…

Inspired by the success of language models (LM), scaling up deep learning recommendation systems (DLRS) has become a recent trend in the community. All previous methods tend to scale up the model parameters during training time. However,…

Information Retrieval · Computer Science 2025-12-09 Fuyuan Lyu , Zhentai Chen , Jingyan Jiang , Lingjie Li , Xing Tang , Xiuqiang He , Xue Liu

Large Language Models (LLMs) have recently achieved impressive performance in math and reasoning benchmarks. However, they often struggle with logic problems and puzzles that are relatively easy for humans. To further investigate this, we…

Artificial Intelligence · Computer Science 2025-09-16 Nasim Borazjanizadeh , Roei Herzig , Trevor Darrell , Rogerio Feris , Leonid Karlinsky

The advent of test-time scaling in large language models (LLMs), exemplified by OpenAI's o1 series, has advanced reasoning capabilities by scaling computational resource allocation during inference. While successors like QwQ, Deepseek-R1…

Machine Learning · Computer Science 2025-03-04 Zhiyuan Zeng , Qinyuan Cheng , Zhangyue Yin , Yunhua Zhou , Xipeng Qiu

Recently, test-time scaling has garnered significant attention from the research community, largely due to the substantial advancements of the o1 model released by OpenAI. By allocating more computational resources during the inference…

This paper introduces a novel Deep Researcher architecture designed to generate detailed research reports on complex PhD level topics by addressing the inherent limitations of the Parallel Scaling paradigm. Our system utilizes two key…

Artificial Intelligence · Computer Science 2026-01-29 Saurav Prateek

Reasoning reinforcement learning (RL) has recently revealed a new scaling effect: test-time scaling. Thinking models such as R1 and o1 improve their reasoning accuracy at test time as the length of the reasoning context increases. However,…

Machine Learning · Computer Science 2025-11-24 Chao Yu , Qixin Tan , Jiaxuan Gao , Shi Yu , Hong Lu , Xinting Yang , Zelai Xu , Yu Wang , Yi Wu , Eugene Vinitsky

Ranking LLMs via pairwise human feedback underpins current leaderboards for open-ended tasks, such as creative writing and problem-solving. We analyze ~89K comparisons in 116 languages from 52 LLMs from Arena, and show that the best-fit…

Machine Learning · Computer Science 2026-05-08 Jai Moondra , Ayela Chughtai , Bhargavi Lanka , Swati Gupta

Purpose: To evaluate the accuracy and reasoning ability of DeepSeek-R1 and three other recently released large language models (LLMs) in bilingual complex ophthalmology cases. Methods: A total of 130 multiple-choice questions (MCQs) related…

Computation and Language · Computer Science 2025-02-26 Pusheng Xu , Yue Wu , Kai Jin , Xiaolan Chen , Mingguang He , Danli Shi

Recent advances in large language models (LLMs) have enabled near-human performance on software coding benchmarks, but their effectiveness in RTL code generation remains limited due to the scarcity of high-quality training data. While prior…

Hardware Architecture · Computer Science 2025-07-17 Chenhui Deng , Yun-Da Tsai , Guan-Ting Liu , Zhongzhi Yu , Haoxing Ren

This project reproduces and extends the recently proposed ``Recursive Language Models'' (RLMs) framework by Zhang et al. (2026). This framework enables Large Language Models (LLMs) to process near-infinite contexts by offloading the prompt…

Computation and Language · Computer Science 2026-03-04 Daren Wang

We present that hierarchical LLM reasoning via scaling thought templates can effectively optimize the reasoning search space and outperform the mathematical reasoning capabilities of powerful LLMs like OpenAI o1-preview and DeepSeek V3. We…

Computation and Language · Computer Science 2025-03-12 Ling Yang , Zhaochen Yu , Bin Cui , Mengdi Wang

Large Language Models (LLMs) have shown impressive performance in reasoning tasks. However, LLMs tend to generate excessively long reasoning content, leading to significant computational overhead. Our observations indicate that even on…

Computation and Language · Computer Science 2025-05-21 Guochao Jiang , Guofeng Quan , Zepeng Ding , Ziqin Luo , Dixuan Wang , Zheng Hu

Conventional deep models predict a test sample with a single forward propagation, which, however, may not be sufficient for predicting hard-classified samples. On the contrary, we human beings may need to carefully check the sample many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Guanghui Xu , Haokun Li , Peilin Zhao , Junzhou Huang , Yaowei Wang , Mingkui Tan

Test-Time Scaling (TTS) improves the reasoning performance of Large Language Models (LLMs) by allocating additional compute during inference. We conduct a structured survey of TTS methods and categorize them into sampling-based,…

Computation and Language · Computer Science 2025-06-06 Ho-Lam Chung , Teng-Yun Hsiao , Hsiao-Ying Huang , Chunerh Cho , Jian-Ren Lin , Zhang Ziwei , Yun-Nung Chen