English
Related papers

Related papers: HDFlow: Enhancing LLM Complex Problem-Solving with…

200 papers

The ability to generate diverse solutions to a given problem is a hallmark of human creativity. This divergent reasoning is also crucial for machines, enhancing their robustness and enabling them to assist humans in many applications such…

Artificial Intelligence · Computer Science 2025-05-28 Fangxu Yu , Lai Jiang , Haoqiang Kang , Shibo Hao , Lianhui Qin

Recent LLMs have demonstrated sophisticated problem-solving capabilities on various benchmarks through advanced reasoning algorithms. However, the key research question of identifying reasoning steps that balance complexity and…

Artificial Intelligence · Computer Science 2025-11-12 Po-Chung Hsieh , Chin-Po Chen , Jeng-Lin Li , Ming-Ching Chang

Hybrid thinking enables LLMs to switch between reasoning and direct answering, offering a balance between efficiency and reasoning capability. Yet our experiments reveal that current hybrid thinking LLMs only achieve partial mode…

Machine Learning · Computer Science 2025-10-15 Shouren Wang , Wang Yang , Xianxuan Long , Qifan Wang , Vipin Chaudhary , Xiaotian Han

Large language models (LLMs) have shown limitations in tasks requiring complex logical reasoning and multi-step problem-solving. To address these challenges, researchers have employed carefully designed prompts and flowcharts, simulating…

Computation and Language · Computer Science 2024-12-06 Changcheng Li , Xiangyu Wang , Qiuju Chen , Xiren Zhou , Huanhuan Chen

Recently, Large Reasoning Models (LRMs) have gradually become a research hotspot due to their outstanding performance in handling complex tasks. Among them, DeepSeek R1 has garnered significant attention for its exceptional performance and…

Artificial Intelligence · Computer Science 2025-08-05 Linan Yue , Yichao Du , Yizhi Wang , Weibo Gao , Fangzhou Yao , Li Wang , Ye Liu , Ziyu Xu , Qi Liu , Shimin Di , Min-Ling Zhang

Large language models (LLMs) have shown impressive promise in code generation, yet their progress remains limited by the shortage of large-scale datasets that are both diverse and well-aligned with human reasoning. Most existing resources…

Machine Learning · Computer Science 2025-10-28 Amal Abed , Ivan Lukic , Jörg K. H. Franke , Frank Hutter

Large Language Models (LLMs) with chains-of-thought have demonstrated strong performance on an increasing range of tasks, particularly those involving complex logical reasoning. However, excessively long chains can lead to overthinking,…

Artificial Intelligence · Computer Science 2025-08-22 Yekun Zhu , Guang Chen , Chengjun Mao

When faced with complex problems, we tend to engage in slower, more deliberate thinking. In contrast, for simple questions we give quick, intuitive responses. This dual-system thinking approach allows us to allocate cognitive resources…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Chenyu Lin , Cheng Chi , Jinlin Wu , Sharon Li , Kaiyang Zhou

Multimodal Large Language Models (MLLMs) have made remarkable progress in multimodal perception and reasoning by bridging vision and language. However, most existing MLLMs perform reasoning primarily with textual CoT, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Jintao Tong , Shilin Yan , Hongwei Xue , Xiaojun Tang , Kunyu Shi , Guannan Zhang , Ruixuan Li , Yixiong Zou

Recent advances in large language models (LLMs) have demonstrated impressive reasoning capacities that mirror human-like thinking. However, whether LLMs possess genuine fluid intelligence (i.e., the ability to reason abstractly and…

Artificial Intelligence · Computer Science 2025-09-30 Yue Yang , MingKang Chen , Qihua Liu , Mengkang Hu , Qiguang Chen , Gengrui Zhang , Shuyue Hu , Guangtao Zhai , Yu Qiao , Yu Wang , Wenqi Shao , Ping Luo

Recent large language models (LLMs) have demonstrated strong reasoning capabilities that benefits from online reinforcement learning (RL). These capabilities have primarily been demonstrated within the left-to-right autoregressive (AR)…

Computation and Language · Computer Science 2025-06-04 Siyan Zhao , Devaansh Gupta , Qinqing Zheng , Aditya Grover

Large Language Models (LLMs) have achieved tremendous progress, yet they still often struggle with challenging reasoning problems. Current approaches address this challenge by sampling or searching detailed and low-level reasoning chains.…

Artificial Intelligence · Computer Science 2023-12-07 Zhan Ling , Yunhao Fang , Xuanlin Li , Tongzhou Mu , Mingu Lee , Reza Pourreza , Roland Memisevic , Hao Su

Long-context question-answering (LCQA) systems have greatly benefited from the powerful reasoning capabilities of large language models (LLMs), which can be categorized into slow and quick reasoning modes. However, both modes have their…

Computation and Language · Computer Science 2025-04-01 Zhengyi Zhao , Shubo Zhang , Zezhong Wang , Bin Liang , Binyang Li , Kam-Fai Wong

Production scheduling is highly susceptible to dynamic disruptions, such as variations in processing times, machine availability, and unexpected task insertions. Conventional approaches typically rely on event-specific models and explicit…

Artificial Intelligence · Computer Science 2026-01-16 Lixiang Zhang , Chenggong Zhao , Qing Gao , Xiaoke Zhao , Gengyi Bai , Jinhu Lv

Recent advances in large language models (LLMs) have introduced latent reasoning as a promising alternative to autoregressive reasoning. By performing internal computation with hidden states from previous steps, latent reasoning benefit…

Computation and Language · Computer Science 2025-10-24 Zhenrui Yue , Bowen Jin , Huimin Zeng , Honglei Zhuang , Zhen Qin , Jinsung Yoon , Lanyu Shang , Jiawei Han , Dong Wang

The reasoning abilities are one of the most enigmatic and captivating aspects of large language models (LLMs). Numerous studies are dedicated to exploring and expanding the boundaries of this reasoning capability. However, tasks that embody…

Artificial Intelligence · Computer Science 2025-02-27 Yuze Zhao , Tianyun Ji , Wenjun Feng , Zhenya Huang , Qi Liu , Zhiding Liu , Yixiao Ma , Kai Zhang , Enhong Chen

Large language models (LLMs) have demonstrated remarkable capabilities in tasks requiring reasoning and multi-step problem-solving through the use of chain-of-thought (CoT) prompting. However, generating the full CoT process results in…

Computation and Language · Computer Science 2024-09-16 Tianqiao Liu , Zui Chen , Zitao Liu , Mi Tian , Weiqi Luo

Recent Large Reasoning Models (LRMs) excel at complex reasoning tasks but often suffer from overthinking, generating overly long and redundant reasoning trajectories. To explore its essence, our empirical analysis reveals that LRMs are…

Artificial Intelligence · Computer Science 2025-10-07 Yongjiang Liu , Haoxi Li , Xiaosong Ma , Jie Zhang , Song Guo

Recent advances in large language models (LLMs) have sparked growing interest in agentic workflows, which are structured sequences of LLM invocations intended to solve complex tasks. However, existing approaches often rely on static…

Artificial Intelligence · Computer Science 2025-08-12 Runchuan Zhu , Bowen Jiang , Lingrui Mei , Fangkai Yang , Lu Wang , Haoxiang Gao , Fengshuo Bai , Pu Zhao , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang

The rise of Large Language Models (LLMs) has sparked interest in their application to sequential recommendation tasks as they can provide supportive item information. However, due to the inherent complexities of sequential recommendation,…

Information Retrieval · Computer Science 2023-12-19 Yu Wang , Zhiwei Liu , Jianguo Zhang , Weiran Yao , Shelby Heinecke , Philip S. Yu