English
Related papers

Related papers: Demystifying Scientific Problem-Solving in LLMs by…

200 papers

Knowledge conflicts commonly arise across diverse sources, and their prevalence has increased with the advent of LLMs. When dealing with conflicts between multiple contexts, also known as \emph{inter-context knowledge conflicts}, LLMs are…

Artificial Intelligence · Computer Science 2025-08-06 Xianda Zheng , Zijian Huang , Meng-Fen Chiang , Michael J. Witbrock , Kaiqi Zhao

Emerging reasoning models hold promise for automating scientific discovery. However, their training is hindered by a critical supervision gap: experimental outcomes are abundant, whereas intermediate reasoning steps are rarely documented at…

Biomolecules · Quantitative Biology 2026-03-24 Zequn Liu , Kehan Wu , Shufang Xie , Zekun Guo , Wei Zhang , Tao Qin , Renhe Liu , Yingce Xia

Logical reasoning consistently plays a fundamental and significant role in the domains of knowledge engineering and artificial intelligence. Recently, Large Language Models (LLMs) have emerged as a noteworthy innovation in natural language…

Computation and Language · Computer Science 2024-09-17 Fangzhi Xu , Qika Lin , Jiawei Han , Tianzhe Zhao , Jun Liu , Erik Cambria

Large Language Models (LLMs) are increasingly being used in education, yet their correctness alone does not capture the quality, reliability, or pedagogical validity of their problem-solving behavior, especially in mathematics, where…

Computers and Society · Computer Science 2025-10-22 Sagnik Dakshit , Sushmita Sinha Roy

Recent advances in large language models (LLMs) have demonstrated impressive reasoning capacities that mirror human-like thinking. However, whether LLMs possess genuine fluid intelligence (i.e., the ability to reason abstractly and…

Artificial Intelligence · Computer Science 2025-09-30 Yue Yang , MingKang Chen , Qihua Liu , Mengkang Hu , Qiguang Chen , Gengrui Zhang , Shuyue Hu , Guangtao Zhai , Yu Qiao , Yu Wang , Wenqi Shao , Ping Luo

Large language models (LLMs) have shown strong knowledge reserves and task-solving capabilities, but still face the challenge of severe hallucination, hindering their practical application. Though scientific theories and rules can…

Computation and Language · Computer Science 2026-04-09 Maotian Ma , Zheni Zeng , Zhenghao Liu , Yukun Yan

Large Language Models (LLMs) have shown superior capability to solve reasoning problems with programs. While being a promising direction, most of such frameworks are trained and evaluated in settings with a prior knowledge of task…

Computation and Language · Computer Science 2024-06-21 Yuan Yang , Siheng Xiong , Ali Payani , Ehsan Shareghi , Faramarz Fekri

With powerful large language models (LLMs) demonstrating superhuman reasoning capabilities, a critical question arises: Do LLMs genuinely reason, or do they merely recall answers from their extensive, web-scraped training datasets? Publicly…

Computation and Language · Computer Science 2025-04-28 Haowei Lin , Xiangyu Wang , Ruilin Yan , Baizhou Huang , Haotian Ye , Jianhua Zhu , Zihao Wang , James Zou , Jianzhu Ma , Yitao Liang

In recent years, the research focus of large language models (LLMs) and agents has shifted increasingly from demonstrating novel capabilities to complex reasoning and tackling challenging tasks. However, existing evaluations focus mainly on…

Background: Despite the current ubiquity of Large Language Models (LLMs) across the medical domain, there is a surprising lack of studies which address their reasoning behaviour. We emphasise the importance of understanding reasoning…

Computation and Language · Computer Science 2025-07-29 Shamus Sim , Tyrone Chen

The reasoning segmentation task, which demands a nuanced comprehension of intricate queries to accurately pinpoint object regions, is attracting increasing attention. However, Multi-modal Large Language Models (MLLM) often find it difficult…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xiaoyi Bao , Siyang Sun , Shuailei Ma , Kecheng Zheng , Yuxin Guo , Guosheng Zhao , Yun Zheng , Xingang Wang

We investigate how to teach large language models (LLMs) to perform scientific reasoning by leveraging expert discussions as a learning signal. Focusing on the genomics domain, we develop an automated pipeline to extract trainable data and…

Artificial Intelligence · Computer Science 2025-06-04 Ming Yin , Yuanhao Qu , Ling Yang , Le Cong , Mengdi Wang

Large Language Models (LLMs), despite their remarkable capabilities, rely on singular, pre-dominant reasoning paradigms, hindering their performance on intricate problems that demand diverse cognitive strategies. To address this, we…

Computation and Language · Computer Science 2025-09-29 Zishan Ahmad , Saisubramaniam Gopalakrishnan

Despite the remarkable advancements and widespread applications of deep neural networks, their ability to perform reasoning tasks remains limited, particularly in domains requiring structured, abstract thought. In this paper, we investigate…

Computation and Language · Computer Science 2025-09-16 Satyam Goyal , Soham Dan

Large Language Models (LLMs) are playing an increasingly important role in physics research by assisting with symbolic manipulation, numerical computation, and scientific reasoning. However, ensuring the reliability, transparency, and…

Artificial Intelligence · Computer Science 2025-08-19 Yinggan Xu , Hana Kimlee , Yijia Xiao , Di Luo

Despite notable advancements in Retrieval-Augmented Generation (RAG) systems that expand large language model (LLM) capabilities through external retrieval, these systems often struggle to meet the complex and diverse needs of real-world…

Computation and Language · Computer Science 2025-03-13 Jinyu Wang , Jingjing Fu , Rui Wang , Lei Song , Jiang Bian

Scientific reasoning poses an excessive challenge for even the most advanced Large Language Models (LLMs). To make this task more practical and solvable for LLMs, we introduce a new task setting named tool-augmented scientific reasoning.…

Computation and Language · Computer Science 2024-02-22 Yubo Ma , Zhibin Gou , Junheng Hao , Ruochen Xu , Shuohang Wang , Liangming Pan , Yujiu Yang , Yixin Cao , Aixin Sun , Hany Awadalla , Weizhu Chen

Recent developments in AI have reinvigorated pursuits to advance the (life) sciences using AI techniques, thereby creating a renewed opportunity to bridge different fields and find synergies. Headlines for AI and the life sciences have been…

Computational Engineering, Finance, and Science · Computer Science 2024-10-18 Pedro Zuidberg Dos Martires , Vincent Derkinderen , Luc De Raedt , Marcus Krantz

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

Computation and Language · Computer Science 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie

The emergence of large language models offers new possibilities for structured exploration of scientific knowledge. Rather than viewing scientific discovery as isolated ideas or content, we propose a structured approach that emphasizes the…

Artificial Intelligence · Computer Science 2025-04-15 Junlan Chen , Kexin Zhang , Daifeng Li , Yangyang Feng , Yuxuan Zhang , Bowen Deng
‹ Prev 1 3 4 5 6 7 10 Next ›