English
Related papers

Related papers: Probing Scientific General Intelligence of LLMs wi…

200 papers

Scientific reasoning poses an excessive challenge for even the most advanced Large Language Models (LLMs). To make this task more practical and solvable for LLMs, we introduce a new task setting named tool-augmented scientific reasoning.…

Computation and Language · Computer Science 2024-02-22 Yubo Ma , Zhibin Gou , Junheng Hao , Ruochen Xu , Shuohang Wang , Liangming Pan , Yujiu Yang , Yixin Cao , Aixin Sun , Hany Awadalla , Weizhu Chen

Scientific innovation relies on detailed workflows, which include critical steps such as analyzing literature, generating ideas, validating these ideas, interpreting results, and inspiring follow-up research. However, scientific…

Computation and Language · Computer Science 2024-06-11 Xingjian Zhang , Yutong Xie , Jin Huang , Jinge Ma , Zhaoying Pan , Qijia Liu , Ziyang Xiong , Tolga Ergen , Dongsub Shim , Honglak Lee , Qiaozhu Mei

The transition of Large Language Models (LLMs) from passive knowledge retrievers to autonomous clinical agents demands a shift in evaluation-from static accuracy to dynamic behavioral reliability. To explore this boundary in dentistry, a…

Computation and Language · Computer Science 2026-01-21 Hongyang Ma , Tiantian Gu , Huaiyuan Sun , Huilin Zhu , Yongxin Wang , Jie Li , Wubin Sun , Zeliang Lian , Yinghong Zhou , Yi Gao , Shirui Wang , Zhihui Tang

Large language models (LLMs) have shown strong knowledge reserves and task-solving capabilities, but still face the challenge of severe hallucination, hindering their practical application. Though scientific theories and rules can…

Computation and Language · Computer Science 2026-04-09 Maotian Ma , Zheni Zeng , Zhenghao Liu , Yukun Yan

This study evaluates large language models (LLMs) in generating code from algorithm descriptions in recent NLP papers. The task requires two key competencies: (1) algorithm comprehension: synthesizing information from papers and academic…

Computation and Language · Computer Science 2025-08-08 Yanzheng Xiang , Hanqi Yan , Shuyin Ouyang , Lin Gui , Yulan He

In recent years, the introduction of AI technologies has brought transformative changes to scientific computing. However, AI models typically focus on single-task and single-modal data processing, limiting their application. To address…

Symbolic Computation · Computer Science 2024-11-26 Tianhao Chen , Pengbo Xu , Pengbo Xu

We tasked 16 state-of-the-art large language models (LLMs) with estimating the likelihood of Artificial General Intelligence (AGI) emerging by 2030. To assess the quality of these forecasts, we implemented an automated peer review process…

Artificial Intelligence · Computer Science 2025-04-23 Fabrizio Davide , Pietro Torre , Leonardo Ercolani , Andrea Gaggioli

Large Language Models (LLMs) demonstrate potential in the field of scientific idea generation. However, the generated results often lack controllable academic context and traceable inspiration pathways. To bridge this gap, this paper…

Artificial Intelligence · Computer Science 2026-02-27 Pengzhen Xie , Huizhi Liang

Large language models (LLMs) have exhibited exceptional capabilities in natural language understanding and generation, image recognition, and multimodal tasks, charting a course towards AGI and emerging as a central issue in the global…

Computation and Language · Computer Science 2025-11-20 Guoqiang Liang , Jingqian Gong , Mengxuan Li , Gege Lin , Shuo Zhang

Collaboration is the defining mode of modern science, yet its core mechanism -- feedback -- remains hard to observe, difficult to scale, and unequally distributed. Here we test whether large language models (LLMs) can contribute to this…

Physics and Society · Physics 2026-05-26 Binglu Wang , Weixin Liang , Jiahui Xue , Yuhui Zhang , Hancheng Cao , Dashun Wang , Yian Yin

Scientific discoveries increasingly rely on complex multimodal reasoning based on information-intensive scientific data and domain-specific expertise. Empowered by expert-level scientific benchmarks, scientific Multimodal Large Language…

Large language models (LLMs) bring unprecedented flexibility in defining and executing complex, creative natural language generation (NLG) tasks. Yet, this flexibility brings new challenges, as it introduces new degrees of freedom in…

Computation and Language · Computer Science 2024-07-08 Furkan Şahinuç , Ilia Kuznetsov , Yufang Hou , Iryna Gurevych

This research pioneers the use of fine-tuned Large Language Models (LLMs) to automate Systematic Literature Reviews (SLRs), presenting a significant and novel contribution in integrating AI to enhance academic research methodologies. Our…

Computation and Language · Computer Science 2025-02-21 Teo Susnjak , Peter Hwang , Napoleon H. Reyes , Andre L. C. Barczak , Timothy R. McIntosh , Surangika Ranathunga

This paper presents multi- and interdisciplinary approaches for finding the appropriate AI technologies for research information. Professional research information management (RIM) is becoming increasingly important as an expressly…

Digital Libraries · Computer Science 2024-05-24 Otmane Azeroual , Tibor Koltay

With the advent of large language models (LLMs), there is a growing interest in applying LLMs to scientific tasks. In this work, we conduct an experimental study to explore applicability of LLMs for configuring, annotating, translating,…

Human-Computer Interaction · Computer Science 2025-10-13 Orcun Yildiz , Tom Peterka

Large Language Models (LLMs) and Large Vision-Language Models (LVLMs) have demonstrated impressive language/vision reasoning abilities, igniting the recent trend of building agents for targeted applications such as shopping assistants or AI…

Artificial Intelligence · Computer Science 2025-04-14 Liqiang Jing , Zhehui Huang , Xiaoyang Wang , Wenlin Yao , Wenhao Yu , Kaixin Ma , Hongming Zhang , Xinya Du , Dong Yu

Artificial intelligence systems for scientific discovery have demonstrated remarkable potential, yet existing approaches remain largely proprietary and operate in batch-processing modes requiring hours per research cycle, precluding…

Artificial Intelligence · Computer Science 2026-01-28 Lukas Weidener , Marko Brkić , Mihailo Jovanović , Ritvik Singh , Chiara Baccin , Emre Ulgac , Alex Dobrin , Aakaash Meduri

The integration of artificial intelligence into experimental fluid mechanics promises to accelerate discovery, yet most AI applications remain narrowly focused on numerical studies. This work proposes an AI Fluid Scientist framework that…

Fluid Dynamics · Physics 2025-12-05 Haodong Feng , Lugang Ye , Dixia Fan

The exponential growth of scientific literature challenges researchers extracting and synthesizing knowledge. Traditional search engines return many sources without direct, detailed answers, while general-purpose LLMs may offer concise…

Information Retrieval · Computer Science 2025-06-24 Sajratul Y. Rubaiat , Hasan M. Jamil
‹ Prev 1 4 5 6 7 8 10 Next ›