English
Related papers

Related papers: Probing Scientific General Intelligence of LLMs wi…

200 papers

Artificial intelligence systems are transforming scientific discovery by accelerating specific research tasks, from protein structure prediction to materials design, yet remain confined to narrow domains requiring substantial human…

Artificial Intelligence · Computer Science 2026-01-30 Gabrielle Wehr , Reuben Rideaux , Amaya J. Fox , David R. Lightfoot , Jason Tangen , Jason B. Mattingley , Shane E. Ehrhardt

We introduce SMGI, a structural theory of general artificial intelligence, and recast the foundational problem of learning from the optimization of hypotheses within fixed environments to the controlled evolution of the learning interface…

Artificial Intelligence · Computer Science 2026-03-10 Aomar Osmani

Recent advancements in artificial intelligence (AI), particularly in large language models (LLMs) such as OpenAI-o1 and DeepSeek-R1, have demonstrated remarkable capabilities in complex domains such as logical reasoning and experimental…

Scientists across all disciplines share a common challenge: the divide between their theoretical knowledge and the specialized skills and time needed to build interactive tools to communicate this expertise. While large language models…

While Large Language Models (LLMs) demonstrate remarkable capabilities in scientific tasks such as literature analysis and experimental design (e.g., accurately extracting key findings from papers or generating coherent experimental…

Computation and Language · Computer Science 2026-02-24 Kai Ruan , Xuan Wang , Jixiang Hong , Peng Wang , Yang Liu , Hao Sun

Recent advances in large language models (LLMs) have demonstrated impressive reasoning capacities that mirror human-like thinking. However, whether LLMs possess genuine fluid intelligence (i.e., the ability to reason abstractly and…

Artificial Intelligence · Computer Science 2025-09-30 Yue Yang , MingKang Chen , Qihua Liu , Mengkang Hu , Qiguang Chen , Gengrui Zhang , Shuyue Hu , Guangtao Zhai , Yu Qiao , Yu Wang , Wenqi Shao , Ping Luo

Large Language Models (LLMs) have shown promise in accelerating the scientific research pipeline. A key capability for this process is the ability to generate novel research ideas, and prior studies have found settings in which…

Computation and Language · Computer Science 2025-06-27 Chenglei Si , Tatsunori Hashimoto , Diyi Yang

Large Language Models (LLMs) have extended their impact beyond Natural Language Processing, substantially fostering the development of interdisciplinary research. Recently, various LLM-based agents have been developed to assist scientific…

The rapid advancement of large language models (LLMs) has opened new possibilities for automating the proposal of innovative scientific ideas. This process involves two key phases: literature retrieval and idea generation. However, existing…

Computation and Language · Computer Science 2025-02-18 Wenxiao Wang , Lihui Gu , Liye Zhang , Yunxiang Luo , Yi Dai , Chen Shen , Liang Xie , Binbin Lin , Xiaofei He , Jieping Ye

While AI innovation accelerates rapidly, the intellectual process behind breakthroughs -- how researchers identify gaps, synthesize prior work, and generate insights -- remains poorly understood. The lack of structured data on scientific…

Artificial Intelligence · Computer Science 2026-01-09 Jiachen Liu , Maestro Harmon , Zechen Zhang

Recent advances in large language models (LLMs) have opened new avenues for accelerating scientific research. While models are increasingly capable of assisting with routine tasks, their ability to contribute to novel, expert-level…

Artificial General Intelligence (AGI) has been a long-standing goal of humanity, with the aim of creating machines capable of performing any intellectual task that humans can do. To achieve this, AGI researchers draw inspiration from the…

Artificial Intelligence · Computer Science 2023-03-29 Lin Zhao , Lu Zhang , Zihao Wu , Yuzhong Chen , Haixing Dai , Xiaowei Yu , Zhengliang Liu , Tuo Zhang , Xintao Hu , Xi Jiang , Xiang Li , Dajiang Zhu , Dinggang Shen , Tianming Liu

Large language models (LLMs) have demonstrated their remarkable performance across various language understanding tasks. While emerging benchmarks have been proposed to evaluate LLMs in various domains such as mathematics and computer…

Artificial Intelligence · Computer Science 2024-10-28 Junnan Dong , Zijin Hong , Yuanchen Bei , Feiran Huang , Xinrun Wang , Xiao Huang

Large Language Model (LLM)-based multi-agent systems (MAS) demonstrate remarkable potential for scientific discovery. Existing approaches, however, often automate scientific discovery using predefined workflows that lack rationality…

Machine Learning · Computer Science 2026-02-10 Yingming Pu , Tao Lin , Hongyu Chen

Conducting literature reviews for scientific papers is essential for understanding research, its limitations, and building on existing work. It is a tedious task which makes an automatic literature review generator appealing. Unfortunately,…

This paper presents a detailed case study of how artificial intelligence, especially large language models, can be integrated into historical research workflows. The workflow is divided into nine steps, covering the full research cycle from…

Computers and Society · Computer Science 2025-08-05 Christian Henriot

Scientific idea generation is central to discovery, requiring the joint satisfaction of novelty and scientific soundness. Unlike standard reasoning or general creative generation, scientific ideation is inherently open-ended and…

Deep research agents have emerged as powerful systems for addressing complex queries. Meanwhile, LLM-based retrievers have demonstrated strong capability in following instructions or reasoning. This raises a critical question: can LLM-based…

Information Retrieval · Computer Science 2026-02-09 Tiansheng Hu , Yilun Zhao , Canyu Zhang , Arman Cohan , Chen Zhao

Real-world mathematical modeling is inherently an experiential and collaborative endeavor. Domain experts rarely solve complex problems from scratch; instead, they draw upon analogies from historical cases and subject their hypotheses to…

Multiagent Systems · Computer Science 2026-04-03 Junhao Jia , Huangwei Chen , Ruiying Sun , Yanhui Song , Haishuai Wang , Jiajun Bu , Lei Wu

As research institutions increasingly commit to supporting the United Nations' Sustainable Development Goals (SDGs), there is a pressing need to accurately assess their research output against these goals. Current approaches, primarily…

Digital Libraries · Computer Science 2025-03-05 William A. Ingram , Bipasha Banerjee , Edward A. Fox