English
Related papers

Related papers: Scientific judgment drifts over time in AI ideatio…

200 papers

The emergence of large language models (LLMs) is propelling automated scientific discovery to the next level, with LLM-based Artificial Intelligence (AI) Scientist systems now taking the lead in scientific research. Several influential…

Artificial Intelligence · Computer Science 2025-08-04 Qiujie Xie , Yixuan Weng , Minjun Zhu , Fuchen Shen , Shulin Huang , Zhen Lin , Jiahui Zhou , Zilan Mao , Zijie Yang , Linyi Yang , Jian Wu , Yue Zhang

While LLMs have seen substantial improvement in reasoning capabilities, they also sometimes overthink, generating unnecessary reasoning steps, particularly under uncertainty, given ill-posed or ambiguous queries. We introduce statistically…

Artificial Intelligence · Computer Science 2026-02-17 Yangxinyu Xie , Tao Wang , Soham Mallick , Yan Sun , Georgy Noarov , Mengxin Yu , Tanwi Mallick , Weijie J. Su , Edgar Dobriban

Scientific innovation is pivotal for humanity, and harnessing large language models (LLMs) to generate research ideas could transform discovery. However, existing LLMs often produce simplistic and repetitive suggestions due to their limited…

Artificial Intelligence · Computer Science 2024-10-29 Xiang Hu , Hongyu Fu , Jinge Wang , Yifeng Wang , Zhikun Li , Renjun Xu , Yu Lu , Yaochu Jin , Lili Pan , Zhenzhong Lan

The rapid growth of scientific literature makes it challenging for researchers to identify novel and impactful ideas, especially across disciplines. Modern artificial intelligence (AI) systems offer new approaches, potentially inspiring…

Artificial Intelligence · Computer Science 2025-01-09 Xuemei Gu , Mario Krenn

Artificial intelligence (AI) tools such as large language models (LLMs) are already altering student learning. Unlike previous technologies, LLMs can independently solve problems regardless of student understanding, yet are not always…

Theoretical Economics · Economics 2025-09-04 Eric Gao

The dual thinking framework considers fast, intuitive, and slower logical processing. The perception of dual thinking in vision requires images where inferences from intuitive and logical processing differ, and the latter is under-explored…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Kailas Dayanandan , Nikhil Kumar , Anand Sinha , Brejesh Lall

Large Language Models (LLMs) are increasingly being used to autonomously evaluate the quality of content in communication systems, e.g., to assess responses in telecom customer support chatbots. However, the impartiality of these AI…

Artificial Intelligence · Computer Science 2026-03-03 Jiaxin Gao , Chen Chen , Yanwen Jia , Xueluan Gong , Kwok-Yan Lam , Qian Wang

Autonomous scientific discovery with large language model (LLM)-based agents has recently made substantial progress, demonstrating the ability to automate end-to-end research workflows. However, existing systems largely rely on…

Computational Engineering, Finance, and Science · Computer Science 2026-01-29 Tengyue Xu , Zhuoyang Qian , Gaoge Liu , Li Ling , Zhentao Zhang , Biao Wu , Shuo Zhang , Ke Lu , Wei Shi , Ziqi Wang , Zheng Feng , Yan Luo , Shu Xu , Yongjin Chen , Zhibo Feng , Zhuo Chen , Bruce Yuan , Harry Wang , Kris Chen

Recent advancements in Large Language Models (LLMs) have demonstrated remarkable capabilities in various domains. However, effective decision-making relies heavily on strong reasoning abilities. Reasoning is the foundation for…

Computation and Language · Computer Science 2025-06-30 Dana Alsagheer , Yang Lu , Abdulrahman Kamal , Omar Kamal , Mohammad Kamal , Nada Mansour , Cosmo Yang Wu , Rambiba Karanjai , Sen Li , Weidong Shi

The integration of artificial intelligence (AI) into medical diagnostic workflows requires robust and consistent evaluation methods to ensure reliability, clinical relevance, and the inherent variability in expert judgments. Traditional…

Objective. Clinical AI documentation systems require evaluation methodologies that are clinically valid, economically viable, and sensitive to iterative changes. Methods requiring expert review per scoring instance are too slow and…

Artificial Intelligence · Computer Science 2026-04-28 Aaryan Shah , Andrew Hines , Alexia Downs , Denis Bajet , Paulius Mui , Fabiano Araujo , Laura Offutt , Aida Rutledge , Elizabeth Jimenez

We investigate whether modern AI can emulate expert creativity in complex scientific endeavors. We introduce novel methodology that utilizes original research articles published after the AI's training cutoff, ensuring no prior exposure,…

Artificial Intelligence · Computer Science 2024-04-09 Anirban Mukherjee , Hannah Hanwen Chang

Understanding the fundamentals of human reasoning is central to the development of any system built to closely interact with humans. Cognitive science pursues the goal of modeling human-like intelligence from a theory-driven perspective…

Artificial Intelligence · Computer Science 2020-03-12 Nicolas Riesterer , Daniel Brand , Marco Ragni

Modern science increasingly relies on ever-growing observational datasets and automated inference pipelines, under the implicit belief that accumulating more data makes scientific conclusions more reliable. Here we show that this belief can…

Machine Learning · Computer Science 2026-02-06 Zhipeng Zhang , Kai Li

Large language models (LLMs) demonstrate outstanding capabilities, but challenges remain regarding their ability to solve complex reasoning tasks, as well as their transparency, robustness, truthfulness, and ethical alignment. In this…

Computers and Society · Computer Science 2023-12-19 Konstantin Hebenstreit , Robert Praas , Matthias Samwald

Artificial intelligence systems, particularly large language models (LLMs), are increasingly being employed in high-stakes decisions that impact both individuals and society at large, often without adequate safeguards to ensure safety,…

Artificial Intelligence · Computer Science 2024-06-24 N. Zöller , J. Berger , I. Lin , N. Fu , J. Komarneni , G. Barabucci , K. Laskowski , V. Shia , B. Harack , E. A. Chu , V. Trianni , R. H. J. M. Kurvers , S. M. Herzog

While AI innovation accelerates rapidly, the intellectual process behind breakthroughs -- how researchers identify gaps, synthesize prior work, and generate insights -- remains poorly understood. The lack of structured data on scientific…

Artificial Intelligence · Computer Science 2026-01-09 Jiachen Liu , Maestro Harmon , Zechen Zhang

Human-in-the-loop validation is essential in safety-critical clinical AI, yet the transition between initial model inference and expert correction is rarely analyzed as a structured signal. We introduce a diagnostic alignment framework in…

Artificial Intelligence · Computer Science 2026-02-27 Dimitrios P. Panagoulias , Evangelia-Aikaterini Tsichrintzi , Georgios Savvidis , Evridiki Tsoureli-Nikita

Continual learning--the ability to acquire, retain, and refine knowledge over time--has always been fundamental to intelligence, both human and artificial. Historically, different AI paradigms have acknowledged this need, albeit with…

Machine Learning · Computer Science 2025-06-05 Jack Bell , Luigi Quarantiello , Eric Nuertey Coleman , Lanpei Li , Malio Li , Mauro Madeddu , Elia Piccoli , Vincenzo Lomonaco

Advances in large language models (LLMs) are rapidly transforming scientific work, yet empirical evidence on how these systems reshape research activities remains limited. We report a mixed-methods pilot evaluation of an AI-orchestrated…

Computers and Society · Computer Science 2026-02-24 Yuan An