English
Related papers

Related papers: AI Scientists Fail Without Strong Implementation C…

200 papers

The rapid emergence of large language models (LLMs) has raised urgent questions across the modern workforce about this new technology's strengths, weaknesses, and capabilities. For privacy professionals, the question is whether these AI…

Computers and Society · Computer Science 2025-08-13 Zane Witherspoon , Thet Mon Aye , YingYing Hao

AI scientist systems are increasingly deployed for autonomous research, yet their academic integrity has never been systematically evaluated. We introduce SCIINTEGRITY-BENCH, the first benchmark designed around a dilemmatic evaluation…

Artificial Intelligence · Computer Science 2026-05-12 Zonglin Yang , Xingtong Liu , Xinyan Xu

Autonomous AI research agents aim to accelerate scientific discovery by automating the research pipeline, from hypothesis generation to peer review. However, existing benchmarks rarely test a fundamental bottleneck: whether Large Language…

Machine Learning · Computer Science 2026-05-29 Sy-Tuyen Ho , Minghui Liu , Huy Nghiem , Furong Huang

The widespread adoption of Large Language Models (LLMs) has made the detection of AI-Generated text a pressing and complex challenge. Although many detection systems report high benchmark accuracy, their reliability in real-world settings…

Computation and Language · Computer Science 2026-04-23 Shushanta Pudasaini , Luis Miralles-Pechuán , David Lillis , Marisa Llorens Salvador

The convergence of LLM-powered research assistants and AI-based peer review systems creates a critical vulnerability: fully automated publication loops where AI-generated research is evaluated by AI reviewers without human oversight. We…

Cryptography and Security · Computer Science 2025-10-22 Fengqing Jiang , Yichen Feng , Yuetai Li , Luyao Niu , Basel Alomair , Radha Poovendran

Recent advancements in large language model (LLM) agents have significantly accelerated scientific discovery automation, yet concurrently raised critical ethical and safety concerns. To systematically address these challenges, we introduce…

Artificial Intelligence · Computer Science 2025-05-30 Kunlun Zhu , Jiaxun Zhang , Ziheng Qi , Nuoxing Shang , Zijia Liu , Peixuan Han , Yue Su , Haofei Yu , Jiaxuan You

Artificial intelligence (AI) has been increasingly applied in scientific activities for decades; however, it is still far from an insightful and trustworthy collaborator in the scientific process. Most existing AI methods are either too…

Artificial Intelligence · Computer Science 2022-02-08 Morad Behandish , John Maxwell , Johan de Kleer

The transformative potential of artificial intelligence (AI) in medical Imaging (MI) is well recognized. Yet despite promising reports in research settings, many AI tools fail to achieve clinical adoption in practice. In fact, more…

Medical Physics · Physics 2025-11-26 Ahmad Fayaz-Bakhsh , Janice Tania , Syaheerah Lebai Lutfi , Abhinav K. Jha , Arman Rahmim

AI is increasingly playing a pivotal role in transforming how scientific discoveries are made. We introduce The AI Scientist-v2, an end-to-end agentic system capable of producing the first entirely AI generated peer-review-accepted workshop…

Artificial Intelligence · Computer Science 2025-04-14 Yutaro Yamada , Robert Tjarko Lange , Cong Lu , Shengran Hu , Chris Lu , Jakob Foerster , Jeff Clune , David Ha

The increasing availability of large-scale datasets has fueled rapid progress across many scientific fields, creating unprecedented opportunities for research and discovery while posing significant analytical challenges. Recent advances in…

Artificial Intelligence · Computer Science 2025-12-01 Erzhuo Shao , Yifang Wang , Yifan Qian , Zhenyu Pan , Han Liu , Dashun Wang

Large-scale Language Models (LLMs) have revolutionized human-AI interaction and achieved significant success in the generation of novel ideas. However, current assessments of idea generation overlook crucial factors such as knowledge…

Artificial Intelligence · Computer Science 2025-05-27 Yansheng Qiu , Haoquan Zhang , Zhaopan Xu , Ming Li , Diping Song , Zheng Wang , Kaipeng Zhang

Artificial intelligence's (AI) progress holds great promise in tackling pressing societal concerns such as health and climate. Large Language Models (LLM) and the derived chatbots, like ChatGPT, have highly improved the natural language…

Artificial Intelligence (AI) is becoming ubiquitous in domains such as medicine and natural science research. However, when AI systems are implemented in practice, domain experts often refuse them. Low acceptance hinders effective human-AI…

Human-Computer Interaction · Computer Science 2024-03-26 Auste Simkute , Ewa Luger , Michael Evans , Rhianne Jones

The use of artificial intelligence (AI) in research across all disciplines is becoming ubiquitous. However, this ubiquity is largely driven by hyperspecific AI models developed during scientific studies for accomplishing a well-defined,…

Computers and Society · Computer Science 2023-12-19 Rishab Jain , Aditya Jain

Artificial intelligence (AI) raises expectations of substantial increases in rates of technological and scientific progress, but such anticipations are often not connected to detailed ground-level studies of AI use in innovation processes.…

Computers and Society · Computer Science 2025-11-21 John P. Nelson , Olajide Olugbade , Philip Shapira , Justin B. Biddle

AI researchers employ not only the scientific method, but also methodology from mathematics and engineering. However, the use of the scientific method - specifically hypothesis testing - in AI is typically conducted in service of…

The development of AI applications is a multidisciplinary effort, involving multiple roles collaborating with the AI developers, an umbrella term we use to include data scientists and other AI-adjacent roles on the same team. During these…

Computers and Society · Computer Science 2021-04-16 David Piorkowski , Soya Park , April Yi Wang , Dakuo Wang , Michael Muller , Felix Portnoy

Modern scientific discovery increasingly requires coordinating distributed facilities and heterogeneous resources, forcing researchers to act as manual workflow coordinators rather than scientists. Advances in AI leading to AI agents show…

Artificial Intelligence · Computer Science 2025-09-15 Woong Shin , Renan Souza , Daniel Rosendo , Frédéric Suter , Feiyi Wang , Prasanna Balaprakash , Rafael Ferreira da Silva

Artificial Intelligence (AI) is a fast-growing research and development (R&D) discipline which is attracting increasing attention because of its promises to bring vast benefits for consumers and businesses, with considerable benefits…

Artificial Intelligence · Computer Science 2022-05-10 Zhenghua Chen , Min Wu , Alvin Chan , Xiaoli Li , Yew-Soon Ong

Recent research advances in Artificial Intelligence (AI) have yielded promising results for automated software vulnerability management. AI-based models are reported to greatly outperform traditional static analysis tools, indicating a…

Cryptography and Security · Computer Science 2024-05-07 Shengye Wan , Joshua Saxe , Craig Gomes , Sahana Chennabasappa , Avilash Rath , Kun Sun , Xinda Wang