AI Must not be Fully Autonomous
Abstract
Autonomous Artificial Intelligence (AI) has many benefits. It also has many risks. In this work, we identify the 3 levels of autonomous AI. We are of the position that AI must not be fully autonomous because of the many risks, especially as artificial superintelligence (ASI) is speculated to be just decades away. Fully autonomous AI, which can develop its own objectives, is at level 3 and without responsible human oversight. However, responsible human oversight is crucial for mitigating the risks. To ague for our position, we discuss theories of autonomy, AI and agents. Then, we offer 12 distinct arguments and 6 counterarguments with rebuttals to the counterarguments. We also present 15 pieces of recent evidence of AI misaligned values and other risks in the appendix.
Cite
@article{arxiv.2507.23330,
title = {AI Must not be Fully Autonomous},
author = {Tosin Adewumi and Lama Alkhaled and Florent Imbert and Hui Han and Nudrat Habib and Karl Löwenmark},
journal= {arXiv preprint arXiv:2507.23330},
year = {2025}
}
Comments
11 pages, 1 figure