English
Related papers

Related papers: Nonstandard Errors in AI Agents

200 papers

This paper investigates how similarity in the informational representation of market states among Artificial Intelligence (AI) trading agents can generate systemic instability in financial markets. We construct a structural multi-agent…

Trading and Market Microstructure · Quantitative Finance 2026-04-28 Yimeng Qiu , Qiwei Han

Multi-agent AI systems can be used for simulating collective decision-making in scientific and practical applications. They can also be used to introduce a diverse group discussion step in chatbot pipelines, enhancing the cultural…

Artificial Intelligence · Computer Science 2024-08-16 Razan Baltaji , Babak Hemmatian , Lav R. Varshney

We investigate whether giving LLM agents the collaborative tools and autonomy that humans naturally use for problem solving can improve their performance. We equip Claude Code agents with MCP-based social media and journaling tools and…

Artificial Intelligence · Computer Science 2025-09-18 Harper Reed , Michael Sugimura , Angelo Zangari

Agentic systems are evaluated on benchmarks where agents interact with environments to solve tasks. Most papers report a pass@1 score computed from a single run per task, assuming this gives a reliable performance estimate. We test this…

Machine Learning · Computer Science 2026-03-26 Bjarni Haukur Bjarnason , André Silva , Martin Monperrus

We report an exploratory red-teaming study of autonomous language-model-powered agents deployed in a live laboratory environment with persistent memory, email accounts, Discord access, file systems, and shell execution. Over a two-week…

Prior work on trustworthy AI emphasizes model-internal properties such as bias mitigation, adversarial robustness, and interpretability. As AI systems evolve into autonomous agents deployed in open environments and increasingly connected to…

Artificial Intelligence · Computer Science 2026-05-06 Wenyue Hua , Tianyi Peng , Chi Wang , Jiaxin Pei , Ian Kaufman , Bryan Lim , Chandler Fang

Classic no-trade theorems attribute trade to heterogeneous beliefs. We re-examine this conclusion for AI agents, asking if trade can arise from computational limitations, under common beliefs. We model agents' bounded computational…

Computer Science and Game Theory · Computer Science 2025-12-23 Hanyu Li , Xiaotie Deng

We study the tendency of AI systems to deceive by constructing a realistic simulation setting of a company AI assistant. The simulated company employees provide tasks for the assistant to complete, these tasks spanning writing assistance,…

Computation and Language · Computer Science 2024-05-06 Olli Järviniemi , Evan Hubinger

We propose a stylized model of human-AI collaboration that isolates a mechanism we call the novelty bottleneck: the fraction of a task requiring human judgment creates an irreducible serial component analogous to Amdahl's Law in parallel…

Artificial Intelligence · Computer Science 2026-03-31 Jacky Liang

Large Language Models demonstrate remarkable capabilities yet remain fundamentally probabilistic, presenting critical reliability challenges for enterprise deployment. We introduce the Six Sigma Agent, a novel architecture that achieves…

Artificial Intelligence · Computer Science 2026-02-02 Khush Patel , Siva Surendira , Jithin George , Shreyas Kapale

Many leading AI researchers expect AI development to exceed the transformative impact of all previous technological revolutions. This belief is based on the idea that AI will be able to automate the process of AI research itself, leading to…

Computers and Society · Computer Science 2026-03-09 Severin Field , Raymond Douglas , David Krueger

Recently, significant improvements have been achieved in various natural language processing tasks using neural sequence-to-sequence models. While aiming for the best generation quality is important, ultimately it is also necessary to…

Computation and Language · Computer Science 2019-10-07 Jan Niehues , Ngoc-Quan Pham

AI Agents can perform complex operations at great speed, but just like all the humans we have ever hired, their intelligence remains fallible. Miscommunications aren't noticed, systemic biases have no counter-action, and inner monologues…

Multiagent Systems · Computer Science 2026-01-22 Gopal Vijayaraghavan , Prasanth Jayachandran , Arun Murthy , Sunil Govindan , Vivek Subramanian

We demonstrate how AI agents can coordinate to deceive oversight systems using automated interpretability of neural networks. Using sparse autoencoders (SAEs) as our experimental framework, we show that language models (Llama, DeepSeek R1,…

Artificial Intelligence · Computer Science 2025-04-11 Simon Lermen , Mateusz Dziemian , Natalia Pérez-Campanero Antolín

The future of software engineering--SE 3.0--is unfolding with the rise of AI teammates: autonomous, goal-driven systems collaborating with human developers. Among these, autonomous coding agents are especially transformative, now actively…

Software Engineering · Computer Science 2025-07-22 Hao Li , Haoxiang Zhang , Ahmed E. Hassan

In many real-world continuous action domains, human agents must decide which actions to attempt and then execute those actions to the best of their ability. However, humans cannot execute actions without error. Human performance in these…

Artificial Intelligence · Computer Science 2024-08-21 Delma Nieves-Rivera , Christopher Archibald

Adaptive interventions (AIs) are increasingly becoming popular in medical and behavioral sciences. An AI is a sequence of individualized intervention options that specify for whom and under what conditions different intervention options…

Applications · Statistics 2018-12-18 Palash Ghosh , Inbal Nahum-Shani , Bonnie Spring , Bibhas Chakraborty

Recent auto-research systems can produce complete papers, but feasibility is not the same as quality, and the field still lacks a systematic study of how good agent-generated papers actually are. We introduce ResearchArena, a minimal…

Artificial Intelligence · Computer Science 2026-05-20 Zhengxin Zhang , Ning Wang , Sainyam Galhotra , Claire Cardie

Large language model (LLM) based coding agents increasingly act as autonomous contributors that generate and merge pull requests, yet their real-world effects on software projects are unclear-especially compared with widely adopted…

Software Engineering · Computer Science 2026-01-28 Shyam Agarwal , Hao He , Bogdan Vasilescu

This work explores a social learning problem with agents having nonidentical noise variances and mismatched beliefs. We consider an $N$-agent binary hypothesis test in which each agent sequentially makes a decision based not only on a…

Computer Science and Game Theory · Computer Science 2019-10-02 Daewon Seo , Ravi Kiran Raman , Joong Bum Rhim , Vivek K Goyal , Lav R Varshney