English
Related papers

Related papers: Auto Researching, not hyperparameter tuning: Conve…

200 papers

Agents equipped with search tools have emerged as effective solutions for knowledge-intensive tasks. While Large Language Models (LLMs) exhibit strong reasoning capabilities, their high computational cost limits practical deployment for…

Artificial Intelligence · Computer Science 2026-04-07 Yizhou Liu , Qi Sun , Yulin Chen , Siyue Zhang , Chen Zhao

Developing autonomous agents for web-based tasks is a core challenge in AI. While Large Language Model (LLM) agents can interpret complex user requests, they often operate as black boxes, making it difficult to diagnose why they fail or how…

Artificial Intelligence · Computer Science 2026-03-16 Orit Shahnovsky , Rotem Dror

Large Language Models (LLMs) are increasingly applied to software engineering (SE), yet their potential for autonomous, role-oriented collaboration remains largely underexplored. Understanding how multiple LLM-based agents coordinate,…

Topology optimization is a widely used design method that produces optimized material distributions for prescribed objectives and constraints through well-established numerical algorithms. Throughout the workflow, engineers make a series of…

Multiagent Systems · Computer Science 2026-05-25 Hyunjee Park , Hayoung Chung

Rapidly increasing context lengths have led to the assumption that large language models (LLMs) can directly reason over entire codebases. Concurrently, recent advances in LLMs have enabled strong performance on software engineering…

Software Engineering · Computer Science 2026-03-09 Ravi Raju , Mengmeng Ji , Shubhangi Upasani , Bo Li , Urmish Thakker

Deploying compound LLM agents in adversarial, partially observable sequential environments requires navigating several design dimensions: (1) what the agent sees, (2) how it reasons, and (3) how tasks are decomposed across components. Yet…

Artificial Intelligence · Computer Science 2026-05-18 Igor Bogdanov , Chung-Horng Lung , Thomas Kunz , Jie Gao , Adrian Taylor , Marzia Zaman

We present a controlled study of multi-hop contextual reasoning in large language models, providing a clean demonstration of the task-method dissociation: rule-based pattern matching achieves 100% success on structured information retrieval…

Artificial Intelligence · Computer Science 2026-01-09 Brady Steele , Micah Katz

Agentic security systems increasingly audit live targets with tool-using LLMs, but prior systems fix a single coordination topology, leaving unclear when additional agents help and when they only add cost. We treat topology choice as an…

Cryptography and Security · Computer Science 2026-04-22 Isaac David , Arthur Gervais

Multi-hop question answering over knowledge graphs remains computationally challenging due to the combinatorial explosion of possible reasoning paths. Recent approaches rely on expensive Large Language Model (LLM) inference for both entity…

Computation and Language · Computer Science 2025-11-26 Manil Shrestha , Edward Kim

LLM agent systems are built by stacking scaffolding components (planning, tools, memory, self-reflection, retrieval) assuming more is better. We study cross-component interference (CCI): degradation when components interact destructively.…

Artificial Intelligence · Computer Science 2026-05-08 Ming Liu

LLM agents increasingly perform end-to-end ML engineering tasks where success is judged by a single scalar test metric. This creates a structural vulnerability: an agent can increase the reported score by compromising the evaluation…

Artificial Intelligence · Computer Science 2026-03-13 Yonas Atinafu , Robin Cohen

Large language models (LLMs) are increasingly explored for their reasoning capabilities, yet their ability to perform structured, constraint-based optimization from natural language remains insufficiently understood. This study evaluates…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-18 Aasish Kumar Sharma , Julian Kunkel

Recent work reports strong performance from multi-agent LLM systems (MAS), but these gains are often confounded by increased test-time computation. When computation is normalized, single-agent systems (SAS) can match or outperform MAS, yet…

Computation and Language · Computer Science 2026-04-14 Dat Tran , Douwe Kiela

Non-Local (NL) blocks have been widely studied in various vision tasks. However, it has been rarely explored to embed the NL blocks in mobile neural networks, mainly due to the following challenges: 1) NL blocks generally have heavy…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Yingwei Li , Xiaojie Jin , Jieru Mei , Xiaochen Lian , Linjie Yang , Cihang Xie , Qihang Yu , Yuyin Zhou , Song Bai , Alan Yuille

Large Language Models (LLMs) have demonstrated emergent common-sense reasoning and Theory of Mind (ToM) capabilities, making them promising candidates for developing coordination agents. This study introduces the LLM-Coordination Benchmark,…

Computation and Language · Computer Science 2025-04-30 Saaket Agashe , Yue Fan , Anthony Reyna , Xin Eric Wang

Using multiple agents was found to improve the debugging capabilities of Large Language Models. However, increasing the number of LLM-agents has several drawbacks such as increasing the running costs and rising the risk for the agents to…

Software Engineering · Computer Science 2025-04-28 Yacine Majdoub , Eya Ben Charrada , Haifa Touati

Modern scientific discovery increasingly relies on high-performance computing for complex modeling and simulation. A key challenge in improving parallel program performance is efficiently mapping tasks to processors and data to memory, a…

Machine Learning · Computer Science 2025-06-02 Anjiang Wei , Allen Nie , Thiago S. F. X. Teixeira , Rohan Yadav , Wonchan Lee , Ke Wang , Alex Aiken

Large Language Models (LLMs) have transformed software development and AI applications. While LLMs are designed for text processing, LLM agents extend this capability by enabling autonomous actions, tool use, and multi-step task completion.…

Software Engineering · Computer Science 2026-04-21 Niful Islam , Muhammad Anas Raza , Mohammad Wardat

Recent work has questioned whether large language models (LLMs) can perform genuine in-context learning (ICL) for scientific experimental design, with prior studies suggesting that LLM-based agents exhibit no sensitivity to experimental…

Large Language Model (LLM)-empowered multi-agent systems extend the cognitive boundaries of individual agents through disciplined collaboration and interaction, while constructing these systems often requires labor-intensive manual designs.…

Machine Learning · Computer Science 2025-06-10 Guibin Zhang , Luyang Niu , Junfeng Fang , Kun Wang , Lei Bai , Xiang Wang