English
Related papers

Related papers: Polymath: A Self-Optimizing Agent with Dynamic Hie…

200 papers

Recent large language models (LLMs) are promising for making decisions in grounded environments. However, LLMs frequently fail in complex decision-making tasks due to the misalignment between the pre-trained knowledge in LLMs and the actual…

Computation and Language · Computer Science 2023-10-27 Siqi Ouyang , Lei Li

Intelligent agent systems based on Large Language Models (LLMs) have shown great potential in real-world applications. However, existing agent frameworks still face critical limitations in task planning and execution, restricting their…

Information Retrieval · Computer Science 2025-04-30 Junjie Chen , Haitao Li , Jingli Yang , Yiqun Liu , Qingyao Ai

Improving Large Language Model (LLM) agents for sequential decision-making tasks typically requires extensive task-specific knowledge engineering--custom prompts, curated examples, and specialized observation/action spaces. We investigate a…

Machine Learning · Computer Science 2025-05-20 Vishnu Sarukkai , Zhiqiang Xie , Kayvon Fatahalian

Large Language Model (LLM) based multi-agent systems (MAS) show remarkable potential in collaborative problem-solving, yet they still face critical challenges: low communication efficiency, poor scalability, and a lack of effective…

Computation and Language · Computer Science 2025-02-19 Weize Chen , Jiarui Yuan , Chen Qian , Cheng Yang , Zhiyuan Liu , Maosong Sun

In recent research advancements within the community, large language models (LLMs) have sparked great interest in creating autonomous agents. However, current prompt-based agents often heavily rely on large-scale LLMs. Meanwhile, although…

Computation and Language · Computer Science 2025-03-04 Xueyang Feng , Bo Lan , Quanyu Dai , Lei Wang , Jiakai Tang , Xu Chen , Zhenhua Dong , Ji-Rong Wen

Agentic systems operating over large tool ecosystems must plan and execute long-horizon workflows under weak or non-verifiable supervision. While frontier models mitigate these challenges through scale and large context budgets, small…

Machine Learning · Computer Science 2026-03-10 Karan Gupta , Pranav Vajreshwari , Yash Pandya , Raghav Magazine , Akshay Nambi , Ahmed Awadallah

While diffusion models excel at generating high-quality images, they often struggle with accurate counting, attributes, and spatial relationships in complex multi-object scenes. One potential solution involves employing Multimodal Large…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiayang Sun , Hongbo Wang , Jie Cao , Huaibo Huang , Ran He

Large Language Models (LLMs) increasingly rely on agentic capabilities-iterative retrieval, tool use, and decision-making-to overcome the limits of static, parametric knowledge. Yet existing agentic frameworks treat external information as…

Computation and Language · Computer Science 2026-04-24 Yuanfu Sun , Kang Li , Dongzhe Fan , Jiajin Liu , Qiaoyu Tan

Large Language Models (LLMs) have demonstrated remarkable capabilities in orchestrating tools for reasoning tasks. However, existing methods rely on a step-wise paradigm that lacks a global perspective, which causes error accumulation over…

Artificial Intelligence · Computer Science 2026-05-11 Tairan Huang , Siyu Shang , Qiang Chen , Xiu Su , Yi Chen

There has been a growing interest in developing learner models to enhance learning and teaching experiences in educational environments. However, existing works have primarily focused on structured environments relying on meticulously…

Machine Learning · Computer Science 2024-05-01 Bahar Radmehr , Adish Singla , Tanja Käser

Language agents have achieved considerable performance on various complex question-answering tasks by planning with external tools. Despite the incessant exploration in this field, existing language agent systems still struggle with costly,…

Computation and Language · Computer Science 2024-05-28 Shuofei Qiao , Ningyu Zhang , Runnan Fang , Yujie Luo , Wangchunshu Zhou , Yuchen Eleanor Jiang , Chengfei Lv , Huajun Chen

The increasing complexity of user demands necessitates automation frameworks that can reliably translate open-ended instructions into robust, multi-step workflows. Current monolithic agent architectures often struggle with the challenges of…

Computation and Language · Computer Science 2026-03-23 Eslam Reda , Maged Yasser , Sara El-Metwally

This position paper argues that optimization problem solving can transition from expert-dependent to evolutionary agentic workflows. Traditional optimization practices rely on human specialists for problem formulation, algorithm selection,…

Optimization and Control · Mathematics 2025-05-08 Wenhao Li , Bo Jin , Mingyi Hong , Changhong Lu , Xiangfeng Wang

The era of foundation models has revolutionized AI research, yet Graph Foundation Models (GFMs) remain constrained by the scarcity of large-scale graph corpora. Traditional graph data synthesis techniques primarily focus on simplistic…

Machine Learning · Computer Science 2025-05-06 Enjun Du , Xunkai Li , Tian Jin , Zhihan Zhang , Rong-Hua Li , Guoren Wang

To sustain coherent long-term interactions, Large Language Model (LLM) agents must navigate the tension between acquiring new information and retaining prior knowledge. Current unified stream-based memory systems facilitate context updates…

Artificial Intelligence · Computer Science 2026-04-15 Zhaofen Wu , Hanrong Zhang , Fulin Lin , Wujiang Xu , Xinran Xu , Yankai Chen , Henry Peng Zou , Shaowen Chen , Weizhi Zhang , Xue Liu , Philip S. Yu , Hongwei Wang

Multi-agent systems (MAS) have emerged as a promising approach for enhancing the reasoning capabilities of large language models in complex problem-solving; however, current MAS frameworks suffer from poor flexibility and scalability with…

Multiagent Systems · Computer Science 2025-06-02 Heng Zhou , Hejia Geng , Xiangyuan Xue , Li Kang , Yiran Qin , Zhiyong Wang , Zhenfei Yin , Lei Bai

Despite the remarkable progress of large language models (LLMs), the capabilities of standalone LLMs have begun to plateau when tackling real-world, complex tasks that require interaction with external tools and dynamic environments.…

Remarkable progress has been made on automated problem solving through societies of agents based on large language models (LLMs). Existing LLM-based multi-agent systems can already solve simple dialogue tasks. Solutions to more complex…

The substantial data volumes encountered in modern particle physics and other domains of fundamental physics research allow (and require) the use of increasingly complex data analysis tools and workflows. While the use of machine learning…

High Energy Physics - Phenomenology · Physics 2026-02-18 Sascha Diefenbacher , Anna Hallin , Gregor Kasieczka , Michael Krämer , Anne Lauscher , Tim Lukas

Multi-agent AI systems powered by large language models (LLMs) are increasingly applied to solve complex tasks. However, these systems often rely on fragile, manually designed prompts and heuristics, making optimization difficult. A key…

Artificial Intelligence · Computer Science 2025-02-10 Wanjia Zhao , Mert Yuksekgonul , Shirley Wu , James Zou