English
Related papers

Related papers: GenericAgent: A Token-Efficient Self-Evolving LLM …

200 papers

Large Language Models (LLMs) have achieved remarkable success across a wide array of tasks. Due to the impressive planning and reasoning abilities of LLMs, they have been used as autonomous agents to do many tasks automatically. Recently,…

Computation and Language · Computer Science 2024-04-22 Taicheng Guo , Xiuying Chen , Yaqi Wang , Ruidi Chang , Shichao Pei , Nitesh V. Chawla , Olaf Wiest , Xiangliang Zhang

Building generalist agents that can rapidly adapt to new environments is a key challenge for deploying AI in the digital and real worlds. Is scaling current agent architectures the most effective way to build generalist agents? We propose a…

Artificial Intelligence · Computer Science 2025-02-25 Kaustubh Sridhar , Souradeep Dutta , Dinesh Jayaraman , Insup Lee

Large language models (LLMs) excel at natural language tasks but are limited by their static parametric knowledge, especially in knowledge-intensive task. Retrieval-augmented generation (RAG) mitigates this by integrating external…

Artificial Intelligence · Computer Science 2025-10-10 Yi Jiang , Lei Shen , Lujie Niu , Sendong Zhao , Wenbo Su , Bo Zheng

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Large Language Models demonstrate outstanding performance in many language tasks but still face fundamental challenges in managing the non-linear flow of human conversation. The prevalent approach of treating dialogue history as a flat,…

Computation and Language · Computer Science 2026-04-20 Junan Hu , Shudan Guo , Wenqi Liu , Jianhua Yin , Yinwei Wei

Although long-term memory systems have made substantial progress in recent years, they still exhibit clear limitations in adaptability, scalability, and self-evolution under continuous interaction settings. Inspired by cognitive theories,…

Artificial Intelligence · Computer Science 2026-01-13 Ningning Zhang , Xingxing Yang , Zhizhong Tan , Weiping Deng , Wenyong Wang

Despite the success of Transformers, handling long contexts remains challenging due to the limited length generalization and quadratic complexity of self-attention. Thus Transformers often require post-training with a larger attention…

Computation and Language · Computer Science 2025-06-13 Xiang Hu , Zhihao Teng , Jun Zhao , Wei Wu , Kewei Tu

Open data repositories hold potential for evidence-based decision-making, yet are inaccessible to non-experts lacking expertise in dataset discovery, schema mapping, and statistical analysis. Large language models show promise for…

Artificial Intelligence · Computer Science 2025-11-06 Sina Montazeri , Yunhe Feng , Kewei Sha

Autonomous agents powered by large language models (LLMs) have shown impressive capabilities in tool manipulation for complex task-solving. However, existing paradigms such as ReAct rely on sequential reasoning and execution, failing to…

Artificial Intelligence · Computer Science 2025-10-30 Jiaqi Wu , Qinlao Zhao , Zefeng Chen , Kai Qin , Yifei Zhao , Xueqian Wang , Yuhang Yao

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

Computation and Language · Computer Science 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

Large language model (LLM) agents are fundamentally bottlenecked by finite context windows on long-horizon tasks. As trajectories grow, retaining tool outputs and intermediate reasoning in-context quickly becomes infeasible: the working…

Computation and Language · Computer Science 2026-03-05 Zhenting Wang , Huancheng Chen , Jiayun Wang , Wei Wei

Large language model (LLM) based agents have recently attracted much attention from the research and industry communities. Compared with original LLMs, LLM-based agents are featured in their self-evolving capability, which is the basis for…

Artificial Intelligence · Computer Science 2024-04-23 Zeyu Zhang , Xiaohe Bo , Chen Ma , Rui Li , Xu Chen , Quanyu Dai , Jieming Zhu , Zhenhua Dong , Ji-Rong Wen

Large language model (LLM) agents are fundamentally constrained by context length on long-horizon tasks. We introduce Context-Folding, a framework that empowers agents to actively manage their working context. An agent can procedurally…

Computation and Language · Computer Science 2025-10-15 Weiwei Sun , Miao Lu , Zhan Ling , Kang Liu , Xuesong Yao , Yiming Yang , Jiecao Chen

There has been a growing interest in developing learner models to enhance learning and teaching experiences in educational environments. However, existing works have primarily focused on structured environments relying on meticulously…

Machine Learning · Computer Science 2024-05-01 Bahar Radmehr , Adish Singla , Tanja Käser

Recent advances in Large Language Models (LLMs) have propelled intelligent agents from reactive responses to proactive support. While promising, existing proactive agents either rely exclusively on observations from enclosed environments…

Artificial Intelligence · Computer Science 2025-10-28 Bufang Yang , Lilin Xu , Liekang Zeng , Kaiwei Liu , Siyang Jiang , Wenrui Lu , Hongkai Chen , Xiaofan Jiang , Guoliang Xing , Zhenyu Yan

The rapid development of mobile GUI agents has stimulated growing research interest in long-horizon task automation. However, building agents for these tasks faces a critical bottleneck: the reliance on ever-expanding interaction history…

Artificial Intelligence · Computer Science 2026-05-11 Shizuo Tian , Hao Wen , Yuxuan Chen , Jiacheng Liu , Shanhui Zhao , Guohong Liu , Ju Ren , Yunxin Liu , Yuanchun Li

Student simulation in online education is important to address dynamic learning behaviors of students with diverse backgrounds. Existing simulation models based on deep learning usually need massive training data, lacking prior knowledge in…

Computers and Society · Computer Science 2024-04-12 Songlin Xu , Xinyu Zhang , Lianhui Qin

Long-context LLMs and Retrieval-Augmented Generation (RAG) systems process information passively, deferring state tracking, contradiction resolution, and evidence aggregation to query time, which becomes brittle under ultra long streams…

Machine Learning · Computer Science 2026-02-24 Kehao Zhang , Shangtong Gui , Sheng Yang , Wei Chen , Yang Feng

Large language models (LLMs) have achieved superior performance in powering text-based AI agents, endowing them with decision-making and reasoning abilities akin to humans. Concurrently, there is an emerging research trend focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Junlin Xie , Zhihong Chen , Ruifei Zhang , Xiang Wan , Guanbin Li

Generative AI is increasingly important in software engineering, including safety engineering, where its use ensures that software does not cause harm to people. This also leads to high quality requirements for generative AI. Therefore, the…

Software Engineering · Computer Science 2024-04-25 Florian Geissler , Karsten Roscher , Mario Trapp