English
Related papers

Related papers: FORGE: Self-Evolving Agent Memory With No Weight U…

200 papers

Reflexion-style agents rely on self-generated reflections as memory, implicitly assuming that agents can accurately diagnose their own failures.We show that this assumption can fail systematically: across ALFWorld and HumanEval, agents…

Machine Learning · Computer Science 2026-05-29 Prakhar Dixit , Sadia Kamal , Tim Oates

Visuomotor policies based on generative architectures such as diffusion and flow-based matching have shown strong performance but degrade under distribution shifts, demonstrating limited recovery capabilities without costly finetuning. In…

Robotics · Computer Science 2025-12-29 Yusuf Ali , Gryphon Patlin , Karthik Kothuri , Muhammad Zubair Irshad , Wuwei Liang , Zsolt Kira

Retrieval-Augmented Generation (RAG) has proven to be an effective method for mitigating hallucination issues inherent in large language models (LLMs). Previous approaches typically train retrievers based on semantic similarity, lacking…

Information Retrieval · Computer Science 2024-11-07 Yuhang Liu , Xueyu Hu , Shengyu Zhang , Jingyuan Chen , Fan Wu , Fei Wu

Continual Knowledge Graph Embedding (CKGE) aims to efficiently learn new knowledge and simultaneously preserve old knowledge. Dominant approaches primarily focus on alleviating catastrophic forgetting of old knowledge but neglect efficient…

Artificial Intelligence · Computer Science 2024-07-09 Jiajun Liu , Wenjun Ke , Peng Wang , Jiahao Wang , Jinhua Gao , Ziyu Shang , Guozheng Li , Zijie Xu , Ke Ji , Yining Li

Recent text-to-image (T2I) diffusion models achieve remarkable realism, yet faithful prompt-image alignment remains challenging, particularly for complex prompts with multiple objects, relations, and fine-grained attributes. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Liyao Jiang , Ruichen Chen , Chao Gao , Di Niu

Recent advances in large language models (LLMs) have enabled the development of autonomous agents capable of complex reasoning and multi-step problem solving. However, these agents struggle to adapt to specialized environments and do not…

Machine Learning · Computer Science 2026-04-02 Marc-Antoine Allard , Arnaud Teinturier , Victor Xing , Gautier Viaud

Reinforcement Learning (RL) serves as a potent paradigm for enhancing reasoning capabilities in Large Language Models (LLMs), yet standard outcome-based approaches often suffer from reward sparsity and inefficient credit assignment. In this…

Artificial Intelligence · Computer Science 2026-02-03 Xiangwei Wang , Wei Wang , Ken Chen , Nanduni Nimalsiri , Saman Halgamuge

Unified Multimodal Models (UMMs) exhibit strong understanding, yet this capability often fails to effectively guide generation. We identify this as a Cognitive Gap: the model lacks the understanding of how to enhance its own generation…

Artificial Intelligence · Computer Science 2026-01-29 Zhenchen Tang , Songlin Yang , Zichuan Wang , Bo Peng , Yang Li , Beibei Dong , Jing Dong

Retrieval-Augmented Generation (RAG), which integrates external knowledge into Large Language Models (LLMs), has proven effective in enabling LLMs to produce more accurate and reliable responses. However, it remains a significant challenge…

Computation and Language · Computer Science 2025-02-11 Yan Weng , Fengbin Zhu , Tong Ye , Haoyan Liu , Fuli Feng , Tat-Seng Chua

The Forward-Forward Learning (FFL) algorithm is a recently proposed solution for training neural networks without needing memory-intensive backpropagation. During training, labels accompany input data, classifying them as positive or…

Machine Learning · Computer Science 2024-05-22 Ali Karkehabadi , Houman Homayoun , Avesta Sasan

Continual learning aims to equip models with the ability to retain previously learned knowledge like a human. Recent work incorporating Parameter-Efficient Fine-Tuning has revitalized the field by introducing lightweight extension modules.…

Machine Learning · Computer Science 2024-12-02 Haiyang Guo , Fei Zhu , Fanhu Zeng , Bing Liu , Xu-Yao Zhang

Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-12-02 Tian Yu , Shaolei Zhang , Yang Feng

Large language model (LLM)-based agents have demonstrated strong capabilities in complex reasoning and problem solving through multi-step interactions, yet most deployed agents remain behaviorally static, with knowledge acquired during…

Artificial Intelligence · Computer Science 2026-05-19 Yuxin Jin , Siyuan Zhang , Hanchen Wang , Lu Qin , Ying Zhang , Wenjie Zhang

Large language model (LLM) agents increasingly operate in settings where a single context window is far too small to capture what has happened, what was learned, and what should not be repeated. Memory -- the ability to persist, organize,…

Artificial Intelligence · Computer Science 2026-03-10 Pengfei Du

Learning from past experience benefits from two complementary forms of memory: episodic traces -- raw trajectories of what happened -- and consolidated abstractions distilled across many episodes into reusable, schema-like lessons. Recent…

Artificial Intelligence · Computer Science 2026-05-14 Dylan Zhang , Yanshan Lin , Zhengkun Wu , Yihang Sun , Bingxuan Li , Dianqi Li , Hao Peng

Automatic evaluation with large language models, commonly known as LLM-as-a-judge, is now standard across reasoning and alignment tasks. Despite evaluating many samples in deployment, these evaluators typically (i) treat each case…

Computation and Language · Computer Science 2025-12-09 Seungyeon Jwa , Daechul Ahn , Reokyoung Kim , Dongyeop Kang , Jonghyun Choi

As high-quality data becomes increasingly difficult to obtain, data-free self-evolution has emerged as a promising paradigm. This approach allows large language models (LLMs) to autonomously generate and solve complex problems, thereby…

Artificial Intelligence · Computer Science 2026-01-13 Zhenrui Yue , Kartikeya Upasani , Xianjun Yang , Suyu Ge , Shaoliang Nie , Yuning Mao , Zhe Liu , Dong Wang

In-context learning has recently been linked to implicit gradient descent in linear self-attention models, suggesting that context can induce a forward-pass update. Retrieval-augmented generation (RAG) also relies on context, but retrieved…

Computation and Language · Computer Science 2026-05-27 Mingchen Li , Jiatan Huang , Chuxu Zhang , Liang Zhao , Hong Yu

Large Language Model (LLM) based agents are powerful yet fundamentally static after deployment, lacking the ability to autonomously expand capabilities, generate new tools, or evolve their reasoning. This work introduces a hierarchical…

Computation and Language · Computer Science 2026-01-21 Indrajit Kar , Sammy Zonunpuia , Zonunfeli Ralte

We present FORGE, a method for sim-to-real transfer of force-aware manipulation policies in the presence of significant pose uncertainty. During simulation-based policy learning, FORGE combines a force threshold mechanism with a dynamics…