中文

Experience Graphs: The Data Foundation for Self-Improving Agents

数据库 2026-06-29 v1 人工智能 多智能体系统

摘要

The database community has repeatedly advanced the state of the art by recognizing that new workloads demand new system architectures. We argue that long-horizon agentic tasks -- code generation, scientific discovery, hardware design -- are such a workload. These agents explore: they generate artifacts, execute tools, observe failures, branch, and repair over hundreds of steps. This search produces a structured object we call an experience graph: executable artifacts, tool outputs, rewards, sibling comparisons, and causal lineage. Yet existing agent frameworks treat this experience as disposable state -- JSON checkpoints and session logs that cannot be recovered after a crash, queried across users, or materialized into training data. We propose Trellis: a data foundation that treats the experience graph as first-class, governed, queryable database state. The core insight is that search over experience graphs is a database access pattern. Frontier selection is a query, cross-session reuse is vector-seeded graph retrieval, training-data extraction is a materialized view, and reconstructing what an agent knew at any past step is a time-travel query. When the database owns the experience graph, agents become stateless compute, and crash recovery, horizontal scaling, and a closed-loop training flywheel emerge as architectural byproducts. We ground the design in KernelEvolve, a production accelerator-kernel optimizer at Meta, where cross-session reuse reaches a target speedup roughly 10x faster at 52% lower token cost. More broadly, Trellis turns inference-time search from disposable computation into a durable institutional asset: logs made databases reliable; experience graphs may make agents cumulative.

引用

@article{arxiv.2606.29823,
  title  = {Experience Graphs: The Data Foundation for Self-Improving Agents},
  author = {Gang Liao and Yujia He and Abdullah Ozturk and Zhouyang Li and Ying Wang and Zhitong Guo and Hongsen Qin and Yaobin Qin and Tao Yang and Zewei Jiang and Dianshi Li and Jort Gemmeke and Jiangyuan Li and Liyuan Li and Nathan Yan and Masha Basmanova and Uladzimir Pashkevich and Matt Steiner and Pedro Pedreira and Rob Fergus and Anirudh Goyal and Carole-Jean Wu and Gaoxiang Liu and Andrew Witten and Daniel J. Abadi},
  journal= {arXiv preprint arXiv:2606.29823},
  year   = {2026}
}