English
Related papers

Related papers: Toward Scalable Terminal Task Synthesis via Skill …

200 papers

Recently, skills have been widely adopted in large language model (LLM)-based agent systems across various domains. In existing frameworks, skills are typically injected into the agent reasoning loop as contextual guidance once matched to a…

Artificial Intelligence · Computer Science 2026-05-18 Duling Xu , Zheng Chen , Zaifeng Pan , Jiawei Guan , Dong Dong , Jialin Li , Bangzheng Pu

We introduce AgentSynth, a scalable and cost-efficient pipeline for automatically synthesizing high-quality tasks and trajectory datasets for generalist computer-use agents. Leveraging information asymmetry, AgentSynth constructs subtasks…

Computation and Language · Computer Science 2026-03-03 Jingxu Xie , Dylan Xu , Xuandong Zhao , Dawn Song

Terminal agents extend Large Language Models with the ability to execute tasks directly in command-line environments, but their progress is bottlenecked by the scarcity of high-quality training data. Existing approaches bootstrap from…

Computation and Language · Computer Science 2026-05-21 Zihao Cheng , Hongru Wang , Zeming Liu , Xinyi Wang , Xiangrong Zhu , Yuhang Guo , Wei Lin , Jeff Z. Pan , Yunhong Wang

Skills are a promising way to improve LLM agent capabilities without retraining, while keeping the added procedure reusable and controllable. However, high-quality skills are still largely written by hand. We introduce SkillGen, a…

Machine Learning · Computer Science 2026-05-13 Yuchen Ma , Yue Huang , Han Bao , Haomin Zhuang , Swadheen Shukla , Michel Galley , Xiangliang Zhang , Stefan Feuerriegel

Large language models (LLMs) have been widely adopted for synthetic data generation, significantly reducing annotation costs. However, most existing studies treat synthesis as a set of isolated tasks and overlook a more fundamental…

Artificial Intelligence · Computer Science 2026-05-29 Zhenlin Hu , Yan Wang , Zhen Bi , Zihao Xue , Bingyu Zhu , Longtao Huang , Xiongtao Zhang , Zeyu Yang , Zhixuan Chu , Jungang Lou

LLM agents benefit from reusable skills, yet test-time tasks often require guidance more specific than a static skill library can provide. We propose \emph{SkillTTA}, a Test-Time Adaptive Skill Synthesis method that retrieves a small set of…

Computation and Language · Computer Science 2026-05-19 Jingxing Wang , Chenyu Zhou , Zhihui Fu , Jun Wang , Weiwen Liu , Weinan Zhang , Jianghao Lin

In this paper, we investigate formal test-case generation for high-level mission objectives, specifically reachability, of autonomous systems. We use Kripke structures to represent the high-level decision-making of the agent under test and…

Systems and Control · Electrical Eng. & Systems 2021-08-16 Apurva Badithela , Richard M. Murray

For agentic systems to use external tools to solve complex, long-horizon tasks, we need a large set of diverse and controllable tool-use environments. We introduce SynthTools, a fully LLM-based pipeline spanning the entire lifecycle:…

Artificial Intelligence · Computer Science 2026-05-28 Tommaso Castellani , Naimeng Ye , Daksh Mittal , Thomson Yen , Emmanouil Koukoumidis , William Zeng , Hongseok Namkoong

Converting process sketches into executable simulation models remains a major bottleneck in process systems engineering, requiring substantial manual effort and simulator-specific expertise. Recent advances in generative AI have improved…

Software Engineering · Computer Science 2026-03-27 Abdullah Bahamdan , Emma Pajak , John D. Hedengren , Antonio del Rio Chanona

Scaling vision-language models into Visual Multiagent Systems (VMAS) is hindered by two coupled issues. First, communication topologies are fixed before inference, leaving them blind to visual content and query context; second, agent…

Artificial Intelligence · Computer Science 2026-04-21 Zheng Nie , Ruolin Shen , Xinlei Yu , Bo Yin , Jiangning Zhang , Xiaobin Hu

Controllable scene synthesis consists of generating 3D information that satisfy underlying specifications. Thereby, these specifications should be abstract, i.e. allowing easy user interaction, whilst providing enough interface for detailed…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Helisa Dhamo , Fabian Manhardt , Nassir Navab , Federico Tombari

Graphical User Interface (GUI) agents can automate complex tasks across digital environments, but their development is hindered by the scarcity of high-quality trajectory data for training. Existing approaches rely on expensive human…

Computation and Language · Computer Science 2025-03-04 Yiheng Xu , Dunjie Lu , Zhennan Shen , Junli Wang , Zekun Wang , Yuchen Mao , Caiming Xiong , Tao Yu

With the rapid progress of controllable generation, training data synthesis has become a promising way to expand labeled datasets and alleviate manual annotation in remote sensing (RS). However, the complexity of semantic mask control and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yunkai Yang , Yudong Zhang , Kunquan Zhang , Jinxiao Zhang , Xinying Chen , Haohuan Fu , Runmin Dong

Training agentic models for terminal-based tasks critically depends on high-quality terminal trajectories that capture realistic long-horizon interactions across diverse domains. However, constructing such data at scale remains challenging…

Computation and Language · Computer Science 2026-02-04 Siwei Wu , Yizhi Li , Yuyang Song , Wei Zhang , Yang Wang , Riza Batista-Navarro , Xian Yang , Mingjie Tang , Bryan Dai , Jian Yang , Chenghua Lin

Realistic long-horizon productivity work is strongly conditioned on user-specific computer environments, where much of the work context is stored and organized through directory structures and content-rich artifacts. To scale synthetic data…

Artificial Intelligence · Computer Science 2026-05-01 Tao Ge , Baolin Peng , Hao Cheng , Jianfeng Gao

The use of synthetic graph generators is a common practice among graph-oriented benchmark designers, as it allows obtaining graphs with the required scale and characteristics. However, finding a graph generator that accurately fits the…

With the advent of AI agents, automatic scientific discovery has become a tenable goal. Many recent works scaffold agentic systems that can perform machine learning research, but don't offer a principled way to train such agents -- and…

Artificial Intelligence · Computer Science 2026-03-19 Ziyang Cai , Harkirat Behl

Recent advancements in large language models (LLMs) have significantly improved the capabilities of web agents. However, effectively navigating complex and dynamic web environments still requires more advanced trajectory-level planning and…

Artificial Intelligence · Computer Science 2025-07-08 Yifei Gao , Junhong Ye , Jiaqi Wang , Jitao Sang

Environments are the bottleneck for self-improving agents. Current terminal benchmarks were built for evaluation, not training; reinforcement learning requires a scalable pipeline, not just a dataset. We introduce Endless Terminals, a fully…

Machine Learning · Computer Science 2026-02-17 Kanishk Gandhi , Shivam Garg , Noah D. Goodman , Dimitris Papailiopoulos

Imitation learning from human demonstrations is an effective paradigm for robot manipulation, but acquiring large datasets is costly and resource-intensive, especially for long-horizon tasks. To address this issue, we propose SkillMimicGen…

Robotics · Computer Science 2024-10-25 Caelan Garrett , Ajay Mandlekar , Bowen Wen , Dieter Fox
‹ Prev 1 2 3 10 Next ›