English
Related papers

Related papers: Toward Scalable Terminal Task Synthesis via Skill …

200 papers

Graph learning algorithms have attained state-of-the-art performance on many graph analysis tasks such as node classification, link prediction, and clustering. It has, however, become hard to track the field's burgeoning progress. One…

Machine Learning · Computer Science 2022-04-05 Anton Tsitsulin , Benedek Rozemberczki , John Palowitch , Bryan Perozzi

In this paper, we study task-oriented human grasp synthesis, a new grasp synthesis task that demands both task and context awareness. At the core of our method is the task-aware contact maps. Unlike traditional contact maps that only reason…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 An-Lun Liu , Yu-Wei Chao , Yi-Ting Chen

We study the problem of plan synthesis for multi-agent systems, to achieve complex, high-level, long-term goals that are assigned to each agent individually. As the agents might not be capable of satisfying their respective goals by…

Systems and Control · Computer Science 2016-10-27 Jana Tumova , Dimos V. Dimarogonas

We present a novel framework for multi-domain synthesis of artwork from semantic layouts. One of the main limitations of this challenging task is the lack of publicly available segmentation datasets for art synthesis. To address this…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yuantian Huang , Satoshi Iizuka , Edgar Simo-Serra , Kazuhiro Fukui

Motivated by the need to emulate workload execution characteristics on high-performance and distributed heterogeneous resources, we introduce Synapse. Synapse is used as a proxy application (or "representative application") for real…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-03 Andre Merzky , Ming Tai Ha , Matteo Turilli , Shantenu Jha

Graphical User Interface (GUI) agents powered by Vision-Language Models (VLMs) have demonstrated human-like computer control capability. Despite their utility in advancing digital automation, a critical bottleneck persists: collecting…

Pre-training models on Imagenet or other massive datasets of real images has led to major advances in computer vision, albeit accompanied with shortcomings related to curation cost, privacy, usage rights, and ethical issues. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Samarth Mishra , Rameswar Panda , Cheng Perng Phoo , Chun-Fu Chen , Leonid Karlinsky , Kate Saenko , Venkatesh Saligrama , Rogerio S. Feris

Agent Skills have become a practical way to extend LLM agents by packaging metadata, natural-language instructions, and executable resources into reusable capability bundles. However, this growing Skill ecosystem introduces a new compliance…

Cryptography and Security · Computer Science 2026-05-08 Jiangrong Wu , Yuhong Nan , Yixi Lin , Huaijin Wang , Yuming Xiao , Shuai Wang , Zibin Zheng

Large Language Model agents demonstrate potential in solving real-world problems via tools, yet generalist intelligence is bottlenecked by scarce high-quality, long-horizon data. Existing methods collect privacy-constrained API logs or…

Computation and Language · Computer Science 2026-02-11 Zexu Sun , Bokai Ji , Hengyi Cai , Shuaiqiang Wang , Lei Wang , Guangxia Li , Xu Chen

The scarcity of data depicting dangerous situations presents a major obstacle to training AI systems for safety-critical applications, such as construction safety, where ethical and logistical barriers hinder real-world data collection.…

Artificial Intelligence · Computer Science 2025-05-21 Vu Dinh Xuan , Hao Vo , David Murphy , Hoang D. Nguyen

Recent advancements in deep learning and the availability of high-quality real-world driving datasets have propelled end-to-end autonomous driving. Despite this progress, relying solely on real-world data limits the variety of driving…

Robotics · Computer Science 2025-10-29 Jongsuk Kim , Jaeyoung Lee , Gyojin Han , Dongjae Lee , Minki Jeong , Junmo Kim

Program synthesis aims to automatically construct human-readable programs that satisfy given task specifications, such as input/output pairs or demonstrations. Recent works have demonstrated encouraging results in a variety of domains, such…

Software Engineering · Computer Science 2023-03-13 Linghan Zhong , Ryan Lindeborg , Jesse Zhang , Joseph J. Lim , Shao-Hua Sun

Creating a diverse and comprehensive dataset of hand gestures for dynamic human-machine interfaces in the automotive domain can be challenging and time-consuming. To overcome this challenge, we propose using synthetic gesture datasets…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Amr Gomaa , Robin Zitt , Guillermo Reyes , Antonio Krüger

Diffusion models have recently been employed to generate high-quality images, reducing the need for manual data collection and improving model generalization in tasks such as object detection, instance segmentation, and image perception.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 You Li , Fan Ma , Yi Yang

Semantic scene understanding is crucial for robotics and computer vision applications. In autonomous driving, 3D semantic segmentation plays an important role for enabling safe navigation. Despite significant advances in the field, the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Lucas Nunes , Rodrigo Marcuzzi , Jens Behley , Cyrill Stachniss

Executing complex terminal tasks remains a significant challenge for open-weight LLMs, constrained by two fundamental limitations. First, high-fidelity, executable training environments are scarce: environments synthesized from real-world…

Artificial Intelligence · Computer Science 2026-02-10 Kaijie Zhu , Yuzhou Nie , Yijiang Li , Yiming Huang , Jialian Wu , Jiang Liu , Ximeng Sun , Zhenfei Yin , Lun Wang , Zicheng Liu , Emad Barsoum , William Yang Wang , Wenbo Guo

As terminal agents scale to long-horizon, multi-turn workflows, a key bottleneck is not merely limited context length, but the accumulation of noisy terminal observations in the interaction history. Retaining raw observations preserves…

Computation and Language · Computer Science 2026-05-18 Jincheng Ren , Siwei Wu , Yizhi Li , Kang Zhu , Shu Xu , Boyu Feng , Ruibin Yuan , Wei Zhang , Riza Batista-Navarro , Jian Yang , Chenghua Lin

With the widespread adoption of Graphical User Interface (GUI) agents for automating GUI interaction tasks, substantial research focused on improving GUI perception to ground task instructions into concrete action steps. However, the step…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Xuan Wang , Siyuan Su , Quantong Fu , Yongxiang Hu , Yangfan Zhou

We propose scaling up 3D scene reconstruction by training with synthesized data. At the core of our work is MegaSynth, a procedurally generated 3D dataset comprising 700K scenes - over 50 times larger than the prior real dataset DL3DV -…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Hanwen Jiang , Zexiang Xu , Desai Xie , Ziwen Chen , Haian Jin , Fujun Luan , Zhixin Shu , Kai Zhang , Sai Bi , Xin Sun , Jiuxiang Gu , Qixing Huang , Georgios Pavlakos , Hao Tan

This paper presents a framework for automatic synthesis of a control sequence for multi-agent systems governed by continuous linear dynamics under timed constraints. First, the motion of the agents in the workspace is abstracted into…

Systems and Control · Computer Science 2017-03-09 Sofie Andersson , Alexandros Nikou , Dimos V. Dimarogonas