中文
相关论文

相关论文: OS-Genesis: Automating GUI Agent Trajectory Constr…

200 篇论文

Omni-directional images have been increasingly used in various applications, including virtual reality and SNS (Social Networking Services). However, their availability is comparatively limited in contrast to normal field of view (NFoV)…

计算机视觉与模式识别 · 计算机科学 2024-09-17 Atsuya Nakata , Takao Yamanaka

A key barrier to using reinforcement learning (RL) in many real-world applications is the requirement of a large number of system interactions to learn a good control policy. Off-policy and Offline RL methods have been proposed to reduce…

机器学习 · 计算机科学 2022-12-02 Wenqi Cui , Linbin Huang , Weiwei Yang , Baosen Zhang

Generative Adversarial Networks (GANs) advance face synthesis through learning the underlying distribution of observed data. Despite the high-quality generated faces, some minority groups can be rarely generated from the trained models due…

计算机视觉与模式识别 · 计算机科学 2021-03-30 Shuhan Tan , Yujun Shen , Bolei Zhou

Synthesizing interactive 3D scenes from text is essential for gaming, virtual reality, and embodied AI. However, existing methods face several challenges. Learning-based approaches depend on small-scale indoor datasets, limiting the scene…

计算机视觉与模式识别 · 计算机科学 2025-05-06 Lu Ling , Chen-Hsuan Lin , Tsung-Yi Lin , Yifan Ding , Yu Zeng , Yichen Sheng , Yunhao Ge , Ming-Yu Liu , Aniket Bera , Zhaoshuo Li

Large language models (LLMs) are increasingly deployed as agents, expected to decompose goals, invoke tools, and verify results in dynamic environments. Realizing these capabilities requires access to agentic data-structured interaction…

人工智能 · 计算机科学 2025-10-22 Abhigya Verma , Seganrasan Subramanian , Nandhakumar Kandasamy , Naman Gupta

The generation of realistic and contextually relevant co-speech gestures is a challenging yet increasingly important task in the creation of multimodal artificial agents. Prior methods focused on learning a direct correspondence between…

人机交互 · 计算机科学 2023-05-09 Hendric Voß , Stefan Kopp

Driving view synthesis along free-form trajectories is essential for realistic driving simulations, enabling closed-loop evaluation of end-to-end driving policies. Existing methods excel at view interpolation along recorded paths but…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Zeyu Yang , Zijie Pan , Yuankun Yang , Xiatian Zhu , Li Zhang

Large language model (LLM) agents often suffer from high reasoning overhead, excessive token consumption, unstable execution, and inability to reuse past experiences in complex tasks like business queries, tool use, and workflow…

机器学习 · 计算机科学 2026-04-23 Ruocan Wei , Shufeng Wang , Ziwei Shi

Despite the rapid progress of multimodal large language models in building Graphical User Interface (GUI) agents, their real-world task completion is fundamentally bottlenecked by a lack of world knowledge about GUI operations. Existing…

计算与语言 · 计算机科学 2026-05-28 Zheng Wu , Chengcheng Han , Zhengxi Lu , Tianjie Ju , Yanyu Chen , Qi Gu , Xunliang Cai , Zhuosheng Zhang

Graphical User Interface (GUI) Agents, powered by multimodal large language models (MLLMs), have shown great potential for task automation on computing devices such as computers and mobile phones. However, existing agents face challenges in…

人工智能 · 计算机科学 2025-01-09 Yuhang Liu , Pengxiang Li , Zishu Wei , Congkai Xie , Xueyu Hu , Xinchen Xu , Shengyu Zhang , Xiaotian Han , Hongxia Yang , Fei Wu

Data quality remains a critical bottleneck in developing capable, competitive models. Researchers have explored many ways to generate top quality samples. Some works rely on rejection sampling: generating lots of synthetic samples and…

Data center (DC) infrastructure serves as the backbone to support the escalating demand for computing capacity. Traditional design methodologies that blend human expertise with specialized simulation tools scale poorly with the increasing…

人工智能 · 计算机科学 2025-12-16 Minghao LI , Ruihang Wang , Rui Tan , Yonggang Wen

Automatic synthesis of faces from visual attributes is an important problem in computer vision and has wide applications in law enforcement and entertainment. With the advent of deep generative convolutional neural networks (CNNs), attempts…

计算机视觉与模式识别 · 计算机科学 2021-04-08 Xing Di , Vishal M. Patel

With the growing demands of AI-generated content (AIGC), the need for high-quality, diverse, and scalable data has become increasingly crucial. However, collecting large-scale real-world data remains costly and time-consuming, hindering the…

计算机视觉与模式识别 · 计算机科学 2025-08-08 Kunyu Feng , Yue Ma , Xinhua Zhang , Boshi Liu , Yikuang Yuluo , Yinhan Zhang , Runtao Liu , Hongyu Liu , Zhiyuan Qin , Shanhui Mo , Qifeng Chen , Zeyu Wang

Synthetic data has become a pivotal resource in post-training tasks for large language models (LLMs) due to the scarcity of high-quality, specific data. While various methods have been developed to generate synthetic data, there remains a…

人工智能 · 计算机科学 2025-02-07 Zeyu Gan , Yong Liu

In the era of big data, access to abundant data is crucial for driving research forward. However, such data is often inaccessible due to privacy concerns or high costs, particularly in healthcare domain. Generating synthetic (tabular) data…

机器学习 · 计算机科学 2026-04-10 Yaobin Ling , Xiaoqian Jiang , Yejin Kim

Formal synthesis is the process of generating a program satisfying a high-level formal specification. In recent times, effective formal synthesis methods have been proposed based on the use of inductive learning. We refer to this class of…

人工智能 · 计算机科学 2016-05-24 Susmit Jha , Sanjit A. Seshia

In many applications of computer graphics, art and design, it is desirable for a user to provide intuitive non-image input, such as text, sketch, stroke, graph or layout, and have a computer system automatically generate photo-realistic…

计算机视觉与模式识别 · 计算机科学 2021-10-04 Yuan Xue , Yuan-Chen Guo , Han Zhang , Tao Xu , Song-Hai Zhang , Xiaolei Huang

In the last few years, the research interest in Vision-and-Language Navigation (VLN) has grown significantly. VLN is a challenging task that involves an agent following human instructions and navigating in a previously unknown environment…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Niyati Rawal , Roberto Bigazzi , Lorenzo Baraldi , Rita Cucchiara

The rapid development of large vision-language model (VLM) has greatly promoted the research of GUI agent. However, GUI agents still face significant challenges in handling long-horizon tasks. First, single-agent models struggle to balance…

人工智能 · 计算机科学 2026-03-05 Zehao Deng , Tianjie Ju , Zheng Wu , Zhuosheng Zhang , Gongshen Liu