中文
相关论文

相关论文: Hollywood Town: Long-Video Generation via Cross-Mo…

200 篇论文

Web agents, which couple language models with browsing and tool-use capabilities, show promise as open web assistants. Yet progress is increasingly limited by the lack of scalable, process-level supervision. Existing benchmarks are largely…

The rapid progress of Artificial Intelligence Generated Content (AIGC) tools enables images, videos, and visualizations to be created on demand for webpage design, offering a flexible and increasingly adopted paradigm for modern UI/UX.…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Yan Li , Zezi Zeng , Yifan Yang , Yuqing Yang , Ning Liao , Weiwei Guo , Lili Qiu , Mingxi Cheng , Qi Dai , Zhendong Wang , Zhengyuan Yang , Xue Yang , Ji Li , Lijuan Wang , Chong Luo

Large Language Model (LLM)-based agents exhibit significant potential across various domains, operating as interactive systems that process environmental observations to generate executable actions for target tasks. The effectiveness of…

计算与语言 · 计算机科学 2024-08-20 Mengkang Hu , Tianxing Chen , Qiguang Chen , Yao Mu , Wenqi Shao , Ping Luo

Most commodity software lacks accessible Application Programming Interfaces (APIs), requiring autonomous agents to interact solely through pixel-based Graphical User Interfaces (GUIs). In this API-free setting, large language model…

人工智能 · 计算机科学 2026-03-26 Chenwei Tang , Lin Long , Xinyu Liu , Jingyu Xing , Zizhou Wang , Joey Tianyi Zhou , Jiawei Du , Liangli Zhen , Jiancheng Lv

While diffusion models generate high-fidelity video clips, transforming them into coherent storytelling engines remains challenging. Current agentic pipelines automate this via chained modules but suffer from semantic drift and cascading…

Long-horizon omnimodal question answering answers questions by reasoning over text, images, audio, and video. Despite recent progress on OmniLLMs, low-resource long audio-video QA still suffers from costly dense encoding, weak fine-grained…

计算与语言 · 计算机科学 2026-03-31 Yifan Zhu , Xinyu Mu , Tao Feng , Zhonghong Ou , Yuning Gong , Haoran Luo

Understanding and generating multi-person interactions is a fundamental challenge with broad implications for robotics and social computing. While humans naturally coordinate in groups, modeling such interactions remains difficult due to…

计算机视觉与模式识别 · 计算机科学 2026-03-27 Vongani H. Maluleke , Kie Horiuchi , Lea Wilken , Evonne Ng , Jitendra Malik , Angjoo Kanazawa

Recent advancements in Large Language Models (LLMs) have expanded their capabilities to multimodal contexts, including comprehensive video understanding. However, processing extensive videos such as 24-hour CCTV footage or full-length films…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Lu Zhang , Tiancheng Zhao , Heting Ying , Yibo Ma , Kyusong Lee

Humanoid agents are expected to emulate the complex coordination inherent in human social behaviors. However, existing methods are largely confined to single-agent scenarios, overlooking the physically plausible interplay essential for…

计算机视觉与模式识别 · 计算机科学 2025-12-15 Bin Li , Ruichi Zhang , Han Liang , Jingyan Zhang , Juze Zhang , Xin Chen , Lan Xu , Jingyi Yu , Jingya Wang

Cooperative multi-agent reinforcement learning faces significant challenges in effectively organizing agent relationships and facilitating information exchange, particularly when agents need to adapt their coordination patterns dynamically.…

多智能体系统 · 计算机科学 2025-05-26 Chiqiang Liu , Dazi Li

Humanoid control systems have made significant progress in recent years, yet modeling fluent interaction-rich behavior between a robot, its surrounding environment, and task-relevant objects remains a fundamental challenge. This difficulty…

机器人学 · 计算机科学 2026-05-01 Yanghao Zhou , Jingyu Ma , Yibo Peng , Zhenguo Sun , Yu Bai , Börje F. Karlsson

Despite recent advances, long-sequence video generation frameworks still suffer from significant limitations: poor assistive capability, suboptimal visual quality, and limited expressiveness. To mitigate these limitations, we propose MAViS,…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Qian Wang , Ziqi Huang , Ruoxi Jia , Paul Debevec , Ning Yu

We introduce Audio-Agent, a multimodal framework for audio generation, editing and composition based on text or video inputs. Conventional approaches for text-to-audio (TTA) tasks often make single-pass inferences from text descriptions.…

声音 · 计算机科学 2025-01-15 Zixuan Wang , Chi-Keung Tang , Yu-Wing Tai

Team-based collaboration is a cornerstone of modern creative work. Recent advances in generative AI open possibilities for humans to collaborate with multiple AI agents in distinct roles to address complex creative workflows. Yet, how to…

人机交互 · 计算机科学 2026-01-21 Hyunseung Lim , Dasom Choi , Sooyohn Nam , Bogoan Kim , Hwajung Hong

The real world is awash with multi-agent problems that require collective action by self-interested agents, from the routing of packets across a computer network to the management of irrigation systems. Such systems have local incentives…

多智能体系统 · 计算机科学 2021-02-16 Michiel A. Bakker , Richard Everett , Laura Weidinger , Iason Gabriel , William S. Isaac , Joel Z. Leibo , Edward Hughes

Most previous studies on multi-agent reinforcement learning focus on deriving decentralized and cooperative policies to maximize a common reward and rarely consider the transferability of trained policies to new tasks. This prevents such…

机器学习 · 计算机科学 2019-11-28 Heechang Ryu , Hayong Shin , Jinkyoo Park

Custom Storyboard Generation (CSG) aims to produce high-quality, multi-character consistent storytelling. Current approaches based on static diffusion models, whether used in a one-shot manner or within multi-agent frameworks, face three…

计算机视觉与模式识别 · 计算机科学 2026-02-25 Hailong Yan , Shice Liu , Tao Wang , Xiangtao Zhang , Yijie Zhong , Jinwei Chen , Le Zhang , Bo Li

The development of artificial intelligence systems is transitioning from creating static, task-specific models to dynamic, agent-based systems capable of performing well in a wide range of applications. We propose an Interactive Agent…

Recent progress in large language model (LLM)-based multi-agent collaboration highlights the power of structured communication in enabling collective intelligence. However, existing methods largely rely on static or graph-based inter-agent…

人工智能 · 计算机科学 2025-11-04 Song Wang , Zhen Tan , Zihan Chen , Shuang Zhou , Tianlong Chen , Jundong Li

Omnimodal large language models have made significant strides in unifying audio and visual modalities; however, they often face challenges in fine-grained cross-modal understanding and have difficulty with multimodal alignment. To address…

计算机视觉与模式识别 · 计算机科学 2026-02-06 Keda Tao , Wenjie Du , Bohan Yu , Weiqiang Wang , Jian Liu , Huan Wang