中文
相关论文

相关论文: A Versatile Multimodal Agent for Multimedia Conten…

200 篇论文

Automated machine learning (AutoML) accelerates AI development by automating tasks in the development pipeline, such as optimal model search and hyperparameter tuning. Existing AutoML systems often require technical expertise to set up…

机器学习 · 计算机科学 2025-06-09 Patara Trirat , Wonyong Jeong , Sung Ju Hwang

This paper explores the potential of generative AI in creating adaptive educational simulations. By leveraging a system of multiple AI agents, simulations can provide personalized learning experiences, offering students the opportunity to…

计算机与社会 · 计算机科学 2024-07-19 Ethan Mollick , Lilach Mollick , Natalie Bach , LJ Ciccarelli , Ben Przystanski , Daniel Ravipinto

With the dynamic evolution of user interests and the increasing multimodal demands in internet applications, personalized content generation strategies based on static interest preferences struggle to meet practical application…

信息检索 · 计算机科学 2025-09-05 Tian Miao

Large Language Models (LLMs) have shown immense potential in education, automating tasks like quiz generation and content summarization. However, generating effective presentation slides introduces unique challenges due to the complexity of…

人工智能 · 计算机科学 2025-11-14 Eric Xie , Danielle Waterfield , Michael Kennedy , Aidong Zhang

Music-to-Video (M2V) generation for full-length songs faces significant challenges. Existing methods produce short, disjointed clips, failing to align visuals with musical structure, beats, or lyrics, and lack temporal consistency. We…

Large Language Models (LLMs) have demonstrated the ability to solve a wide range of practical tasks within multi-agent systems. However, existing human-designed multi-agent frameworks are typically limited to a small set of pre-defined…

人工智能 · 计算机科学 2025-07-31 Yaolun Zhang , Xiaogeng Liu , Chaowei Xiao

Training and evaluating autonomous driving algorithms requires a diverse range of scenarios. However, most available datasets predominantly consist of normal driving behaviors demonstrated by human drivers, resulting in a limited number of…

机器人学 · 计算机科学 2025-05-27 Miao Li , Wenhao Ding , Haohong Lin , Yiqi Lyu , Yihang Yao , Yuyou Zhang , Ding Zhao

Recent advances in multimodal LLMs and systems that use tools for long-video QA point to the promise of reasoning over hour-long episodes. However, many methods still compress content into lossy summaries or rely on limited toolsets,…

人工智能 · 计算机科学 2025-12-24 Runtao Liu , Ziyi Liu , Jiaqi Tang , Yue Ma , Renjie Pi , Jipeng Zhang , Qifeng Chen

Recent advancements in multimodal generative AI (GenAI) enable the creation of personal context-aware real-time agents that, for example, can augment user workflows by following their on-screen activities and providing contextual…

人机交互 · 计算机科学 2025-10-09 Frederic Gmeiner , Kenneth Holstein , Nikolas Martelaro

Common knowledge indicates that the process of constructing image datasets usually depends on the time-intensive and inefficient method of manual collection and annotation. Large models offer a solution via data generation. Nonetheless,…

计算机视觉与模式识别 · 计算机科学 2025-07-14 Haoran Sun , Haoyu Bian , Shaoning Zeng , Yunbo Rao , Xu Xu , Lin Mei , Jianping Gou

Virtual film production requires intricate decision-making processes, including scriptwriting, virtual cinematography, and precise actor positioning and actions. Motivated by recent advances in automated decision-making with language…

计算与语言 · 计算机科学 2025-01-23 Zhenran Xu , Longyue Wang , Jifang Wang , Zhouyi Li , Senbao Shi , Xue Yang , Yiyu Wang , Baotian Hu , Jun Yu , Min Zhang

The rapid advances in Foundation Models and agentic Artificial Intelligence are transforming multimedia analytics by enabling richer, more sophisticated interactions between humans and analytical systems. Existing conceptual models for…

多媒体 · 计算机科学 2025-04-11 Marcel Worring , Jan Zahálka , Stef van den Elzen , Maximilian T. Fischer , Daniel A. Keim

We introduce $\textit{InteractiveVideo}$, a user-centric framework for video generation. Different from traditional generative approaches that operate based on user-provided images or text, our framework is designed for dynamic interaction,…

计算机视觉与模式识别 · 计算机科学 2024-02-06 Yiyuan Zhang , Yuhao Kang , Zhixin Zhang , Xiaohan Ding , Sanyuan Zhao , Xiangyu Yue

While specialized AI models excel at isolated video tasks like generation or understanding, real-world applications demand complex, iterative workflows that combine these capabilities. To bridge this gap, we introduce UniVA, an open-source,…

计算机视觉与模式识别 · 计算机科学 2025-11-12 Zhengyang Liang , Daoan Zhang , Huichi Zhou , Rui Huang , Bobo Li , Yuechen Zhang , Shengqiong Wu , Xiaohan Wang , Jiebo Luo , Lizi Liao , Hao Fei

Visual presentations are vital for effective communication. Early attempts to automate their creation using deep learning often faced issues such as poorly organized layouts, inaccurate text summarization, and a lack of image understanding,…

机器学习 · 计算机科学 2025-09-03 Xiaojie Xu , Xinli Xu , Sirui Chen , Haoyu Chen , Fan Zhang , Ying-Cong Chen

Creation of images using generative adversarial networks has been widely adapted into multi-modal regime with the advent of multi-modal representation models pre-trained on large corpus. Various modalities sharing a common representation…

声音 · 计算机科学 2022-06-10 Yoonjeon Kim , Joel Jang , Sumin Shin

Integration of artificial intelligent (AI) agents in higher education is transforming teaching, learning and administrative processes. Although existing AI agents effectively support individual tasks, their implementation remains fragmented…

AI models underpin modern intelligent systems, driving advances across science, medicine, finance, and technology. Yet developing high-performing AI models remains a labor-intensive process that requires expert practitioners to iteratively…

人工智能 · 计算机科学 2026-04-17 Ruiyi Zhang , Peijia Qin , Qi Cao , Li Zhang , Pengtao Xie

With the rapid advancement of Vision-Language Models (VLMs), GUI-based mobile agents have emerged as a key development direction for intelligent mobile systems. However, existing agent models continue to face significant challenges in…

多智能体系统 · 计算机科学 2025-09-03 Cheng Zhang , Erhu Feng , Xi Zhao , Yisheng Zhao , Wangbo Gong , Jiahui Sun , Dong Du , Zhichao Hua , Yubin Xia , Haibo Chen

Text-to-image generation has advanced rapidly, but existing models still struggle with faithfully composing multiple objects and preserving their attributes in complex scenes. We propose coDrawAgents, an interactive multi-agent dialogue…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Chunhan Li , Qifeng Wu , Jia-Hui Pan , Ka-Hei Hui , Jingyu Hu , Yuming Jiang , Bin Sheng , Xihui Liu , Wenjuan Gong , Zhengzhe Liu