English
Related papers

Related papers: MotionRAG: Motion Retrieval-Augmented Image-to-Vid…

200 papers

Video generation has achieved rapid progress benefiting from high-quality renderings provided by powerful image generators. We regard the video synthesis task as generating a sequence of images sharing the same contents but varying in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jingyuan Zhu , Huimin Ma , Jiansheng Chen , Jian Yuan

Generating human motion that satisfies customized zero-shot goal functions, enabling applications such as controllable character animation and behavior synthesis for virtual agents, is a critical capability. While current approaches handle…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Hanchao Liu , Fang-Lue Zhang , Shining Zhang , Tai-Jiang Mu , Shi-Min Hu

Recently, Retrieval-Augmented Generation (RAG) has achieved remarkable success in addressing the challenges of Large Language Models (LLMs) without necessitating retraining. By referencing an external knowledge base, RAG refines LLM…

Artificial Intelligence · Computer Science 2024-09-11 Boci Peng , Yun Zhu , Yongchao Liu , Xiaohe Bo , Haizhou Shi , Chuntao Hong , Yan Zhang , Siliang Tang

Recent video generation models have achieved remarkable progress and are now deployed in film, social media production, and advertising. Beyond their creative potential, such models also hold promise as world simulators for robotics and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 David Romero , Ariana Bermudez , Viacheslav Iablochnikov , Hao Li , Fabio Pizzati , Ivan Laptev

Text-to-video (T2V) diffusion models have shown promising capabilities in synthesizing realistic videos from input text prompts. However, the input text description alone provides limited control over the precise objects movements and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Yen-Siang Wu , Chi-Pin Huang , Fu-En Yang , Yu-Chiang Frank Wang

Music profoundly enhances video production by improving quality, engagement, and emotional resonance, sparking growing interest in video-to-music generation. Despite recent advances, existing approaches remain limited in specific scenarios…

Multimedia · Computer Science 2025-04-11 Xiaohao Liu , Teng Tu , Yunshan Ma , Tat-Seng Chua

Diffusion models have seen widespread adoption for text-driven human motion generation and related tasks due to their impressive generative capabilities and flexibility. However, current motion diffusion models face two major limitations: a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Yifei Liu , Changxing Ding , Ling Guo , Huaiguang Jiang , Qiong Cao

Human motion generation is a significant pursuit in generative computer vision with widespread applications in film-making, video games, AR/VR, and human-robot interaction. Current methods mainly utilize either diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Canxuan Gang

Retrieval-augmented generation (RAG) is a powerful technique that enhances downstream task execution by retrieving additional information, such as knowledge, skills, and tools from external sources. Graph, by its intrinsic "nodes connected…

Recent advances in motion diffusion models have led to remarkable progress in diverse motion generation tasks, including text-to-motion synthesis. However, existing approaches represent motions as dense frame sequences, requiring the model…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Jinseok Bae , Inwoo Hwang , Young Yoon Lee , Ziyu Guo , Joseph Liu , Yizhak Ben-Shabat , Young Min Kim , Mubbasir Kapadia

Text-to-video diffusion models have enabled high-quality video synthesis, yet often fail to generate temporally coherent and physically plausible motion. A key reason is the models' insufficient understanding of complex motions that natural…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Aritra Bhowmik , Denis Korzhenkov , Cees G. M. Snoek , Amirhossein Habibian , Mohsen Ghafoorian

Retrieval-augmented generation (RAG) techniques have proven to be effective in integrating up-to-date information, mitigating hallucinations, and enhancing response quality, particularly in specialized domains. While many RAG approaches…

Community Question Answering (CQA) platforms can be deemed as important knowledge bases in community, but effectively leveraging historical interactions and domain knowledge in real-time remains a challenge. Existing methods often…

Computation and Language · Computer Science 2025-07-02 Qinwen Chen , Wenbiao Tao , Zhiwei Zhu , Mingfan Xi , Liangzhong Guo , Yuan Wang , Wei Wang , Yunshi Lan

Recent advances in 3D content generation have amplified demand for dynamic models that are both visually realistic and physically consistent. However, state-of-the-art video diffusion models frequently produce implausible results such as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Siwei Meng , Yawei Luo , Ping Liu

Frame-level autoregressive (frame-AR) models have achieved significant progress, enabling real-time video generation comparable to bidirectional diffusion models and serving as a foundation for interactive world models and game engines.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Tianrui Zhu , Shiyi Zhang , Zhirui Sun , Jingqi Tian , Yansong Tang

Multimodal Retrieval-Augmented Generation (MRAG) has emerged as a promising method to generate factual and up-to-date responses of Multimodal Large Language Models (MLLMs) by incorporating non-parametric knowledge from external knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Shu Zhao , Tianyi Shen , Nilesh Ahuja , Omesh Tickoo , Vijaykrishnan Narayanan

Retrieval-Augmented Generation (RAG) enhances language models by combining retrieval with generation. However, its current workflow remains largely text-centric, limiting its applicability in geoscience. Many geoscientific tasks are…

Emerging Technologies · Computer Science 2025-08-18 Runlong Yu , Shiyuan Luo , Rahul Ghosh , Lingyao Li , Yiqun Xie , Xiaowei Jia

Graph-based Retrieval-Augmented Generation (Graph-RAG) enhances large language models (LLMs) by structuring retrieval over an external corpus. However, existing approaches typically assume a static corpus, requiring expensive full-graph…

Information Retrieval · Computer Science 2025-07-08 Fangyuan Zhang , Zhengjun Huang , Yingli Zhou , Qintian Guo , Zhixun Li , Wensheng Luo , Di Jiang , Yixiang Fang , Xiaofang Zhou

State-of-the-art video generation models produce remarkable photorealism, but they lack the precise control required to align generated content with specific scene requirements. Furthermore, without an underlying explicit geometry, these…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Dana Cohen-Bar , Ido Sobol , Raphael Bensadoun , Shelly Sheynin , Oran Gafni , Or Patashnik , Daniel Cohen-Or , Amit Zohar

Retrieval-augmented generation (RAG) has emerged as a pivotal technique in artificial intelligence (AI), particularly in enhancing the capabilities of large language models (LLMs) by enabling access to external, reliable, and up-to-date…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xu Zheng , Ziqiao Weng , Yuanhuiyi Lyu , Lutao Jiang , Haiwei Xue , Bin Ren , Danda Paudel , Nicu Sebe , Luc Van Gool , Xuming Hu