English
Related papers

Related papers: ARMFlow: AutoRegressive MeanFlow for Online 3D Hum…

200 papers

Generative models have become increasingly powerful tools for robot motion generation, enabling flexible and multimodal trajectory generation across various tasks. Yet, most existing approaches remain limited in handling multiple types of…

Robotics · Computer Science 2026-01-15 Zewen Yang , Xiaobing Dai , Dian Yu , Zhijun Li , Majid Khadiv , Sandra Hirche , Sami Haddadin

Agent systems based on large language models (LLMs) have shown great potential in complex reasoning tasks, but building efficient and generalizable workflows remains a major challenge. Most existing approaches rely on manually designed…

Computation and Language · Computer Science 2025-10-01 Yanbo Wang , Zixiang Xu , Yue Huang , Xiangqi Wang , Zirui Song , Lang Gao , Chenxi Wang , Xiangru Tang , Yue Zhao , Arman Cohan , Xiangliang Zhang , Xiuying Chen

Humans exhibit adaptive, context-sensitive responses to egocentric visual input. However, faithfully modeling such reactions from egocentric video remains challenging due to the dual requirements of strictly causal generation and precise 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Libo Zhang , Zekun Li , Tianyu Li , Zeyu Cao , Rui Xu , Xiaoxiao Long , Wenjia Wang , Jingbo Wang , Yuan Liu , Wenping Wang , Daquan Zhou , Taku Komura , Zhiyang Dou

Despite rapid progress in autonomous driving, reliable training and evaluation of driving systems remain fundamentally constrained by the lack of scalable and interactive simulation environments. Recent generative video models achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yaoru Li , Federico Landi , Marco Godi , Xin Jin , Ruiju Fu , Yufei Ma , Muyang Sun , Heyu Si , Qi Guo

Autonomous driving requires the model to perceive the environment and (re)act within a low latency for safety. While past works ignore the inevitable changes in the environment after processing, streaming perception is proposed to jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Jinrong Yang , Songtao Liu , Zeming Li , Xiaoping Li , Jian Sun

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

We present a sample-based, autoregressive (AR) method for the generation and time evolution of atmospheric phase screens that is computationally efficient and uses a single parameter per Fourier mode to vary the power contained in the…

Atmospheric and Oceanic Physics · Physics 2015-12-21 Sriakr Srinath , Lisa A. Poyneer , Alexander R. Rudy , S. Mark Ammons

Flow-based generative models have greatly improved text-to-speech (TTS) synthesis quality, but inference speed remains limited by the iterative sampling process and multiple function evaluations (NFE). The recent MeanFlow model accelerates…

Sound · Computer Science 2025-10-10 Wei Wang , Rong Cao , Yi Guo , Zhengyang Chen , Kuan Chen , Yuanyuan Huo

Real-time, streaming interactive avatars represent a critical yet challenging goal in digital human research. Although diffusion-based human avatar generation methods achieve remarkable success, their non-causal architecture and high…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Zhiyao Sun , Ziqiao Peng , Yifeng Ma , Yi Chen , Zhengguang Zhou , Zixiang Zhou , Guozhen Zhang , Youliang Zhang , Yuan Zhou , Qinglin Lu , Yong-Jin Liu

Speech-driven 3D facial animation aims to generate realistic lip movements and facial expressions for 3D head models from arbitrary audio clips. Although existing diffusion-based methods are capable of producing natural motions, their slow…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Xuangeng Chu , Nabarun Goswami , Ziteng Cui , Hanqin Wang , Tatsuya Harada

Generative models have emerged as a promising paradigm for offline multi-agent reinforcement learning (MARL), but existing approaches require many iterative sampling steps. Recent few-step acceleration methods either distill a joint teacher…

Artificial Intelligence · Computer Science 2026-05-14 Guowei Zou , Haitao Wang , Beiwen Zhang , Boning Zhang , Hejun Wu

We present FrameFlow, a method for fast protein backbone generation using SE(3) flow matching. Specifically, we adapt FrameDiff, a state-of-the-art diffusion model, to the flow-matching generative modeling paradigm. We show how flow…

Large language models (LLMs) have shown strong potential in automating the design of agentic workflows. However, existing methods still rely heavily on manually predefined operators, limiting generalization and scalability. To address this…

Artificial Intelligence · Computer Science 2025-11-27 Mingming Zhao , Xiaokang Wei , Yuanqi Shao , Kaiwen Zhou , Lin Yang , Siwei Rao , Junhui Zhan , Zhitang Chen

Formulated as a conditional generation problem, face animation aims at synthesizing continuous face images from a single source image driven by a set of conditional face motion. Previous works mainly model the face motion as conditions with…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Xintian Wu , Qihang Zhang , Yiming Wu , Huanyu Wang , Songyuan Li , Lingyun Sun , Xi Li

Face-to-face communication, as a common human activity, motivates the research on interactive head generation. A virtual agent can generate motion responses with both listening and speaking capabilities based on the audio or motion signals…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Ying Guo , Xi Liu , Cheng Zhen , Pengfei Yan , Xiaoming Wei

Generative models have gained popularity for their potential applications in imaging science, such as image reconstruction, posterior sampling and data sharing. Flow-based generative models are particularly attractive due to their ability…

Machine Learning · Computer Science 2023-12-14 Varun A. Kelkar , Rucha Deshpande , Arindam Banerjee , Mark A. Anastasio

To address the problem of training on small datasets for action recognition tasks, most prior works are either based on a large number of training samples or require pre-trained models transferred from other large datasets to tackle…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Haoyu Chen , Zitong Yu , Xin Liu , Wei Peng , Yoon Lee , Guoying Zhao

Vision-Language-Action (VLA) models based on flow matching have shown excellent performance in general-purpose robotic manipulation tasks. However, the action accuracy of these models on complex downstream tasks is unsatisfactory. One…

Robotics · Computer Science 2025-09-05 Hongyin Zhang , Shiyuan Zhang , Junxi Jin , Qixin Zeng , Yifan Qiao , Hongchao Lu , Donglin Wang

This paper focuses on the task of speech-driven 3D facial animation, which aims to generate realistic and synchronized facial motions driven by speech inputs. Recent methods have employed audio-conditioned diffusion models for 3D facial…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yifan Yang , Zhi Cen , Sida Peng , Xiangwei Chen , Yifu Deng , Xinyu Zhu , Fan Jia , Xiaowei Zhou , Hujun Bao

This paper addresses the challenge of text-conditioned streaming motion generation, which requires us to predict the next-step human pose based on variable-length historical motions and incoming texts. Existing methods struggle to achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Lixing Xiao , Shunlin Lu , Huaijin Pi , Ke Fan , Liang Pan , Yueer Zhou , Ziyong Feng , Xiaowei Zhou , Sida Peng , Jingbo Wang