English
Related papers

Related papers: Next-Scale Autoregressive Models for Text-to-Motio…

200 papers

In recent years, advances in the large-scale pretraining of language and text-to-image models have revolutionized the field of machine learning. Yet, integrating these two modalities into a single, robust model capable of generating…

Machine Learning · Computer Science 2023-09-29 Emanuele Aiello , Lili Yu , Yixin Nie , Armen Aghajanyan , Barlas Oguz

Autoregressive (AR) models have demonstrated significant success in the realm of text-to-image generation. However, they usually face two major challenges. Firstly, the generated images may not always meet the quality standards expected by…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Kai Dong , Tingting Bai

Autoregressive models are a class of generative model that probabilistically predict the next output of a sequence based on previous inputs. The autoregressive sequence is by definition one-dimensional (1D), which is natural for language…

Machine Learning · Computer Science 2024-08-29 Yi Hong Teoh , Roger G. Melko

Text-driven multi-human motion generation with complex interactions remains a challenging problem. Despite progress in performance, existing offline methods that generate fixed-length motions with a fixed number of agents, are inherently…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Mengge Liu , Yan Di , Gu Wang , Yun Qu , Dekai Zhu , Yanyan Li , Xiangyang Ji

Methods based on diffusion backbones have recently revolutionized novel view synthesis (NVS). However, those models require pretrained 2D diffusion checkpoints (e.g., Stable Diffusion) as the basis for geometrical priors. Since such…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Shiran Yuan , Hao Zhao

Text-to-motion generation is an emerging and challenging problem, which aims to synthesize motion with the same semantics as the input text. However, due to the lack of diverse labeled training data, most approaches either limit to specific…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Junfan Lin , Jianlong Chang , Lingbo Liu , Guanbin Li , Liang Lin , Qi Tian , Chang Wen Chen

Human auditory perception is shaped by moving sound sources in 3D space, yet prior work in generative sound modelling has largely been restricted to mono signals or static spatial audio. In this work, we introduce a framework for generating…

Sound · Computer Science 2025-09-29 Yunyi Liu , Shaofan Yang , Kai Li , Xu Li

While deep learning has significantly advanced medical image segmentation, most existing methods still struggle with handling complex anatomical regions. Cascaded or deep supervision-based approaches attempt to address this challenge…

Image and Video Processing · Electrical Eng. & Systems 2025-03-03 Tao Chen , Chenhui Wang , Zhihao Chen , Hongming Shan

World models allow agents to simulate the consequences of actions in imagined environments for planning, control, and long-horizon decision-making. However, existing autoregressive world models struggle with visually coherent predictions…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Sen Wang , Jingyi Tian , Le Wang , Zhimin Liao , Jiayi Li , Huaiyi Dong , Kun Xia , Sanping Zhou , Wei Tang , Hua Gang

Autoregressive (AR) models have been the dominating approach to conditional sequence generation, but are suffering from the issue of high inference latency. Non-autoregressive (NAR) models have been recently proposed to reduce the latency…

Machine Learning · Computer Science 2020-07-01 Zhiqing Sun , Yiming Yang

Face-to-face communication, as a common human activity, motivates the research on interactive head generation. A virtual agent can generate motion responses with both listening and speaking capabilities based on the audio or motion signals…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Ying Guo , Xi Liu , Cheng Zhen , Pengfei Yan , Xiaoming Wei

Humans are capable of processing speech by making use of multiple sensory modalities. For example, the environment where a conversation takes place generally provides semantic and/or acoustic context that helps us to resolve ambiguities or…

Computation and Language · Computer Science 2019-02-21 Ozan Caglayan , Ramon Sanabria , Shruti Palaskar , Loïc Barrault , Florian Metze

Recently, human motion analysis has experienced great improvement due to inspiring generative models such as the denoising diffusion model and large language model. While the existing approaches mainly focus on generating motions with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yiming Wu , Wei Ji , Kecheng Zheng , Zicheng Wang , Dong Xu

Text-conditioned human motion generation, which allows for user interaction through natural language, has become increasingly popular. Existing methods typically generate short, isolated motions based on a single input sentence. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Kaifeng Zhao , Gen Li , Siyu Tang

We introduce MoRAG, a novel multi-part fusion based retrieval-augmented generation strategy for text-based human motion generation. The method enhances motion diffusion models by leveraging additional knowledge obtained through an improved…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Sai Shashank Kalakonda , Shubh Maheshwari , Ravi Kiran Sarvadevabhatla

Recent approaches to data-to-text generation have adopted the very successful encoder-decoder architecture or variants thereof. These models generate text which is fluent (but often imprecise) and perform quite poorly at selecting…

Computation and Language · Computer Science 2021-02-05 Ratish Puduppully , Mirella Lapata

Recent advances in text-to-image generative models have enabled numerous practical applications, including subject-driven generation, which fine-tunes pretrained models to capture subject semantics from only a few examples. While…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Jiwoo Chung , Sangeek Hyun , Hyunjun Kim , Eunseo Koh , MinKyu Lee , Jae-Pil Heo

Existing multi-object image generation methods face difficulties in achieving precise alignment between localized image generation regions and their corresponding semantics based on language descriptions, frequently resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yanfeng Li , Yue Sun , Keren Fu , Sio-Kei Im , Xiaoming Liu , Guangtao Zhai , Xiaohong Liu , Tao Tan

Standard sequential generation methods assume a pre-specified generation order, such as text generation methods which generate words from left to right. In this work, we propose a framework for training models of text generation that…

Computation and Language · Computer Science 2019-10-25 Sean Welleck , Kianté Brantley , Hal Daumé , Kyunghyun Cho

The current paper presents a novel recurrent neural network model, the predictive multiple spatio-temporal scales RNN (P-MSTRNN), which can generate as well as recognize dynamic visual patterns in the predictive coding framework. The model…

Computer Vision and Pattern Recognition · Computer Science 2017-03-20 Minkyu Choi , Jun Tani