English
Related papers

Related papers: Multitask Non-Autoregressive Model for Human Motio…

200 papers

The primary goal of skeletal motion prediction is to generate future motion by observing a sequence of 3D skeletons. A key challenge in motion prediction is the fact that a motion can often be performed in several different ways, with each…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Junfeng Hu , Zhencheng Fan , Jun Liao , Li Liu

As a new neural machine translation approach, Non-Autoregressive machine Translation (NAT) has attracted attention recently due to its high efficiency in inference. However, the high efficiency has come at the cost of not capturing the…

Computation and Language · Computer Science 2019-02-28 Yiren Wang , Fei Tian , Di He , Tao Qin , ChengXiang Zhai , Tie-Yan Liu

Fully non-autoregressive neural machine translation (NAT) is proposed to simultaneously predict tokens with single forward of neural networks, which significantly reduces the inference latency at the expense of quality drop compared to the…

Computation and Language · Computer Science 2021-01-01 Jiatao Gu , Xiang Kong

Non-autoregressive neural machine translation (NAT) models suffer from the multi-modality problem that there may exist multiple possible translations of a source sentence, so the reference sentence may be inappropriate for the training when…

Computation and Language · Computer Science 2022-12-01 Chenze Shao , Jinchao Zhang , Jie Zhou , Yang Feng

Non-autoregressive translation (NAT) models, which remove the dependence on previous target tokens from the inputs of the decoder, achieve significantly inference speedup but at the cost of inferior accuracy compared to autoregressive…

Computation and Language · Computer Science 2018-12-27 Junliang Guo , Xu Tan , Di He , Tao Qin , Linli Xu , Tie-Yan Liu

Multi-frame human pose estimation in complicated situations is challenging. Although state-of-the-art human joints detectors have demonstrated remarkable results for static images, their performances come short when we apply these models to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-22 Zhenguang Liu , Haoming Chen , Runyang Feng , Shuang Wu , Shouling Ji , Bailin Yang , Xun Wang

Human motion prediction aims at generating future frames of human motion based on an observed sequence of skeletons. Recent methods employ the latest hidden states of a recurrent neural network (RNN) to encode the historical skeletons,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-08 Yongyi Tang , Lin Ma , Wei Liu , Weishi Zheng

The autoregressive (AR) models, such as attention-based encoder-decoder models and RNN-Transducer, have achieved great success in speech recognition. They predict the output sequence conditioned on the previous tokens and acoustic encoded…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-06 Zhengkun Tian , Jiangyan Yi , Jianhua Tao , Ye Bai , Shuai Zhang , Zhengqi Wen , Xuefei Liu

Human trajectory forecasting is a key component of autonomous vehicles, social-aware robots and advanced video-surveillance applications. This challenging task typically requires knowledge about past motion, the environment and likely…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Luigi Filippo Chiara , Pasquale Coscia , Sourav Das , Simone Calderara , Rita Cucchiara , Lamberto Ballan

We propose the Encoder-Recurrent-Decoder (ERD) model for recognition and prediction of human body pose in videos and motion capture. The ERD model is a recurrent neural network that incorporates nonlinear encoder and decoder networks before…

Computer Vision and Pattern Recognition · Computer Science 2015-09-30 Katerina Fragkiadaki , Sergey Levine , Panna Felsen , Jitendra Malik

In this work, we introduce a novel local autoregressive translation (LAT) mechanism into non-autoregressive translation (NAT) models so as to capture local dependencies among tar-get outputs. Specifically, for each target decoding position,…

Computation and Language · Computer Science 2020-11-13 Xiang Kong , Zhisong Zhang , Eduard Hovy

As multi-object tracking (MOT) tasks continue to evolve toward more general and multi-modal scenarios, the rigid and task-specific architectures of existing MOT methods increasingly hinder their applicability across diverse tasks and limit…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Lianjie Jia , Yuhan Wu , Binghao Ran , Yifan Wang , Lijun Wang , Huchuan Lu

Human motion prediction aims to forecast future human poses given a historical motion. Whether based on recurrent or feed-forward neural networks, existing learning based methods fail to model the observation that human motion tends to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Wei Mao , Miaomiao Liu , Mathieu Salzmann , Hongdong Li

The problem of predicting human motion given a sequence of past observations is at the core of many applications in robotics and computer vision. Current state-of-the-art formulate this problem as a sequence-to-sequence task, in which a…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Enric Corona , Albert Pumarola , Guillem Alenyà , Francesc Moreno-Noguer

Predicting human motion in unstructured and dynamic environments is difficult as humans naturally exhibit complex behaviors that can change drastically from one environment to the next. In order to alleviate this issue, we propose to encode…

Robotics · Computer Science 2019-07-01 Philipp Kratzer , Marc Toussaint , Jim Mainprice

Inspired by ideas in cognitive science, we propose a novel and general approach to solve human motion understanding via pattern completion on a learned latent representation space. Our model outperforms current state-of-the-art methods in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Yi Tian Xu , Yaqiao Li , David Meger

Although Transformer has made breakthrough success in widespread domains especially in Natural Language Processing (NLP), applying it to time series forecasting is still a great challenge. In time series forecasting, the autoregressive…

Machine Learning · Computer Science 2021-06-01 Kai Chen , Guang Chen , Dan Xu , Lijun Zhang , Yuyao Huang , Alois Knoll

Human motion prediction is consisting in forecasting future body poses from historically observed sequences. It is a longstanding challenge due to motion's complex dynamics and uncertainty. Existing methods focus on building up complicated…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Zhihao Wang , Yulin Zhou , Ningyu Zhang , Xiaosong Yang , Jun Xiao , Zhao Wang

Existing captioning models often adopt the encoder-decoder architecture, where the decoder uses autoregressive decoding to generate captions, such that each token is generated sequentially given the preceding generated tokens. However,…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Junlong Gao , Xi Meng , Shiqi Wang , Xia Li , Shanshe Wang , Siwei Ma , Wen Gao

Non-Autoregressive Transformer (NAT) aims to accelerate the Transformer model through discarding the autoregressive mechanism and generating target words independently, which fails to exploit the target sequential information.…

Computation and Language · Computer Science 2019-06-25 Chenze Shao , Yang Feng , Jinchao Zhang , Fandong Meng , Xilin Chen , Jie Zhou