English
Related papers

Related papers: Predictive Coding Based Multiscale Network with En…

200 papers

The pursuit of higher compression efficiency continuously drives the advances of video coding technologies. Fundamentally, we wish to find better "predictions" or "priors" that are reconstructed previously to remove the signal dependency…

Image and Video Processing · Electrical Eng. & Systems 2019-02-22 Haojie Liu , Tong Chen , Ming Lu , Qiu Shen , Zhan Ma

Neural generative models can be used to learn complex probability distributions from data, to sample from them, and to produce probability density estimates. We propose a computational framework for developing neural generative models…

Machine Learning · Computer Science 2022-01-06 Alexander Ororbia , Daniel Kifer

Bridging the gap between motion models and reality is crucial by using limited data to deploy robots in the real world. Deep learning is expected to be generalized to diverse situations while reducing feature design costs through end-to-end…

Robotics · Computer Science 2024-03-15 Kanata Suzuki , Hiroshi Ito , Tatsuro Yamada , Kei Kase , Tetsuya Ogata

Recurrent Neural Network (RNN) and one of its specific architectures, Long Short-Term Memory (LSTM), have been widely used for sequence labeling. In this paper, we first enhance LSTM-based sequence labeling to explicitly model label…

Computation and Language · Computer Science 2016-09-01 Gakuto Kurata , Bing Xiang , Bowen Zhou , Mo Yu

Mimicking human ability to forecast future positions or interpret complex interactions in urban scenarios, such as streets, shopping malls or squares, is essential to develop socially compliant robots or self-driving cars. Autonomous…

Computer Vision and Pattern Recognition · Computer Science 2019-09-20 Matteo Lisotto , Pasquale Coscia , Lamberto Ballan

Predictive coding (PC) is an influential theory in computational neuroscience, which argues that the cortex forms unsupervised world models by implementing a hierarchical process of prediction error minimization. PC networks (PCNs) are…

Neural and Evolutionary Computing · Computer Science 2022-08-05 Beren Millidge , Yuhang Song , Tommaso Salvatori , Thomas Lukasiewicz , Rafal Bogacz

Constrained sequence codes have been widely used in modern communication and data storage systems. Sequences encoded with constrained sequence codes satisfy constraints imposed by the physical channel, hence enabling efficient and reliable…

Information Theory · Computer Science 2018-09-07 Congzhe Cao , Duanshun Li , Ivan Fair

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

Considering the inherent stochasticity and uncertainty, predicting future video frames is exceptionally challenging. In this work, we study the problem of video prediction by combining interpretability of stochastic state space models and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Dong Wang , Feng Zhou , Zheng Yan , Guang Yao , Zongxuan Liu , Wennan Ma , Cewu Lu

Recent deep learning methods for vessel trajectory prediction are able to learn complex maritime patterns from historical Automatic Identification System (AIS) data and accurately predict sequences of future vessel positions with a…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Samuele Capobianco , Nicola Forti , Leonardo M. Millefiori , Paolo Braca , Peter Willett

Video prediction models often combine three components: an encoder from pixel space to a small latent space, a latent space prediction model, and a generative model back to pixel space. However, the large and unpredictable pixel space makes…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 T. Barak , Y. Loewenstein

We present a novel predictive model architecture based on the principles of predictive coding that enables open loop prediction of future observations over extended horizons. There are two key innovations. First, whereas current methods…

Machine Learning · Computer Science 2024-12-20 Brian Gaudet , Richard Linares , Roberto Furfaro

We study the problem of synthesizing a number of likely future frames from a single input image. In contrast to traditional methods that have tackled this problem in a deterministic or non-parametric way, we propose to model future frames…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Tianfan Xue , Jiajun Wu , Katherine L. Bouman , William T. Freeman

Predicting the completion time of business process instances would be a very helpful aid when managing processes under service level agreement constraints. The ability to know in advance the trend of running process instances would allow…

Machine Learning · Computer Science 2017-11-13 Nicolò Navarin , Beatrice Vincenzi , Mirko Polato , Alessandro Sperduti

Natural spatiotemporal processes can be highly non-stationary in many ways, e.g. the low-level non-stationarity such as spatial correlations or temporal dependencies of local pixel values; and the high-level variations such as the…

Machine Learning · Computer Science 2019-04-23 Yunbo Wang , Jianjin Zhang , Hongyu Zhu , Mingsheng Long , Jianmin Wang , Philip S Yu

In this paper, we propose a sequential neural encoder with latent structured description (SNELSD) for modeling sentences. This model introduces latent chunk-level representations into conventional sequential neural encoders, i.e., recurrent…

Computation and Language · Computer Science 2017-11-16 Yu-Ping Ruan , Qian Chen , Zhen-Hua Ling

End-to-end learning-based video compression has made steady progress over the last several years. However, unlike learning-based image coding, which has already surpassed its handcrafted counterparts, learning-based video coding still has…

Image and Video Processing · Electrical Eng. & Systems 2023-04-20 Hadi Hadizadeh , Ivan V. Bajić

Deep convolutional neural networks are used to address many computer vision problems, including video prediction. The task of video prediction requires analyzing the video frames, temporally and spatially, and constructing a model of how…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Niloofar Azizi , Hafez Farazi , Sven Behnke

In this paper we introduce Neural Network Coding(NNC), a data-driven approach to joint source and network coding. In NNC, the encoders at each source and intermediate node, as well as the decoder at each destination node, are neural…

Information Theory · Computer Science 2021-01-12 Litian Liu , Amit Solomon , Salman Salamatian , Muriel Medard

Estimating accurate depth from a single image is challenging because it is an ill-posed problem as infinitely many 3D scenes can be projected to the same 2D scene. However, recent works based on deep convolutional neural networks show great…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Jin Han Lee , Myung-Kyu Han , Dong Wook Ko , Il Hong Suh