English
Related papers

Related papers: Context Guided Transformer Entropy Modeling for Vi…

200 papers

While replacing Gaussian decoders with a conditional diffusion model enhances the perceptual quality of reconstructions in neural image compression, their lack of inductive bias for image data restricts their ability to achieve…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Atefeh Khoshkhahtinat , Ali Zafari , Piyush M. Mehta , Nasser M. Nasrabadi

We propose a new neurally-inspired model that can learn to encode the global relationship context of visual events across time and space and to use the contextual information to modulate the analysis by synthesis process in a predictive…

Machine Learning · Computer Science 2015-04-17 Mingmin Zhao , Chengxu Zhuang , Yizhou Wang , Tai Sing Lee

Multimodal reward models are crucial for aligning multimodal large language models with human preferences. Recent works have incorporated reasoning capabilities into these models, achieving promising results. However, training these models…

Artificial Intelligence · Computer Science 2026-02-03 Shidong Yang , Tongwen Huang , Hao Wen , Yong Wang , Li Chen , Xiangxiang Chu

Learned image compression methods have attracted great research interest and exhibited superior rate-distortion performance to the best classical image compression standards of the present. The entropy model plays a key role in learned…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Jingbo Lu , Leheng Zhang , Xingyu Zhou , Mu Li , Wen Li , Shuhang Gu

Recently, learned image compression methods have outperformed traditional hand-crafted ones including BPG. One of the keys to this success is learned entropy models that estimate the probability distribution of the quantized latent…

Image and Video Processing · Electrical Eng. & Systems 2022-07-22 Jun-Hyuk Kim , Byeongho Heo , Jong-Seok Lee

In learning-based approaches to image compression, codecs are developed by optimizing a computational model to minimize a rate-distortion objective. Currently, the most effective learned image codecs take the form of an entropy-constrained…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 David Minnen , Saurabh Singh

In recent years, learned image compression (LIC) technologies have surpassed conventional methods notably in terms of rate-distortion (RD) performance. Most present learned techniques are VAE-based with an autoregressive entropy model,…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Minghao Han , Shiyin Jiang , Shengxi Li , Xin Deng , Mai Xu , Ce Zhu , Shuhang Gu

Transformer-based entropy models have gained prominence in recent years due to their superior ability to capture long-range dependencies in probability distribution estimation compared to convolution-based methods. However, previous…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Daxin Li , Yuanchao Bai , Kai Wang , Junjun Jiang , Xianming Liu , Wen Gao

In point cloud geometry compression, context models usually use the one-hot encoding of node occupancy as the label, and the cross-entropy between the one-hot encoding and the probability distribution predicted by the context model as the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Chang Sun , Hui Yuan , Shuai Li , Xin Lu , Raouf Hamzaoui

This paper presents a reinforcement learning framework that incorporates a Contextual Reward Machine for task-oriented grasping. The Contextual Reward Machine reduces task complexity by decomposing grasping tasks into manageable sub-tasks.…

Robotics · Computer Science 2025-12-12 Hui Li , Akhlak Uz Zaman , Fujian Yan , Hongsheng He

Designing a fast and effective entropy model is challenging but essential for practical application of neural codecs. Beyond spatial autoregressive entropy models, more efficient backward adaptation-based entropy models have been recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Jun-Hyuk Kim , Seungeon Kim , Won-Hee Lee , Dokwan Oh

In the framework of learned image compression, the context model plays a pivotal role in capturing the dependencies among latent representations. To reduce the decoding time resulting from the serial autoregressive context model, the…

Image and Video Processing · Electrical Eng. & Systems 2023-12-01 Yang Sui , Ding Ding , Xiang Pan , Xiaozhong Xu , Shan Liu , Bo Yuan , Zhenzhong Chen

Connectionist Temporal Classification (CTC) and attention mechanism are two main approaches used in recent scene text recognition works. Compared with attention-based methods, CTC decoder has a much shorter inference time, yet a lower…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Wenyang Hu , Xiaocong Cai , Jun Hou , Shuai Yi , Zhiping Lin

With the increasing importance of video data in real-world applications, there is a rising need for efficient object detection methods that utilize temporal information. While existing video object detection (VOD) techniques employ various…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Seungjun An , Seonghoon Park , Gyeongnyeon Kim , Jeongyeol Baek , Byeongwon Lee , Seungryong Kim

Video-language alignment is a crucial multi-modal task that benefits various downstream applications, e.g., video-text retrieval and video question answering. Existing methods either utilize multi-modal information in video-text pairs or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Shi-Xue Zhang , Hongfa Wang , Xiaobin Zhu , Weibo Gu , Tianjin Zhang , Chun Yang , Wei Liu , Xu-Cheng Yin

Conditional coding has lately emerged as the mainstream approach to learned video compression. However, a recent study shows that it may perform worse than residual coding when the information bottleneck arises. Conditional residual coding…

Image and Video Processing · Electrical Eng. & Systems 2024-07-11 Yi-Hsin Chen , Hong-Sheng Xie , Cheng-Wei Chen , Zong-Lin Gao , Martin Benjak , Wen-Hsiao Peng , Jörn Ostermann

In neural video codecs, current state-of-the-art methods typically adopt multi-scale motion compensation to handle diverse motions. These methods estimate and compress either optical flow or deformable offsets to reduce inter-frame…

Multimedia · Computer Science 2024-12-03 Yongqi Zhai , Jiayu Yang , Wei Jiang , Chunhui Yang , Luyang Tang , Ronggang Wang

Achieving reliable multidimensional Vehicle-to-Vehicle (V2V) channel state information (CSI) prediction is both challenging and crucial for optimizing downstream tasks that depend on instantaneous CSI. This work extends traditional…

Systems and Control · Electrical Eng. & Systems 2024-09-24 Lei Chu , Daoud Burghal , Rui Wang , Michael Neuman , Andreas F. Molisch

Task-conditional architecture offers advantage in parameter efficiency but falls short in performance compared to state-of-the-art multi-decoder methods. How to trade off performance and model parameters is an important and difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yuxiang Lu , Shalayiding Sirejiding , Yue Ding , Chunlin Wang , Hongtao Lu

This paper presents a cross channel context model for latents in deep image compression. Generally, deep image compression is based on an autoencoder framework, which transforms the original image to latents at the encoder and recovers the…

Image and Video Processing · Electrical Eng. & Systems 2021-03-05 Changyue Ma , Zhao Wang , Ruling Liao , Yan Ye