English
Related papers

Related papers: Split Hierarchical Variational Compression

200 papers

The implementation difficulties of combining distribution matching (DM) and dematching (invDM) for probabilistic shaping (PS) with soft-decision forward error correction (FEC) coding can be relaxed by reverse concatenation, for which the…

Signal Processing · Electrical Eng. & Systems 2024-01-25 Tsuyoshi Yoshida , Magnus Karlsson , Erik Agrell

Conventional video compression approaches use the predictive coding architecture and encode the corresponding motion information and residual information. In this paper, taking advantage of both classical architecture in the conventional…

Image and Video Processing · Electrical Eng. & Systems 2019-04-09 Guo Lu , Wanli Ouyang , Dong Xu , Xiaoyun Zhang , Chunlei Cai , Zhiyong Gao

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple prior over the…

Machine Learning · Computer Science 2017-08-29 Prasoon Goyal , Zhiting Hu , Xiaodan Liang , Chenyu Wang , Eric Xing

The increasing efficiency and compactness of deep learning architectures, together with hardware improvements, have enabled the complex and high-dimensional modelling of medical volumetric data at higher resolutions. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2020-02-14 Petru-Daniel Tudosiu , Thomas Varsavsky , Richard Shaw , Mark Graham , Parashkev Nachev , Sebastien Ourselin , Carole H. Sudre , M. Jorge Cardoso

Variational autoencoders (VAE) represent a popular, flexible form of deep generative model that can be stochastically fit to samples from a given random process using an information-theoretic variational bound on the true underlying…

Machine Learning · Computer Science 2019-10-08 Bin Dai , Yu Wang , John Aston , Gang Hua , David Wipf

To make an employee roster, photo album, or training dataset of generative models, one needs to collect high-quality images while dismissing low-quality ones. This study addresses a new task of unsupervised detection of low-quality images.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Tomoyasu Nanaumi , Kazuhiko Kawamoto , Hiroshi Kera

We describe an end-to-end trainable model for image compression based on variational autoencoders. The model incorporates a hyperprior to effectively capture spatial dependencies in the latent representation. This hyperprior relates to side…

Image and Video Processing · Electrical Eng. & Systems 2018-05-02 Johannes Ballé , David Minnen , Saurabh Singh , Sung Jin Hwang , Nick Johnston

Neural image compression has surpassed state-of-the-art traditional codecs (H.266/VVC) for rate-distortion (RD) performance, but suffers from large complexity and separate models for different rate-distortion trade-offs. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-13 Guo-Hua Wang , Jiahao Li , Bin Li , Yan Lu

Unsupervised learning can leverage large-scale data sources without the need for annotations. In this context, deep learning-based autoencoders have shown great potential in detecting anomalies in medical images. However, especially…

Image and Video Processing · Electrical Eng. & Systems 2020-01-03 David Zimmerer , Simon Kohl , Jens Petersen , Fabian Isensee , Klaus Maier-Hein

Lossy image and video compression algorithms yield visually annoying artifacts including blocking, blurring, and ringing, especially at low bit-rates. To reduce these artifacts, post-processing techniques have been extensively studied.…

Multimedia · Computer Science 2017-02-21 Yuanying Dai , Dong Liu , Feng Wu

To achieve higher coding efficiency, Versatile Video Coding (VVC) includes several novel components, but at the expense of increasing decoder computational complexity. These technologies at a low bit rate often create contouring and ringing…

Image and Video Processing · Electrical Eng. & Systems 2021-05-27 Shiba Kuanar , Dwarikanath Mahapatra , Vassilis Athitsos , K. R Rao

Recently, numerous learning-based compression methods have been developed with outstanding performance for the coding of the geometry information of point clouds. On the contrary, limited explorations have been devoted to point cloud…

Image and Video Processing · Electrical Eng. & Systems 2022-04-05 Jianqiang Wang , Zhan Ma

Almost all digital videos are coded into compact representations before being transmitted. Such compact representations need to be decoded back to pixels before being displayed to humans and - as usual - before being enhanced/analyzed by…

Image and Video Processing · Electrical Eng. & Systems 2023-11-03 Xihua Sheng , Li Li , Dong Liu , Houqiang Li

Encoding videos into discrete tokens could align with text tokens to facilitate concise and unified multi-modal LLMs, yet introducing significant spatiotemporal compression compared to continuous video representation. Previous discrete…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Yupeng Zhou , Zhen Li , Ziheng Ouyang , Yuming Chen , Ruoyi Du , Daquan Zhou , Bin Fu , Yihao Liu , Peng Gao , Ming-Ming Cheng , Qibin Hou

Understanding relationships across multiple imaging modalities is central to neuroimaging research. We introduce the Integrative Variational Autoencoder (InVA), the first hierarchical VAE framework for image-on-image regression in…

Image and Video Processing · Electrical Eng. & Systems 2025-09-15 Bowen Lei , Yeseul Jeon , Rajarshi Guhaniyogi , Aaron Scheffler , Bani Mallick , Alzheimer's Disease Neuroimaging Initiatives

Variational Autoencoders (VAEs) are a popular generative model, but one in which conditional inference can be challenging. If the decomposition into query and evidence variables is fixed, conditional VAEs provide an attractive solution. To…

Machine Learning · Statistics 2018-10-05 Ga Wu , Justin Domke , Scott Sanner

Variational autoencoder (VAE) estimates the posterior parameters (mean and variance) of latent variables corresponding to each input data. While it is used for many tasks, the transparency of the model is still an underlying issue. This…

Machine Learning · Statistics 2023-02-23 Akira Nakagawa , Keizo Kato , Taiji Suzuki

Despite recent successes in synthesizing faces and bedrooms, existing generative models struggle to capture more complex image types, potentially due to the oversimplification of their latent space constructions. To tackle this issue,…

Machine Learning · Computer Science 2018-03-13 Wenling Shang , Kihyuk Sohn , Yuandong Tian

Due to differences in frame structure, existing multi-rate video encoding algorithms cannot be directly adapted to encoders utilizing special reference frames such as AV1 without introducing substantial rate-distortion loss. To tackle this…

Multimedia · Computer Science 2018-07-30 Bichuan Guo , Xinyao Chen , Jiawen Gu , Yuxing Han , Jiangtao Wen

With the development of deep learning techniques, the combination of deep learning with image compression has drawn lots of attention. Recently, learned image compression methods had exceeded their classical counterparts in terms of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-03 Ze Cui , Jing Wang , Shangyin Gao , Bo Bai , Tiansheng Guo , Yihui Feng