中文
相关论文

相关论文: RAVQ-HoloNet: Rate-Adaptive Vector-Quantized Holog…

200 篇论文

Downsampling is widely adopted to achieve a good trade-off between accuracy and latency for visual recognition. Unfortunately, the commonly used pooling layers are not learned, and thus cannot preserve important information. As another…

计算机视觉与模式识别 · 计算机科学 2022-07-26 Ho Man Kwan , Shenghui Song

Although image super-resolution (SR) problem has experienced unprecedented restoration accuracy with deep neural networks, it has yet limited versatile applications due to the substantial computational costs. Since different input images…

计算机视觉与模式识别 · 计算机科学 2024-04-05 Cheeun Hong , Kyoung Mu Lee

The rapid rise of real-time communication and large language models has significantly increased the importance of speech compression. Deep learning-based neural speech codecs have outperformed traditional signal-level speech codecs in terms…

音频与语音处理 · 电气工程与系统科学 2025-01-22 Jun Xu , Zhengxue Cheng , Guangchuan Chi , Yuhan Liu , Yuelin Hu , Li Song

Vector quantization (VQ) is a technique to deterministically learn features with discrete codebook representations. It is commonly performed with a variational autoencoding model, VQ-VAE, which can be further extended to hierarchical…

Existing vector quantization (VQ) methods struggle with scalability, largely attributed to the instability of the codebook that undergoes partial updates during training. The codebook is prone to collapse as utilization decreases, due to…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Fengyuan Shi , Zhuoyan Luo , Yixiao Ge , Yujiu Yang , Ying Shan , Limin Wang

Video compression is a critical component of Internet video delivery. Recent work has shown that deep learning techniques can rival or outperform human-designed algorithms, but these methods are significantly less compute and…

计算机视觉与模式识别 · 计算机科学 2021-04-07 Mehrdad Khani , Vibhaalakshmi Sivaraman , Mohammad Alizadeh

With the rapid increase in model size and the growing importance of various fine-tuning applications, lightweight training has become crucial. Since the backward pass is twice as expensive as the forward pass, optimizing backpropagation is…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Seonggon Kim , Eunhyeok Park

Large language model inference is often bounded by memory footprint and bandwidth in resource-constrained deployments, making quantization fundamental to efficient serving. While post-training quantization (PTQ) maintains high fidelity at…

Visual Display Units (VDUs), capable of displaying video data at High Definition (HD) and Ultra HD (UHD) resolutions, are frequently employed in a variety of technological domains. Quantization-induced video compression artifacts, which are…

多媒体 · 计算机科学 2016-09-22 Lee Prangnell , Victor Sanchez

In virtual reality (VR) applications, 360-degree images play a pivotal role in crafting immersive experiences and offering panoramic views, thus improving user Quality of Experience (QoE). However, the voluminous data generated by…

图像与视频处理 · 电气工程与系统科学 2024-06-10 Yang Ma , Wenchi Cheng , Jingqing Wang , Wei Zhang

Most video platforms provide video streaming services with different qualities, and the quality of the services is usually adjusted by the resolution of the videos. So high-resolution videos need to be downsampled for compression. In order…

多媒体 · 计算机科学 2023-06-08 Mengxi Guo , Shijie Zhao , Hao Jiang , Junlin Li , Li Zhang

Post Training Quantization (PTQ), a mainstream model compression technique, often leads to the paradoxical 'low error, high loss' phenomenon because it focuses solely on minimizing quantization error. The root cause lies in the Hessian…

机器学习 · 计算机科学 2026-01-30 Jinhao Zhang Yunquan Zhang , Zicheng yan , Boyang Zhang , Jun Sun , Daning Cheng

Recently, speech codecs based on neural networks have proven to perform better than traditional methods. However, redundancy in traditional parameter quantization is visible within the codec architecture of combining the traditional codec…

声音 · 计算机科学 2023-07-26 Youqiang Zheng , Li Xiao , Weiping Tu , Yuhong Yang , Xinmeng Xu

Existing neural networks are memory-consuming and computationally intensive, making deploying them challenging in resource-constrained environments. However, there are various methods to improve their efficiency. Two such methods are…

机器学习 · 计算机科学 2023-11-10 Anastasiia Prutianova , Alexey Zaytsev , Chung-Kuei Lee , Fengyu Sun , Ivan Koryakovskiy

Achieving successful variable bitrate compression with computationally simple algorithms from a single end-to-end learned image or video compression model remains a challenge. Many approaches have been proposed, including conditional…

图像与视频处理 · 电气工程与系统科学 2024-03-01 Fatih Kamisli , Fabien Racape , Hyomin Choi

Dynamic point cloud compression (DPCC) is crucial in applications like autonomous driving and AR/VR. Current compression methods face challenges with complexity management and rate control. This paper introduces a novel dynamic coding…

多媒体 · 计算机科学 2025-08-29 Chenhao Zhang , Wei Gao

Integrating deep learning techniques into the video coding framework gains significant improvement compared to the standard compression techniques, especially applying super-resolution (up-sampling) to down-sampling based video coding as…

图像与视频处理 · 电气工程与系统科学 2021-01-19 Man M. Ho , Jinjia Zhou , Gang He

Vector Quantized Variational Autoencoders (VQ-VAEs) are fundamental models that compress continuous visual data into discrete tokens. Existing methods have tried to improve the quantization strategy for better reconstruction quality,…

计算机视觉与模式识别 · 计算机科学 2025-07-15 Mingkai Jia , Wei Yin , Xiaotao Hu , Jiaxin Guo , Xiaoyang Guo , Qian Zhang , Xiao-Xiao Long , Ping Tan

Neural video compression (NVC) has demonstrated superior compression efficiency, yet effective rate control remains a significant challenge due to complex temporal dependencies. Existing rate control schemes typically leverage frame content…

图像与视频处理 · 电气工程与系统科学 2026-02-03 Wuyang Cong , Junqi Shi , Lizhong Wang , Weijing Shi , Ming Lu , Hao Chen , Zhan Ma

Post-training quantization (PTQ) has emerged as a practical approach to compress large neural networks, making them highly efficient for deployment. However, effectively reducing these models to their low-bit counterparts without…

机器学习 · 计算机科学 2024-10-22 Aozhong Zhang , Zi Yang , Naigang Wang , Yingyong Qi , Jack Xin , Xin Li , Penghang Yin