English
Related papers

Related papers: Regularized Vector Quantization for Tokenized Imag…

200 papers

The scale of modern datasets necessitates the development of efficient distributed optimization methods for machine learning. We present a general-purpose framework for distributed computing environments, CoCoA, that has an efficient…

Machine Learning · Computer Science 2018-10-11 Virginia Smith , Simone Forte , Chenxin Ma , Martin Takac , Michael I. Jordan , Martin Jaggi

Text-to-image generation via Stable Diffusion models (SDM) have demonstrated remarkable capabilities. However, their computational intensity, particularly in the iterative denoising process, hinders real-time deployment in latency-sensitive…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Shuaiting Li , Juncan Deng , Zeyu Wang , Kedong Xu , Rongtao Deng , Hong Gu , Haibin Shen , Kejie Huang

Recent advancements in text-to-image generation have inspired researchers to generate datasets tailored for perception models using generative models, which prove particularly valuable in scenarios where real-world data is limited. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Minho Park , Sunghyun Park , Jooyeol Yun , Jaegul Choo

Super-resolution and denoising are ill-posed yet fundamental image restoration tasks. In blind settings, the degradation kernel or the noise level are unknown. This makes restoration even more challenging, notably for learning-based…

Image and Video Processing · Electrical Eng. & Systems 2020-07-24 Majed El Helou , Ruofan Zhou , Sabine Süsstrunk

Photoacoustic tomography is a hybrid imaging technique that combines high optical tissue contrast with high ultrasound resolution. Direct reconstruction methods such as filtered backprojection, time reversal and least squares suffer from…

Convolution neural networks have achieved remarkable performance in many tasks of computing vision. However, CNN tends to bias to low frequency components. They prioritize capturing low frequency patterns which lead them fail when suffering…

Machine Learning · Computer Science 2020-07-08 Weiyu Guo , Yidong Ouyang

Quantization has emerged as a promising direction for model compression. Recently, data-free quantization has been widely studied as a promising method to avoid privacy concerns, which synthesizes images as an alternative to real training…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jianhong Bai , Yuchen Yang , Huanpeng Chu , Hualiang Wang , Zuozhu Liu , Ruizhe Chen , Xiaoxuan He , Lianrui Mu , Chengfei Cai , Haoji Hu

Product quantisation (PQ) is a classical method for scalable vector encoding, yet it has seen limited usage for latent representations in high-fidelity image generation. In this work, we introduce PQGAN, a quantised image autoencoder that…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Denis Zavadski , Nikita Philip Tatsch , Carsten Rother

It's well-known that inverse problems are ill-posed and to solve them meaningfully one has to employ regularization methods. Traditionally, popular regularization methods have been the penalized Variational approaches. In recent years, the…

Machine Learning · Computer Science 2022-02-17 Abinash Nayak

Modern neural translation models based on the Transformer architecture are known for their high performance, particularly when trained on high-resource datasets. A standard next-token prediction training strategy, while widely adopted in…

Computation and Language · Computer Science 2026-02-20 Evgeniia Tokarchuk , Maya K. Nachesa , Sergey Troshin , Vlad Niculae

Inverse problems play a key role in modern image/signal processing methods. However, since they are generally ill-conditioned or ill-posed due to lack of observations, their solutions may have significant intrinsic uncertainty. Analysing…

Signal Processing · Electrical Eng. & Systems 2019-09-09 Xiaohao Cai , Marcelo Pereyra , Jason D. McEwen

In this paper, we study randomized reduction methods, which reduce high-dimensional features into low-dimensional space by randomized methods (e.g., random projection, random hashing), for large-scale high-dimensional classification.…

Machine Learning · Computer Science 2015-07-21 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu

In this paper a variation of the classic vector quantization problem is considered. In the standard formulation, a quantizer is designed to minimize the distortion between input and output when the number of reconstruction points is fixed.…

Information Theory · Computer Science 2021-06-01 Joseph Chataignon , Stefano Rini

Rendering bridges the gap between 2D vision and 3D scenes by simulating the physical process of image formation. By inverting such renderer, one can think of a learning approach to infer 3D information from 2D images. However, standard…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Shichen Liu , Tianye Li , Weikai Chen , Hao Li

Efficient model inference is an important and practical issue in the deployment of deep neural network on resource constraint platforms. Network quantization addresses this problem effectively by leveraging low-bit representation and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-01 Tianshu Chu , Qin Luo , Jie Yang , Xiaolin Huang

Normalizing flows provide an elegant approach to generative modeling that allows for efficient sampling and exact density evaluation of unknown data distributions. However, current techniques have significant limitations in their…

Machine Learning · Computer Science 2022-06-22 Sahil Sidheekh , Chris B. Dock , Tushar Jain , Radu Balan , Maneesh K. Singh

Recent advancements in implicit neural representations have contributed to high-fidelity surface reconstruction and photorealistic novel view synthesis. However, the computational complexity inherent in these methodologies presents a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Yiying Yang , Wen Liu , Fukun Yin , Xin Chen , Gang Yu , Jiayuan Fan , Tao Chen

Deep neural networks (DNNs) have achieved great success in a wide range of computer vision areas, but the applications to mobile devices is limited due to their high storage and computational cost. Much efforts have been devoted to compress…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yiming Hu , Jianquan Li , Xianlei Long , Shenhua Hu , Jiagang Zhu , Xingang Wang , Qingyi Gu

A regularized version of Mixture Models is proposed to learn a principal graph from a distribution of $D$-dimensional data points. In the particular case of manifold learning for ridge detection, we assume that the underlying manifold can…

Machine Learning · Computer Science 2023-07-13 Tony Bonnaire , Aurélien Decelle , Nabila Aghanim

Deep Neural Networks have achieved remarkable success relying on the developing high computation capability of GPUs and large-scale datasets with increasing network depth and width in image recognition, object detection and many other…

Machine Learning · Computer Science 2020-01-08 E Zhenqian , Gao Weiguo