English
Related papers

Related papers: Rate-Distortion Limits for Multimodal Retrieval: T…

200 papers

We establish a sharp estimate for a minimal number of binary digits (bits) needed to represent all bounded total generalized variation functions taking values in a general totally bounded metric space $(E,\rho)$ up to an accuracy of…

Functional Analysis · Mathematics 2020-11-19 Rossana Capuani , Prerona Dutta , Khai T. Nguyen

We present a new algorithm based on posterior sampling for learning in constrained Markov decision processes (CMDP) in the infinite-horizon undiscounted setting. The algorithm achieves near-optimal regret bounds while being advantageous…

Machine Learning · Computer Science 2023-09-28 Danil Provodin , Pratik Gajane , Mykola Pechenizkiy , Maurits Kaptein

The Blahut-Arimoto (BA) algorithm has played a fundamental role in the numerical computation of rate-distortion (RD) functions. This algorithm possesses a desirable monotonic convergence property by alternatively minimizing its Lagrangian…

Information Theory · Computer Science 2024-01-19 Lingyi Chen , Shitong Wu , Wenhao Ye , Huihui Wu , Wenyi Zhang , Hao Wu , Bo Bai

Rate-Distortion Optimized Quantization (RDOQ) has played an important role in the coding performance of recent video compression standards such as H.264/AVC, H.265/HEVC, VP9 and AV1. This scheme yields significant reductions in bit-rate at…

Machine Learning · Computer Science 2020-12-14 Dana Kianfar , Auke Wiggers , Amir Said , Reza Pourreza , Taco Cohen

The information rate-distortion-perception (RDP) function characterizes the three-way trade-off between description rate, average distortion, and perceptual quality measured by discrepancy between probability distributions and has been…

Information Theory · Computer Science 2024-10-31 Chunhui Chen , Xueyan Niu , Wenhao Ye , Hao Wu , Bo Bai

For several styles of fidelity constraints -- guaranteed distortion, conditional excess distortion, excess distortion -- we show mutual information upper bounds on the minimum expected description length needed to represent a random…

Information Theory · Computer Science 2026-02-10 Victoria Kostina

Learned image compression (LIC) using deep learning architectures has seen significant advancements, yet standard rate-distortion (R-D) optimization often encounters imbalanced updates due to diverse gradients of the rate and distortion…

Image and Video Processing · Electrical Eng. & Systems 2025-03-19 Yichi Zhang , Zhihao Duan , Yuning Huang , Fengqing Zhu

Image-Text Retrieval (ITR) is challenging in bridging visual and lingual modalities. Contrastive learning has been adopted by most prior arts. Except for limited amount of negative image-text pairs, the capability of constrastive learning…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Haoran Wang , Dongliang He , Wenhao Wu , Boyang Xia , Min Yang , Fu Li , Yunlong Yu , Zhong Ji , Errui Ding , Jingdong Wang

This paper derives an achievable rate-distortion (R-D) region for the state-dependent discrete memoryless multiple access channel (SD-DMMAC), where the generalized feedback and causal side information are present at encoders, and the…

Information Theory · Computer Science 2024-09-27 Xinyang Li , Vlad C. Andrei , Ullrich J. Mönich , Holger Boche

In this paper, we study the cross-modal image retrieval, where the inputs contain a source image plus some text that describes certain modifications to this image and the desired image. Prior work usually uses a three-stage strategy to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Chunbin Gu , Jiajun Bu , Xixi Zhou , Chengwei Yao , Dongfang Ma , Zhi Yu , Xifeng Yan

This paper describes an adaptive Lagrange multiplier determination method for rate-quality optimisation in video compression. Inspired by the experimental results of a Lagrange multiplier selection test, the presented approach adaptively…

Image and Video Processing · Electrical Eng. & Systems 2021-06-16 Fan Zhang , David R. Bull

Let (S1,i, S2,i), distributed according to i.i.d p(s1, s2), i = 1, 2, . . . be a memoryless, correlated partial side information sequence. In this work we study channel coding and source coding problems where the partial side information…

Information Theory · Computer Science 2013-04-12 Avihay Shirazi , Uria Basher , Haim Permuter

This paper introduces a new approach to proving that a sequence of deterministic linear codes achieves capacity on an erasure channel under maximum a posteriori decoding. Rather than relying on the precise structure of the codes, this…

Information Theory · Computer Science 2015-06-16 Santhosh Kumar , Henry D. Pfister

This paper presents new \emph{variance-aware} confidence sets for linear bandits and linear mixture Markov Decision Processes (MDPs). With the new confidence sets, we obtain the follow regret bounds: For linear bandits, we obtain an…

Machine Learning · Computer Science 2021-11-01 Zihan Zhang , Jiaqi Yang , Xiangyang Ji , Simon S. Du

Accurately matching visual and textual data in cross-modal retrieval has been widely studied in the multimedia community. To address these challenges posited by the heterogeneity gap and the semantic gap, we propose integrating Shannon…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Wei Chen , Yu Liu , Erwin M. Bakker , Michael S. Lew

Vision-language retrieval is an important multi-modal learning topic, where the goal is to retrieve the most relevant visual candidate for a given text query. Recently, pre-trained models, e.g., CLIP, show great potential on retrieval…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Haojun Jiang , Jianke Zhang , Rui Huang , Chunjiang Ge , Zanlin Ni , Shiji Song , Gao Huang

By a locally recoverable code (LRC), we will in this paper, mean a linear code in which a given code symbol can be recovered by taking a linear combination of at most $r$ other code symbols with $r << k$. A natural extension is to the local…

Information Theory · Computer Science 2018-12-07 S. B. Balaji , Ganesh R. Kini , P. Vijay Kumar

Despite demonstrating superior rate-distortion (RD) performance, learning-based image compression (LIC) algorithms have been found to be vulnerable to malicious perturbations in recent studies. However, the adversarial attacks considered in…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Chenhao Wu , Qingbo Wu , Haoran Wei , Shuai Chen , Lei Wang , King Ngi Ngan , Fanman Meng , Hongliang Li

Neural video compression (NVC) has demonstrated superior compression efficiency, yet effective rate control remains a significant challenge due to complex temporal dependencies. Existing rate control schemes typically leverage frame content…

Image and Video Processing · Electrical Eng. & Systems 2026-02-03 Wuyang Cong , Junqi Shi , Lizhong Wang , Weijing Shi , Ming Lu , Hao Chen , Zhan Ma

We define a graph-based rate optimization problem and consider its computation, which provides a unified approach to the computation of various theoretical limits, including the (conditional) graph entropy, rate-distortion functions and…

Information Theory · Computer Science 2025-03-18 Deheng Yuan , Tao Guo , Zhongyi Huang , Shi Jin
‹ Prev 1 8 9 10 Next ›