English
Related papers

Related papers: Less is More: Information Bottleneck Denoised Mult…

200 papers

Item representation holds significant importance in recommendation systems, which encompasses domains such as news, retail, and videos. Retrieval and ranking models utilise item representation to capture the user-item relationship based on…

Information Retrieval · Computer Science 2023-08-21 Amit Kumar Jaiswal , Yu Xiong

The information bottleneck (IB) problem is a widely studied framework in machine learning for extracting compressed features that are informative for downstream tasks. However, current approaches to solving the IB problem rely on a…

Information Theory · Computer Science 2024-10-11 Amirmohammad Farzaneh , Osvaldo Simeone

Although existing CLIP-based methods for detecting AI-generated images have achieved promising results, they are still limited by severe feature redundancy, which hinders their generalization ability. To address this issue, incorporating an…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Haotian Qin , Dongliang Chang , Yueying Gao , Bingyao Yu , Lei Chen , Zhanyu Ma

Semantic communication shifts the focus from bit-level accuracy to task-relevant semantic delivery, enabling efficient and intelligent communication for next-generation networks. However, existing multi-modal solutions often process all…

Information Theory · Computer Science 2026-01-01 Yujie Zhou , Cheng Peng , Rulong Wang , Yong Xiao , Yingyu Li , Guangming Shi , Ping Zhang

Encoding only the task-related information from the raw data, \ie, disentangled representation learning, can greatly contribute to the robustness and generalizability of models. Although significant advances have been made by regularizing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Zhuohang Dang , Minnan Luo , Chengyou Jia , Guang Dai , Jihong Wang , Xiaojun Chang , Jingdong Wang

Integrated communication and control serves as a critical ingredient in Multi-Agent Reinforcement Learning. However, partial observability limitations will impair collaboration effectiveness, and a potential solution is to establish…

Multiagent Systems · Computer Science 2025-04-11 Ziqiong Wang , Xiaoxue Yu , Rongpeng Li , Zhifeng Zhao

Sequential recommendation models aim to learn from users evolving preferences. However, current state-of-the-art models suffer from an inherent popularity bias. This study developed a novel framework, BiCoRec, that adaptively accommodates…

Information Retrieval · Computer Science 2025-12-17 Mufhumudzi Muthivhi , Terence L van Zyl , Hairong Wang

This paper proposes a new principled multi-task representation learning framework (InfoMTL) to extract noise-invariant sufficient representations for all tasks. It ensures sufficiency of shared representations for all tasks and mitigates…

Computation and Language · Computer Science 2025-03-07 Dou Hu , Lingwei Wei , Wei Zhou , Songlin Hu

Deep neural networks typically learn spatially entangled representations that conflate discriminative foreground features with spurious background correlations, thereby undermining model interpretability and robustness. We propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Kaixiang Shu , Kai Meng , Junqin Luo

As a paradigm shift towards pervasive intelligence, semantic communication (SemCom) has shown great potentials to improve communication efficiency and provide user-centric services by delivering task-oriented semantic meanings. However, the…

Signal Processing · Electrical Eng. & Systems 2025-05-02 Hao Wei , Wen Wang , Wanli Ni , Wenjun Xu , Yongming Huang , Dusit Niyato , Ping Zhang

Learning recommender systems with multi-class optimization objective is a prevalent setting in recommendation. However, as observed user feedback often accounts for a tiny fraction of the entire item pool, the standard Softmax loss tends to…

Information Retrieval · Computer Science 2024-10-10 Hao Zhang , Mingyue Cheng , Qi Liu , Yucong Luo , Rui Li , Enhong Chen

This paper presents Hyper-VIB, a hypernetwork-enhanced information bottleneck (IB) approach designed to enable efficient task-oriented communications in 6G collaborative intelligent systems. Leveraging IB theory, our approach enables an…

Information Theory · Computer Science 2025-11-20 Jingchen Peng , Chaowen Deng , Yili Deng , Boxiang Ren , Lu Yang

This paper investigates a multi-terminal source coding problem under a logarithmic loss fidelity which does not necessarily lead to an additive distortion measure. The problem is motivated by an extension of the Information Bottleneck…

Information Theory · Computer Science 2021-11-29 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Multimodal recommendation aims to enhance user preference modeling by leveraging rich item content such as images and text. Yet dominant systems fuse modalities in the spatial domain, obscuring the frequency structure of signals and…

Information Retrieval · Computer Science 2026-02-02 Wei Yang , Rui Zhong , Yiqun Chen , Shixuan Li , Heng Ping , Chi Lu , Peng Jiang

Recommender systems have long been built upon the modeling of interactions between users and items, while recent studies have sought to broaden this paradigm by generalizing to new users and items, incorporating diverse information sources,…

Information Retrieval · Computer Science 2025-10-28 Chanyoung Chung , Kyeongryul Lee , Sunbin Park , Joyce Jiyoung Whang

Information bottleneck (IB) principle [1] has become an important element in information-theoretic analysis of deep models. Many state-of-the-art generative models of both Variational Autoencoder (VAE) [2; 3] and Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Slava Voloshynovskiy , Mouad Kondah , Shideh Rezaeifar , Olga Taran , Taras Holotyak , Danilo Jimenez Rezende

News recommendation is critical for personalized news access. Existing news recommendation methods usually infer users' personal interest based on their historical clicked news, and train the news recommendation models by predicting future…

Information Retrieval · Computer Science 2021-04-16 Jingwei Yi , Fangzhao Wu , Chuhan Wu , Qifei Li , Guangzhong Sun , Xing Xie

As one of the main solutions to the information overload problem, recommender systems are widely used in daily life. In the recent emerging micro-video recommendation scenario, micro-videos contain rich multimedia information, involving…

Information Retrieval · Computer Science 2022-05-31 Breda Lim , Shubhi Bansal , Ahmed Buru , Kayla Manthey

Keyframe selection has become essential for video understanding with vision-language models (VLMs) due to limited input tokens and the temporal sparsity of relevant information across video frames. Video understanding often relies on…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuan Zhou , Litao Hua , Shilong Jin , Wentao Huang , Haoran Duan

Generalizing from limited data is particularly critical for models in domains such as material science, where task-relevant features in experimental datasets are often heavily confounded by measurement noise and experimental artifacts.…

Machine Learning · Computer Science 2026-02-10 Shuai Ning , Zhenpeng Wang , Lin Wang , Bing Chen , Shuangrong Liu , Xu Wu , Jin Zhou , Bo Yang