中文
相关论文

相关论文: Learning Optimal Multimodal Information Bottleneck…

200 篇论文

Reinforcement learning has achieved promising results on robotic control tasks but struggles to leverage information effectively from multiple sensory modalities that differ in many characteristics. Recent works construct auxiliary losses…

机器学习 · 计算机科学 2024-10-24 Bang You , Huaping Liu

Collaborative perception systems leverage multiple edge devices, such surveillance cameras or autonomous cars, to enhance sensing quality and eliminate blind spots. Despite their advantages, challenges such as limited channel capacity and…

网络与互联网体系结构 · 计算机科学 2025-01-07 Zhengru Fang , Senkang Hu , Jingjing Wang , Yiqin Deng , Xianhao Chen , Yuguang Fang

Learning invariant (causal) features for out-of-distribution (OOD) generalization has attracted extensive attention recently, and among the proposals invariant risk minimization (IRM) is a notable solution. In spite of its theoretical…

机器学习 · 计算机科学 2023-02-01 Bin Deng , Kui Jia

Despite widespread adoption, multimodal large language models (MLLMs) suffer performance degradation when encountering unfamiliar queries under distribution shifts. Existing methods to improve MLLM generalization typically require either…

人工智能 · 计算机科学 2025-10-21 Changdae Oh , Jiatong Li , Shawn Im , Sharon Li

In real-world recommendation scenarios, users typically engage with platforms through multiple types of behavioral interactions. Multi-behavior recommendation algorithms aim to leverage various auxiliary user behaviors to enhance prediction…

信息检索 · 计算机科学 2025-07-22 Hengyu Zhang , Chunxu Shen , Xiangguo Sun , Jie Tan , Yanchao Tan , Yu Rong , Hong Cheng , Lingling Yi

While LLM-based agents excel at planning and executing long action sequences, their execution often remains inconsistent across trials, limiting reliability. Consolidating agent consistency requires distilling trial-error trajectories into…

机器学习 · 计算机科学 2026-05-12 Zihan Huang , Junda Wu , Tong Yu , Qianqi Yan , Rohan Surana , Uttaran Bhattacharya , Lina Yao , Xin Eric Wang , Julian McAuley

Missing data represents a fundamental challenge in machine learning applications, often reducing model performance and reliability. This problem is particularly acute in fields like bioinformatics and clinical machine learning, where…

机器学习 · 计算机科学 2025-09-04 Fatemeh Azad , Zoran Bosnić , Matjaž Kukar

Vision-language pretrained models have seen remarkable success, but their application to safety-critical settings is limited by their lack of interpretability. To improve the interpretability of vision-language models such as CLIP, we…

计算机视觉与模式识别 · 计算机科学 2024-06-25 Ying Wang , Tim G. J. Rudner , Andrew Gordon Wilson

Task-oriented semantic communication emerges as a crucial paradigm for next-generation wireless networks, aiming to efficiently transmit task-relevant information while reducing interference and redundancy across multiple users. Existing…

信号处理 · 电气工程与系统科学 2026-04-14 Jiaxiang Wang , Zhaohui Yang , Yahao Ding , Ye Hu , Mohammad Shikh-Bahaei

We present a variational approximation to the information bottleneck of Tishby et al. (1999). This variational approach allows us to parameterize the information bottleneck model using a neural network and leverage the reparameterization…

机器学习 · 计算机科学 2019-10-25 Alexander A. Alemi , Ian Fischer , Joshua V. Dillon , Kevin Murphy

In recent several years, the information bottleneck (IB) principle provides an information-theoretic framework for deep multi-view clustering (MVC) by compressing multi-view observations while preserving the relevant information of multiple…

信息论 · 计算机科学 2024-03-26 Xiaoqiang Yan , Zhixiang Jin , Fengshou Han , Yangdong Ye

Normalization is fundamental to deep learning, but existing approaches such as BatchNorm, LayerNorm, and RMSNorm are variance-centric by enforcing zero mean and unit variance, stabilizing training without controlling how representations…

机器学习 · 计算机科学 2026-01-30 Xiandong Zou , Jia Li , Xiaotong Yuan , Pan Zhou

Multi-behavior recommendation faces a critical challenge in practice: auxiliary behaviors (e.g., clicks, carts) are often noisy, weakly correlated, or semantically misaligned with the target behavior (e.g., purchase), which leads to biased…

信息检索 · 计算机科学 2026-01-22 Miaomiao Cai , Zhijie Zhang , Junfeng Fang , Zhiyong Cheng , Xiang Wang , Meng Wang

Empowered by semantic-rich content information, multimedia recommendation has emerged as a potent personalized technique. Current endeavors center around harnessing multimedia content to refine item representation or uncovering latent…

信息检索 · 计算机科学 2025-01-22 Yonghui Yang , Le Wu , Zhuangzhuang He , Zhengwei Wu , Richang Hong , Meng Wang

Deep neural networks suffer from poor generalization to unseen environments when the underlying data distribution is different from that in the training set. By learning minimum sufficient representations from training data, the information…

机器学习 · 计算机科学 2021-10-13 Francesco Alesiani , Shujian Yu , Xi Yu

The information bottleneck (IB) principle has been suggested as a way to analyze deep neural networks. The learning dynamics are studied by inspecting the mutual information (MI) between the hidden layers and the input and output. Notably,…

机器学习 · 计算机科学 2022-02-15 Stephan Sloth Lorenzen , Christian Igel , Mads Nielsen

In multi-agent deep reinforcement learning, extracting sufficient and compact information of other agents is critical to attain efficient convergence and scalability of an algorithm. In canonical frameworks, distilling of such information…

机器学习 · 计算机科学 2021-09-30 Yue Jin , Shuangqing Wei , Jian Yuan , Xudong Zhang

Learning with hidden variables is a central challenge in probabilistic graphical models that has important implications for many real-life problems. The classical approach is using the Expectation Maximization (EM) algorithm. This…

机器学习 · 计算机科学 2012-12-12 Gal Elidan , Nir Friedman

Multimodal models often converge to a dominant-modality solution, in which a stronger, faster-converging modality overshadows weaker ones. This modality imbalance causes suboptimal performance. Existing methods attempt to balance different…

多媒体 · 计算机科学 2026-03-19 Zechang Xiong , Da Li , Kexin Tang , Pengyuan Li , Wenkang Kong , Yulan Hu

Semantic communications for multi-modal data can transmit task-relevant information efficiently over noisy and bandwidth-limited channels. However, a key challenge is to simultaneously compress inter-modal redundancy and improve semantic…

图像与视频处理 · 电气工程与系统科学 2025-11-13 Jingwen Fu , Ming Xiao , Zhonghao Lyu , Mikael Skoglund , Celimuge Wu