English
Related papers

Related papers: Discriminative Mutual Information Estimators for C…

200 papers

In this work, we expand the cooperative multi-task semantic communication framework (CMT-SemCom) introduced in [1], which divides the semantic encoder on the transmitter side into a common unit (CU) and multiple specific units (SUs), to a…

Signal Processing · Electrical Eng. & Systems 2026-01-27 Ahmad Halimi Razlighi , Carsten Bockelmann , Armin Dekorsy

A memoryless state-dependent broadcast channel (BC) is considered, where the transmitter wishes to convey two private messages to two receivers while simultaneously estimating the respective states via generalized feedback. The model at…

Information Theory · Computer Science 2020-11-09 Mehrasa Ahmadipour , Michèle Wigger , Mari Kobayashi

In this paper, we explore the benefits, in the sense of total (sum rate) degrees of freedom (DOF), of cooperation and cognitive message sharing for a two-user multiple-input-multiple-output (MIMO) Gaussian interference channel with $M_1$,…

Information Theory · Computer Science 2008-03-13 Chiachi Huang , Syed A. Jafar

We consider a new formulation of a class of synchronization error channels and derive analytical bounds and numerical estimates for the capacity of these channels. For the binary channel with only deletions, we obtain an expression for the…

Information Theory · Computer Science 2016-11-17 Aravind R. Iyengar , Paul H. Siegel , Jack K. Wolf

In this letter we determine the derivative of the mutual information corresponding to bit-interleaved coded modulation systems. The derivative follows as a linear combination of minimum-mean-squared error functions of coded modulation sets.…

Information Theory · Computer Science 2007-08-16 Albert Guillen I Fabregas , Alfonso Martinez

Equalizer parameter optimization is critical for signal integrity in high-speed memory systems operating at multi-gigabit data rates. However, existing methods suffer from computationally expensive eye diagram evaluation, optimization of…

Machine Learning · Computer Science 2026-05-07 Muhammad Usama , Dong Eui Chang

We consider a three-terminal state-dependent relay channel with the channel state available non-causally at only the source. Such a model may be of interest for node cooperation in the framework of cognition, i.e., collaborative signal…

Information Theory · Computer Science 2016-11-15 Abdellatif Zaidi , Shlomo Shamai , Pablo Piantanida , Luc Vandendorpe

Predictive uncertainty estimation is essential for deploying Deep Neural Networks in real-world autonomous systems. However, most successful approaches are computationally intensive. In this work, we attempt to address these challenges in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Gianni Franchi , Xuanlong Yu , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , David Filliat

We consider a cooperative two-user multiaccess channel in which the transmission is controlled by a random state. Both encoders transmit a common message and, one of the encoders also transmits an individual message. We study the capacity…

Information Theory · Computer Science 2016-11-15 Abdellatif Zaidi , Shlomo Shamai

This work considers the problem of Distributed Mean Estimation (DME) over networks with intermittent connectivity, where the goal is to learn a global statistic over the data samples localized across distributed nodes with the help of a…

Information Theory · Computer Science 2023-03-02 Rajarshi Saha , Mohamed Seif , Michal Yemini , Andrea J. Goldsmith , H. Vincent Poor

This work examines the use of two-way training in multiple-input multiple-output (MIMO) wireless systems to discriminate the channel estimation performances between a legitimate receiver (LR) and an unauthorized receiver (UR). This thesis…

Information Theory · Computer Science 2011-10-18 Chao-Wei Huang

Deep ensembles perform better than a single network thanks to the diversity among their members. Recent approaches regularize predictions to increase diversity; however, they also drastically decrease individual members' performances. In…

Machine Learning · Computer Science 2021-01-15 Alexandre Rame , Matthieu Cord

We propose a method to increase the capacity achieved by uniform prior in discrete memoryless channels (DMC) with high input cardinality. It consists in appropriately reducing the input set. Different design criteria of the input subset are…

Information Theory · Computer Science 2010-10-28 Amine Mezghani , Michel T. Ivrlac , Josef A. Nossek

The Maximum Mutual Information (MMI) criterion is different from the Least Error Rate (LER) criterion. It can reduce failing to report small probability events. This paper introduces the Channels Matching (CM) algorithm for the MMI…

Machine Learning · Computer Science 2019-01-30 Chenguang Lu

The cutoff rate $R_0(W)$ of a discrete memoryless channel (DMC) $W$ is often used as a figure of merit, alongside the channel capacity $C(W)$. Given a channel $W$ consisting of two possibly correlated subchannels $W_1$, $W_2$, the capacity…

Information Theory · Computer Science 2007-07-13 Erdal Arikan

This paper introduces a novel method for closed information extraction. The method employs a discriminative approach that incorporates type and entity-specific information to improve relation extraction accuracy, particularly benefiting…

Computation and Language · Computer Science 2025-06-23 Cedric Möller , Ricardo Usbeck

Machine learning techniques have garnered great interest in designing communication systems owing to their capacity in tackling with channel uncertainty. To provide theoretical guarantees for learning-based communication systems, some…

Machine Learning · Computer Science 2025-06-17 Zheshun Wu , Junfan Li , Zenglin Xu , Sumei Sun , Jie Liu

Learning to collaborate is critical in Multi-Agent Reinforcement Learning (MARL). Previous works promote collaboration by maximizing the correlation of agents' behaviors, which is typically characterized by Mutual Information (MI) in…

Multiagent Systems · Computer Science 2023-02-23 Pengyi Li , Hongyao Tang , Tianpei Yang , Xiaotian Hao , Tong Sang , Yan Zheng , Jianye Hao , Matthew E. Taylor , Wenyuan Tao , Zhen Wang , Fazl Barez

Representation learning methods utilizing the InfoNCE loss have demonstrated considerable capacity in reducing human annotation effort by training invariant neural feature extractors. Although different variants of the training objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Hanyang Chen , Yanchao Yang

We study downlink (DL) channel estimation in a multi-cell Massive multiple-input multiple-output (MIMO) system operating in a time-division duplex. The users must know their effective channel gains to decode their received DL data signals.…

Information Theory · Computer Science 2021-09-07 Amin Ghazanfari , Trinh Van Chien , Emil Björnson , Erik G. Larsson
‹ Prev 1 4 5 6 7 8 10 Next ›