English
Related papers

Related papers: Communicating via Markov Decision Processes

200 papers

Memes are a powerful tool for communication over social media. Their affinity for evolving across politics, history, and sociocultural phenomena makes them an ideal communication vehicle. To comprehend the subtle message conveyed within a…

Computation and Language · Computer Science 2023-05-30 Shivam Sharma , Ramaneswaran S , Udit Arora , Md. Shad Akhtar , Tanmoy Chakraborty

In this paper, a semantic-aware joint communication and computation resource allocation framework is proposed for mobile edge computing (MEC) systems. In the considered system, each terminal device (TD) has a computation task, which needs…

Signal Processing · Electrical Eng. & Systems 2023-09-22 Yihan Cang , Ming Chen , Zhaohui Yang , Yuntao Hu , Yinlu Wang , Zhaoyang Zhang , Kai-Kit Wong

Emergent language research has made significant progress in recent years, but still largely fails to explore how communication emerges in more complex and situated multi-agent systems. Existing setups often employ a reference game, which…

Artificial Intelligence · Computer Science 2024-10-18 Cornelius Wolff , Julius Mayer , Elia Bruni , Xenia Ohmer

Parameter estimation in Markov random fields (MRFs) is a difficult task, in which inference over the network is run in the inner loop of a gradient descent procedure. Replacing exact inference with approximate methods such as loopy belief…

Machine Learning · Computer Science 2012-06-18 Varun Ganapathi , David Vickrey , John Duchi , Daphne Koller

We study the problem of identifying the causal relationship between two discrete random variables from observational data. We recently proposed a novel framework called entropic causality that works in a very general functional model but…

Information Theory · Computer Science 2017-01-31 Murat Kocaoglu , Alexandros G. Dimakis , Sriram Vishwanath , Babak Hassibi

Neural Processes (NPs) are powerful and flexible models able to incorporate uncertainty when representing stochastic processes, while maintaining a linear time complexity. However, NPs produce a latent description by aggregating independent…

Machine Learning · Computer Science 2020-09-30 Ben Day , Cătălina Cangea , Arian R. Jamasb , Pietro Liò

Game-theoretic models are effective tools for modeling multi-agent interactions, especially when robots need to coordinate with humans. However, applying these models requires inferring their specifications from observed behaviors -- a…

Robotics · Computer Science 2025-02-06 Max Muchen Sun , Pete Trautman , Todd Murphey

Scaling neural network training increasingly depends on synchronous data-parallelism, yet full-precision gradient all-reduce imposes a severe communication bottleneck. We propose Decoupled Momentum Optimization (DeMo), a drop-in replacement…

Machine Learning · Computer Science 2026-02-10 Bowen Peng , Lizhang Chen , Baiyu Su , Jeffrey Quesnelle , Diederik P. Kingma , Qiang Liu

Content caching in wireless networks provides a substantial opportunity to trade off low cost memory storage with energy consumption, yet finding the optimal causal policy with low computational complexity remains a challenge. This paper…

Signal Processing · Electrical Eng. & Systems 2020-01-22 Zhijie Chen , Hoshyar Mohammed , Wei Chen

Virtual reality (VR) over wireless is emerging as an important use case of 5G networks. Immersive VR experience requires the delivery of huge data at ultra-low latency, thus demanding ultra-high transmission rate. This challenge can be…

Information Theory · Computer Science 2018-06-26 Yaping Sun , Zhiyong Chen , Meixia Tao , Hui Liu

We propose MATE, a simple yet effective memory architecture for solving Contextual Markov Decision Processes (CMDPs), a family of MDPs parameterized by an unobserved context. In CMDPs, an optimal agent can adapt online by maintaining the…

Machine Learning · Computer Science 2026-05-19 Himchan Hwang , Hyeokju Jeong , Gene Chung , Seungyeon Kim , Sangwoong Yoon , Frank Chongwoo Park

Message propagation is fundamental in constructing distributed systems upon sparsely connected communication networks. For providing easy message propagation primitives, the mutual-exclusive propagation (MEP) of one-bit messages is…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-08 Shaolin Yu , Jihong Zhu , Jiali Yang

We propose a novel formulation of the "effectiveness problem" in communications, put forth by Shannon and Weaver in their seminal work [2], by considering multiple agents communicating over a noisy channel in order to achieve better…

Signal Processing · Electrical Eng. & Systems 2021-04-02 Tze-Yang Tung , Szymon Kobus , Joan Roig Pujol , Deniz Gunduz

We introduce Multi-Environment Markov Decision Processes (MEMDPs) which are MDPs with a set of probabilistic transition functions. The goal in a MEMDP is to synthesize a single controller with guaranteed performances against all…

Logic in Computer Science · Computer Science 2014-12-04 Jean-François Raskin , Ocan Sankur

Semantic communications (SC) is an emerging communication paradigm in which wireless devices can send only relevant information from a source of data while relying on computing resources to regenerate missing data points. However, the…

Information Theory · Computer Science 2024-09-30 Christo Kurisummoottil Thomas , Walid Saad

Molecular Communication (MC) is an emerging field of research focused on understanding how cells in the human body communicate and exploring potential medical applications. In theoretical analysis, the goal is to investigate cellular…

Information Theory · Computer Science 2025-12-19 Wafa Labidi , Vida Gholamian , Yaning Zhao , Christian Deppe , Holger Boche

We present a scalable methodology for evaluating language models in multi-turn interactions, using a suite of collaborative games that require effective communication about private information. This enables an interactive scaling analysis,…

Computation and Language · Computer Science 2026-03-02 Jacob Eisenstein , Fantine Huot , Adam Fisch , Jonathan Berant , Mirella Lapata

The problem of state communication over a discrete memoryless channel with discrete memoryless state is studied when the state information is available strictly causally at the encoder. It is shown that block Markov encoding, in which the…

Information Theory · Computer Science 2015-03-20 Chiranjib Choudhuri , Young-Han Kim , Urbashi Mitra

The paper presents exponentially-strong converses for source-coding, channel coding, and hypothesis testing problems. More specifically, it presents alternative proofs for the well-known exponentially-strong converse bounds for almost…

Information Theory · Computer Science 2023-01-18 Mustapha Hamad , Michele Wigger , Mireille Sarkiss

In this paper, we consider a goal-oriented communication problem for edge server monitoring, where jobs arrive intermittently at multiple dispatchers and must be assigned to shared edge servers with finite queues and time-varying…

Systems and Control · Electrical Eng. & Systems 2025-10-01 Samuel Chamoun , Christian McDowell , Robin Buchanan , Kevin Chan , Eric Graves , Yin Sun