English
Related papers

Related papers: Modelling the Probability Density of Markov Source…

200 papers

This paper presents a mathematical framework for causal nonlinear prediction in settings where observations are generated from an underlying hidden Markov model (HMM). Both the problem formulation and the proposed solution are motivated by…

Machine Learning · Computer Science 2026-03-16 Heng-Sheng Chang , Prashant G. Mehta

One of the arduous tasks in supply chain modelling is to build robust models against irregular variations. During the proliferation of time-series analyses and machine learning models, several modifications were proposed such as…

Artificial Intelligence · Computer Science 2020-04-30 Heerok Banerjee , V. Ganapathy , V. M. Shenbagaraman

In this work, a likelihood encoder is studied in the context of lossy source compression. The analysis of the likelihood encoder is based on a soft-covering lemma. It is demonstrated that the use of a likelihood encoder together with the…

Information Theory · Computer Science 2014-04-24 Eva C. Song , Paul Cuff , H. Vincent Poor

Constrained decoding enables Language Models (LMs) to produce samples that provably satisfy hard constraints. However, existing constrained-decoding approaches often distort the underlying model distribution, a limitation that is especially…

Artificial Intelligence · Computer Science 2025-06-09 Emmanuel Anaya Gonzalez , Sairam Vaidya , Kanghee Park , Ruyi Ji , Taylor Berg-Kirkpatrick , Loris D'Antoni

Deep models are designed to operate on huge volumes of high dimensional data such as images. In order to reduce the volume of data these models must process, we propose a set-based two-stage end-to-end neural subsampling model that is…

Machine Learning · Computer Science 2022-05-31 Bruno Andreis , Seanie Lee , A. Tuan Nguyen , Juho Lee , Eunho Yang , Sung Ju Hwang

A multiple objective simulation optimization algorithm named Multiple Objective Probabilistic Branch and Bound with Single Observation (MOPBnB(so)) is presented for approximating the Pareto optimal set and the associated efficient frontier…

Optimization and Control · Mathematics 2025-06-06 Hao Huang , Zelda B. Zabinsky

We develop a fast end-to-end method for training lightweight neural networks using multiple classifier heads. By allowing the model to determine the importance of each head and rewarding the choice of a single shallow classifier, we are…

Machine Learning · Computer Science 2020-04-20 Bartosz Wójcik , Maciej Wołczyk , Klaudia Bałazy , Jacek Tabor

Designing networks with specified collective properties is useful in a variety of application areas, enabling the study of how given properties affect the behavior of network models, the downscaling of empirical networks to workable sizes,…

Optimization and Control · Mathematics 2017-06-20 Chrysanthos E. Gounaris , Karthikeyan Rajendran , Ioannis G. Kevrekidis , Christodoulos A. Floudas

We study a fading linear finite-field relay network having multiple source-destination pairs. Because of the interference created by different unicast sessions, the problem of finding its capacity region is in general difficult. We observe…

Information Theory · Computer Science 2009-05-12 Sang-Woon Jeon , Sae-Young Chung

This paper considers a multi-source multi-relay network, in which relay nodes employ a coding scheme based on random linear network coding on source packets and generate coded packets. If a destination node collects enough coded packets, it…

Information Theory · Computer Science 2022-03-08 Amjad Saeed Khan , Ioannis Chatzigeorgiou

The complementary problems of masking and amplifying channel state information in the Gel'fand-Pinsker channel have recently been solved by Merhav and Shamai, and Kim et al., respectively. In this paper, we study a related source coding…

Information Theory · Computer Science 2016-11-15 Thomas Courtade

In the distributed coding of correlated sources, the problem of characterizing the joint probability distribution of a pair of random variables satisfying an n-letter Markov chain arises. The exact solution of this problem is intractable.…

Information Theory · Computer Science 2016-11-18 W. Kang , S. Ulukus

Consider two remote nodes (encoder and decoder), each with a binary sequence. The encoder's sequence $X$ differs from the decoder's sequence $Y$ by a small number of edits (deletions and insertions). The goal is to construct a message $M$,…

Information Theory · Computer Science 2020-10-28 Mahed Abroshan , Ramji Venkataramanan , Albert Guillen i Fabregas

Maximum a posteriori decoding, a commonly used method for neural machine translation (NMT), aims to maximize the estimated posterior probability. However, high estimated probability does not always lead to high translation quality. Minimum…

Computation and Language · Computer Science 2025-05-27 Boxuan Lyu , Hidetaka Kamigaito , Kotaro Funakoshi , Manabu Okumura

Using single-pixel detection, the end-to-end neural network that jointly optimizes both encoding and decoding enables high-precision imaging and high-level semantic sensing. However, for varied sampling rates, the large-scale network…

Image and Video Processing · Electrical Eng. & Systems 2022-01-11 Xinrui Zhan , Liheng Bian , Chunli Zhu , Jun Zhang

We propose a scheme that universally achieves the smallest possible compression rate for a class of sources with side information, and develop an application of this result for a joint source channel coding problem over a broadcast channel.

Information Theory · Computer Science 2014-09-30 Min Ye , Alexander Barg

This paper studies two problems that are motivated by the novel recent approach of composite DNA that takes advantage of the DNA synthesis property which generates a huge number of copies for every synthesized strand. Under this paradigm,…

Information Theory · Computer Science 2025-05-15 Tomer Cohen , Eitan Yaakobi

Mixed-precision quantization offers superior performance to fixed-precision quantization. It has been widely used in signal processing, communication systems, and machine learning. In mixed-precision quantization, bit allocation is…

Signal Processing · Electrical Eng. & Systems 2025-06-17 Yiming Fang , Li Chen , Yunfei Chen , Weidong Wang , Changsheng You

Stochastic processes on complex networks, where each node is in one of several compartments, and neighboring nodes interact with each other, can be used to describe a variety of real-world spreading phenomena. However, computational…

Social and Information Networks · Computer Science 2019-06-28 Gerrit Großmann , Luca Bortolussi

Starting from the Avellaneda-Stoikov framework, we consider a market maker who wants to optimally set bid/ask quotes over a finite time horizon, to maximize her expected utility. The intensities of the orders she receives depend not only on…

Trading and Market Microstructure · Quantitative Finance 2020-06-29 Diego Zabaljauregui , Luciano Campi