English
Related papers

Related papers: Hierarchical Distribution Matching for Probabilist…

200 papers

Distributed model fitting refers to the process of fitting a mathematical or statistical model to the data using distributed computing resources, such that computing tasks are divided among multiple interconnected computers or nodes, often…

Computation · Statistics 2024-06-04 Xiaofei Wu , Rongmei Liang , Fabio Roli , Marcello Pelillo , Jing Yuan

We investigate the properties of a Block Decomposition Method (BDM), which extends the power of a Coding Theorem Method (CTM) that approximates local estimations of algorithmic complexity based upon Solomonoff-Levin's theory of algorithmic…

Information Theory · Computer Science 2018-06-20 Hector Zenil , Santiago Hernández-Orozco , Narsis A. Kiani , Fernando Soler-Toscano , Antonio Rueda-Toicen

Recently, probabilistic predictive coding that directly models the conditional distribution of latent features across successive frames for temporal redundancy removal has yielded promising results. Existing methods using a single-scale…

Image and Video Processing · Electrical Eng. & Systems 2023-12-13 Ming Lu , Zhihao Duan , Fengqing Zhu , Zhan Ma

In this paper, we propose a systematic low density generator matrix (LDGM) code ensemble, which is defined by the Bernoulli process. We prove that, under maximum likelihood (ML) decoding, the proposed ensemble can achieve the capacity of…

Information Theory · Computer Science 2020-01-10 Suihua Cai , Wenchao Lin , Xinyuanmeng Yao , Baodian Wei , Xiao Ma

Recently, true-time-delay (TTD) arrays, also referred to as joint phase-time arrays (JPTA), have been investigated for low-cost frequency-dependent beamforming capabilities to enable various applications, including beam-squint correction,…

Signal Processing · Electrical Eng. & Systems 2026-05-11 Ibrahim Pehlivan , Danijela Cabric

In this work, arithmetic distribution matching (ADM) is presented. ADM invertibly transforms a discrete memoryless source (DMS) into a target DMS. ADM can be used for probabilistic shaping and for rate adaption. Opposed to existing…

Information Theory · Computer Science 2014-08-19 Sebastian Baur , Georg Böcherer

In Spectrally Efficient Frequency Division Multiplexing systems the input data stream is divided into several adjacent subchannels where the distance of the subchannels is less than that of Orthogonal Frequency Division…

Information Theory · Computer Science 2013-04-16 Seyed Javad Heydari , Mahmoud Ferdosizade Naeiny , Farokh Marvasti

Spectral efficiency is a key design issue for all wireless communication systems. Orthogonal frequency division multiplexing (OFDM) is a very well-known technique for efficient data transmission over many carriers overlapped in frequency.…

Networking and Internet Architecture · Computer Science 2013-03-28 R. G. Clegg , S. Isam , I. Kanaris , I. Darwazeh

One of the fundamental problems in machine learning is the estimation of a probability distribution from data. Many techniques have been proposed to study the structure of data, most often building around the assumption that observations…

Machine Learning · Statistics 2013-02-22 Oren Rippel , Ryan Prescott Adams

This paper presents a novel distributed approach for solving AC power flow (PF) problems. The optimization problem is reformulated into a distributed form using a communication structure corresponding to a hypergraph, by which complex…

Optimization and Control · Mathematics 2024-07-03 Xinliang Dai , Yingzhao Lian , Yuning Jiang , Colin N. Jones , Veit Hagenmeyer

The dynamic behavior of jointed assemblies exhibiting friction nonlinearities features amplitude-dependent dissipation and stiffness. To develop numerical simulations for predictive and design purposes, macro-scale High Fidelity Models…

Computational Engineering, Finance, and Science · Computer Science 2022-04-27 Ahmed Amr Morsy , Mariella Kast , Paolo Tiso

Retrieval-augmented code generation often conditions the decoder on large retrieved code snippets. This ties online inference cost to repository size and introduces noise from long contexts. We present Hierarchical Embedding Fusion (HEF), a…

Computation and Language · Computer Science 2026-03-10 Nikita Sorokin , Ivan Sedykh , Valentin Malykh

As the recommendation service needs to address increasingly diverse distributions, such as multi-population, multi-scenario, multitarget, and multi-interest, more and more recent works have focused on multi-distribution modeling and…

Machine Learning · Computer Science 2024-08-05 Xingyu Lou , Yu Yang , Kuiyao Dong , Heyuan Huang , Wenyi Yu , Ping Wang , Xiu Li , Jun Wang

Explicit representations of the global match distributions of pixel-wise correspondences between pairs of images are desirable for uncertainty estimation and downstream applications. However, the computation of the match density for each…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Zhichao Yin , Trevor Darrell , Fisher Yu

Probabilistic Amplitude Shaping (PAS) is a coded-modulation scheme in which the encoder is a concatenation of a distribution matcher with a systematic Forward Error Correction (FEC) code. For reduced computational complexity the decoder can…

Information Theory · Computer Science 2018-06-05 Rana Ali Amjad

Concatenated bit-interleaved and multilevel coded modulation with outer Reed--Solomon codes, inner Chase-algorithm-based soft-decision-decoded Bose--Ray-Chaudhuri--Hocquenghem codes, and four-level pulse amplitude modulation is considered.…

Information Theory · Computer Science 2025-01-22 Alvin Y. Sukmadji , Frank R. Kschischang

We address a design of high-capacity and low-peak-to-average power ratio (PAPR) orthogonal frequency-division multiplexing (OFDM) systems based on bit-interleaved coded modulation (BICM) utilizing non-equiprobable and non-uniform (NENU)…

Information Theory · Computer Science 2026-01-21 Eito Kurihara , Hideki Ochiai

The Hierarchical Heavy Hitters problem extends the notion of frequent items to data arranged in a hierarchy. This problem has applications to network traffic monitoring, anomaly detection, and DDoS detection. We present a new streaming…

Data Structures and Algorithms · Computer Science 2011-08-10 Michael Mitzenmacher , Thomas Steinke , Justin Thaler

Approaching Shannon's capacity via geometric shaping has usually been regarded as challenging due to modulation and demodulation complexity, requiring look-up tables to store the constellation points and constellation bit labeling. To…

Signal Processing · Electrical Eng. & Systems 2024-01-25 Ali Mirani , Erik Agrell , Magnus Karlsson

For finite geometry low-density parity-check codes, heavy row and column weights in their parity check matrix make the decoding with even Min-Sum (MS) variants computationally expensive. To alleviate it, we present a class of hybrid schemes…

Information Theory · Computer Science 2009-07-02 Guangwen Li , Dashe Li , Yuling Wang , Wenyan Sun