English
Related papers

Related papers: Towards a complete DMT classification of division …

200 papers

The goal in label-imbalanced and group-sensitive classification is to optimize relevant metrics such as balanced error and equal opportunity. Classical methods, such as weighted cross-entropy, fail when training deep nets to the terminal…

Machine Learning · Computer Science 2021-11-09 Ganesh Ramachandra Kini , Orestis Paraskevas , Samet Oymak , Christos Thrampoulidis

In this paper, we propose a lattice-based robust distributed source coding system for two correlated sources and provide a detailed performance analysis under the high resolution assumption. It is shown, among other things, that, in the…

Information Theory · Computer Science 2018-10-04 Dania Elzouki , Sorina Dumitrescu , Jun Chen

In this short note we will prove that non-vanishing determinant (NVD) criterion is not enough for an asymmetric space-time block code (STBC) to achieve the optimal diversity-multiplexing gain trade-off (DMT). This result is in contrast to…

Information Theory · Computer Science 2013-08-20 Roope Vehkalahti

We study the problem of approximating a discrete probability distribution, such as the next-token distribution of a large language model, by a dyadic distribution induced by a binary tree under encoding rate constraints. The objective is to…

Information Theory · Computer Science 2026-05-08 Daniella Bar-Lev , Farzad Farnoud , Ryan Gabrys

One of the main open problems in the theory of multi-category margin classification is the form of the optimal dependency of a guaranteed risk on the number C of categories, the sample size m and the margin parameter gamma. From a practical…

Statistics Theory · Mathematics 2018-12-04 Khadija Musayeva , Fabien Lauer , Yann Guermeur

Despite the successes of probabilistic models based on passing noise through neural networks, recent work has identified that such methods often fail to capture tail behavior accurately, unless the tails of the base distribution are…

Machine Learning · Statistics 2023-06-16 Feynman Liang , Liam Hodgkinson , Michael W. Mahoney

Convergence of Extremum Seeking (ES) algorithms has been established in the limit of small gains. Using averaging theory and contraction analysis, we propose a framework for computing explicit bounds on the departure of the ES scheme from…

Optimization and Control · Mathematics 2013-03-20 Gabriel Bousquet , Jean-Jacques Slotine

Suppose $\Omega\subseteq\RR^d$ is a bounded and measurable set and $\Lambda \subseteq \RR^d$ is a lattice. Suppose also that $\Omega$ tiles multiply, at level $k$, when translated at the locations $\Lambda$. This means that the…

Classical Analysis and ODEs · Mathematics 2013-05-14 Mihail N. Kolountzakis

The familiar adjunction between ordered sets and completely distributive lattices can be extended to generalised metric spaces, that is, categories enriched over a quantale (a lattice of "truth values"), via an appropriate distributive law…

Category Theory · Mathematics 2021-12-28 Adriana Balan , Alexander Kurz

This paper introduces a novel approach to algebraic multigrid methods for large systems of linear equations coming from finite element discretizations of certain elliptic second order partial differential equations. Based on a discrete…

Numerical Analysis · Mathematics 2020-11-30 Lukas Kogler , Joachim Schöberl

This paper presents a class of Dynamic Multi-Armed Bandit problems where the reward can be modeled as the noisy output of a time varying linear stochastic dynamic system that satisfies some boundedness constraints. The class allows many…

Machine Learning · Computer Science 2017-10-10 T. W. U. Madhushani , D. H. S. Maithripala , N. E. Leonard

Bounds on linear codes play a central role in coding theory, as they capture the fundamental trade-off between error-correction capability (minimum distance) and information rate (dimension relative to length). Classical results…

Information Theory · Computer Science 2025-09-04 Liren Lin , Guanghui Zhang , Bocong Chen , Hongwei Liu

A method for finding an optimum $n$-dimensional commutative group code of a given order $M$ is presented. The approach explores the structure of lattices related to these codes and provides a significant reduction in the number of…

Information Theory · Computer Science 2013-03-26 Cristiano Torezzan , João E. Strapasson , Sueli I. R. Costa , Rogerio M. Siqueira

We obtain algorithmically effective versions of the dense lattice sphere packings constructed from orders in $\mathbb{Q}$-division rings by the first author. The lattices in question are lifts of suitable codes from prime characteristic to…

Number Theory · Mathematics 2022-04-12 Nihar Gargava , Vlad Serban

In this paper we develop a general theory which provides a unified treatment of two apparently different problems. The weak Gibbs property of measures arising from the application of Renormalization Group maps and the mixing properties of…

Statistical Mechanics · Physics 2015-05-30 L. Bertini , Emilio N. M. Cirillo , E. Olivieri

We propose and analyze a novel scheme based on LDPC codes for quantitative group testing. The key underlying idea is to augment the bipartite graph by introducing hidden non-binary variables to strengthen the message-passing decoder. This…

Information Theory · Computer Science 2024-10-01 Mgeni Makambi Mashauri , Alexandre Graell i Amat , Michael Lentmaier

Long-tail imbalance is endemic to multi-label learning: a few head labels dominate the gradient signal, while the many rare labels that matter in practice are silently ignored. We tackle this problem by casting the task as a cooperative…

Machine Learning · Computer Science 2025-10-21 Canran Xiao , Chuangxin Zhao , Zong Ke , Fei Shen

Low-density parity-check (LDPC) codes with the parity-based approach for distributed joint source channel coding (DJSCC) with decoder side information is described in this paper. The parity-based approach is theoretical limit achievable.…

Information Theory · Computer Science 2014-04-10 Feng Cen

In this paper, we consider the problem of distributed optimisation of a separable convex cost function over a graph, where every edge and node in the graph could carry both linear equality and/or inequality constraints. We show how to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-20 Richard Heusdens , Guoqiang Zhang

An algebraic theory of dualities is developed based on the notion of bond algebras. It deals with classical and quantum dualities in a unified fashion explaining the precise connection between quantum dualities and the low temperature…

Statistical Mechanics · Physics 2015-03-19 Emilio Cobanera , Gerardo Ortiz , Zohar Nussinov