English
Related papers

Related papers: Dynamic Parameter Scheduling in Soft-Hard BPGD for…

200 papers

In this paper, we present a fast min-sum algorithm for decoding LDPC codes over GF(q). Our algorithm is different from the one presented by David Declercq and Marc Fossorier in ISIT 05 only at the way of speeding up the horizontal scan in…

Information Theory · Computer Science 2016-11-15 Xiaofei Huang , Suquan Ding , Zhixing Yang , Youshou Wu

A GPU-accelerated version of the lattice Boltzmann method for efficient simulation of soft materials is introduced. Unlike standard approaches, this method reconstructs the distribution functions from available hydrodynamic variables…

Gradient-boosted decision trees (GBDT) are widely used and highly effective machine learning approach for tabular data modeling. However, their complex structure may lead to low robustness against small covariate perturbation in unseen…

Machine Learning · Statistics 2023-05-12 Shijie Cui , Agus Sudjianto , Aijun Zhang , Runze Li

In this paper, we studied a buffered mini-batch gradient descent (BMGD) algorithm for training complex model on massive datasets. The algorithm studied here is designed for fast training on a GPU-CPU system, which contains two steps: the…

Computation · Statistics 2023-12-15 Haobo Qi , Du Huang , Yingqiu Zhu , Danyang Huang , Hansheng Wang

In this dissertation we propose alternative analysis of distributed stochastic gradient descent (SGD) algorithms that rely on spectral properties of the data covariance. As a consequence we can relate questions pertaining to speedups and…

Optimization and Control · Mathematics 2016-09-03 Avleen S. Bijral

The problem of error correction for Gallager's low-density parity-check codes is famously equivalent to that of computing marginal Boltzmann probabilities for an Ising-like model with multispin interactions in a non-uniform magnetic field.…

Statistical Mechanics · Physics 2014-11-03 Marco Pretti

Concatenated bosonic-stabilizer codes have recently gained prominence as promising candidates for achieving low-overhead fault-tolerant quantum computing in the long term. In such systems, analog information obtained from the syndrome…

Quantum Physics · Physics 2025-05-13 Shantom K. Borah , Asit K. Pradhan , Nithin Raveendran , Michele Pacenti , Bane Vasic

We introduce a new family of erasure codes, called group decodable code (GDC), for distributed storage system. Given a set of design parameters {\alpha; \beta; k; t}, where k is the number of information symbols, each codeword of an…

Information Theory · Computer Science 2015-07-30 Wentu Song , Son Hoang Dau , Chau Yuen

With the rapid increase of big data, distributed Machine Learning (ML) has been widely applied in training large-scale models. Stochastic Gradient Descent (SGD) is arguably the workhorse algorithm of ML. Distributed ML models trained by SGD…

Machine Learning · Computer Science 2021-12-09 Keyu Yang , Lu Chen , Zhihao Zeng , Yunjun Gao

Functionally Graded Materials (FGMs) made of soft constituents have emerged as promising material-structure systems in potential applications across many engineering disciplines, such as soft robots, actuators, energy harvesting, and tissue…

Computational Engineering, Finance, and Science · Computer Science 2025-07-01 Shiguang Deng , Horacio D. Espinosa , Wei Chen

In this paper, soft-decision (SD) decoders of permutation trellis code (PTC) with $M$-ary frequency shift keying are designed using three optimization algorithms and presented in four decoding schemes. In a concatenated code such as PTC,…

Signal Processing · Electrical Eng. & Systems 2020-11-12 Oluwafemi Kolade , Mulundumina Shimaponda-Nawa , Daniel J. J. Versfeld , Ling Cheng

This paper proposes a framework of L-BFGS based on the (approximate) second-order information with stochastic batches, as a novel approach to the finite-sum minimization problems. Different from the classical L-BFGS where stochastic batches…

Machine Learning · Computer Science 2018-07-17 Jie Liu , Yu Rong , Martin Takac , Junzhou Huang

This paper proposes a new iterative gradient descent decoding method for real number parity codes. The proposed decoder, named Gradient Descent Symbol Update (GDSU), is used for a class of low-density parity-check (LDPC) real-number codes…

Information Theory · Computer Science 2024-11-26 Oana Boncalo , Alexandru Amaricai

We introduce a generalized low-density parity-check decoding framework for quantum Tanner codes utilizing soft-output guessing random additive noise decoding (SOGRAND). By soft-output decoding entire component codes, we mitigate trapping…

Quantum Physics · Physics 2026-03-20 Lukas Rapp , Muriel Médard , Eugene Tang , Ken R. Duffy

Low-density parity-check (LDPC) codes together with belief propagation (BP) decoding yield exceptional error correction capabilities in the large block length regime. Yet, there remains a gap between BP decoding and maximum likelihood…

Information Theory · Computer Science 2025-01-22 Jonathan Mandelbaum , Holger Jäkel , Laurent Schmalen

Reed-Muller (RM) codes are conjectured to achieve the capacity of any binary-input memoryless symmetric (BMS) channel, and are observed to have a comparable performance to that of random codes in terms of scaling laws. On the negative side,…

Information Theory · Computer Science 2021-02-03 Mohammad Vahid Jamali , Xiyang Liu , Ashok Vardhan Makkuva , Hessam Mahdavifar , Sewoong Oh , Pramod Viswanath

Efficient decoding is crucial to high-throughput and power-sensitive wireless communication scenarios. A theoretical analysis of the performance-complexity tradeoff toward low-complexity decoding is required for a better understanding of…

Information Theory · Computer Science 2025-11-12 Qingqing Peng , Dawei Yin , Dongxu Chang , Yuan Li , Huazi Zhang , Guiying Yan , Guanghui Wang

Cognitive radio (CR) is to detect the presence of primary users (PUs) reliably in order to reduce the interference to licensed communications. Genetic algorithms (GAs) are well suited for CR optimization problems to increase efficiency of…

Networking and Internet Architecture · Computer Science 2013-04-12 Md. Kamal Hossain , Ayman Abd El-Saleh

We propose an Iterative Detection and Decoding (IDD) scheme with Low Density Parity Check (LDPC) codes for Multiple Input Multiple Output (MIMO) systems for block-fading $F = 2$ and fast fading Rayleigh channels. An IDD receiver with soft…

Information Theory · Computer Science 2014-04-09 A. G. D. Uchoa , C. T. Healy , R. C. de Lamare , P. Li

Federated learning, where algorithms are trained across multiple decentralized devices without sharing local data, is increasingly popular in distributed machine learning practice. Typically, a graph structure $G$ exists behind local…

Machine Learning · Statistics 2022-09-20 Huiyuan Wang , Xuyang Zhao , Wei Lin