中文
相关论文

相关论文: Coded Distributed (Batch) Matrix Multiplication ov…

200 篇论文

This paper proposes a novel parallel coding transmission strategy and an iterative detection and decoding receiver signal processing technique for orthogonal delay-Doppler division multiplexing (ODDM) modulation. Specifically, the proposed…

信息论 · 计算机科学 2025-02-04 Qi Li , Jinhong Yuan , Min Qiu

In this paper we develop a low-complexity coding scheme and system design framework for the half duplex relay channel based on the Quantize-Map-and-Forward (QMF) relay- ing scheme. The proposed framework allows linear complexity operations…

信息论 · 计算机科学 2012-10-26 Vinayak Nagpal , I-Hsiang Wang , Milos Jorgovanovic , David Tse , Borivoje Nikolic

Distributed multi-task learning (DMTL) effectively improves model generalization performance through the collaborative training of multiple related models. However, in large-scale learning scenarios, communication bottlenecks severely limit…

信息论 · 计算机科学 2025-07-25 Minquan Cheng , Yongkang Wang , Lingyu Zhang , Youlong Wu

We introduce a new class of exact Minimum-Bandwidth Regenerating (MBR) codes for distributed storage systems, characterized by a low-complexity uncoded repair process that can tolerate multiple node failures. These codes consist of the…

信息论 · 计算机科学 2010-10-14 Salim El Rouayheb , Kannan Ramchandran

General Matrix Multiplication (GEMM) is a crucial algorithm for various applications such as machine learning and scientific computing, and an efficient GEMM implementation is essential for the performance of these systems. While…

分布式、并行与集群计算 · 计算机科学 2023-05-03 Shixun Wu , Yujia Zhai , Jinyang Liu , Jiajun Huang , Zizhe Jian , Bryan M. Wong , Zizhong Chen

Diffusion model distillation has emerged as a powerful technique for creating efficient few-step and single-step generators. Among these, Distribution Matching Distillation (DMD) and its variants stand out for their impressive performance,…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Dongyang Liu , Peng Gao , David Liu , Ruoyi Du , Zhen Li , Qilong Wu , Xin Jin , Sihan Cao , Shifeng Zhang , Hongsheng Li , Steven Hoi

To better understand the wireless network design with a large number of hops, we investigate a line network formed by general discrete memoryless channels (DMCs), which may not be identical. Our focus lies on Generalized Batched Network…

信息论 · 计算机科学 2023-12-21 Jie Wang , Shenghao Yang , Yanyan Dong , Yiheng Zhang

Finite field transforms are offered as a new tool of spreading sequence design. This approach exploits orthogonality properties of synchronous non-binary sequences defined over a complex finite field. It is promising for channels supporting…

信息论 · 计算机科学 2015-02-23 H. M. de Oliveira , R. M. Campello de Souza

We consider the estimation of Dirichlet Process Mixture Models (DPMMs) in distributed environments, where data are distributed across multiple computing nodes. A key advantage of Bayesian nonparametric models such as DPMMs is that they…

机器学习 · 统计学 2017-09-20 Ruohui Wang , Dahua Lin

Excessive accumulation of group-delay (GD) spread increases computational complexity and affects tracking of receiver-based multi-input multi-output signal processing, posing challenges to long-haul mode-division multiplexing in multimode…

光学 · 物理学 2025-05-13 Anirudh Vijay , Nika Zahedi , Oleksiy Krutko , Rebecca Refaee , Joseph M. Kahn

An important linear algebra routine, GEneral Matrix Multiplication (GEMM), is a fundamental operator in deep learning. Compilers need to translate these routines into low-level code optimized for specific hardware. Compiler-level…

机器学习 · 计算机科学 2019-09-25 Huaqing Zhang , Xiaolin Cheng , Hui Zang , Dae Hoon Park

In this paper we consider the diversity-multiplexing gain tradeoff (DMT) of so-called minimum delay asymmetric space-time codes. Such codes are less than full dimensional lattices in their natural ambient space. Apart from the multiple…

信息论 · 计算机科学 2021-02-22 Roope Vehkalahti , Laura Luzzi

In this paper, we explore how quantum resources can be used to increase the rate of private distributed matrix multiplication (PDMM). In PDMM, a user who has two high-dimensional matrices, $A$ and $B$, and lacks the computational…

信息论 · 计算机科学 2025-12-01 Mohamed Nomeir , Alptug Aytekin , Lei Hu , Sennur Ulukus

We present DMax, a new paradigm for efficient diffusion language models (dLLMs). It mitigates error accumulation in parallel decoding, enabling aggressive decoding parallelism while preserving generation quality. Unlike conventional masked…

机器学习 · 计算机科学 2026-05-18 Zigeng Chen , Gongfan Fang , Xinyin Ma , Ruonan Yu , Xinchao Wang

Learning by integrating multiple heterogeneous data sources is a common requirement in many tasks. Collective Matrix Factorization (CMF) is a technique to learn shared latent representations from arbitrary collections of matrices. It can be…

机器学习 · 计算机科学 2021-09-29 Ragunathan Mariappan , Vaibhav Rajan

The distance profiles of linear block codes can be employed to design variational coding scheme for encoding message with variational length and getting lower decoding error probability by large minimum Hamming distance. %, e.g. the design…

信息论 · 计算机科学 2013-06-05 Xiaogang Liu , Yuan Luo , Kenneth W. Shum

Linear computation coding is concerned with the compression of multidimensional linear functions, i.e. with reducing the computational effort of multiplying an arbitrary vector to an arbitrary, but known, constant matrix. This paper…

信息论 · 计算机科学 2025-07-02 Hans Rosenberger , Johanna S. Fröhlich , Ali Bereyhi , Ralf R. Müller

An adaptive randomized distributed space-time coding (DSTC) scheme is proposed for two-hop cooperative MIMO networks. Linear minimum mean square error (MMSE) receiver filters and randomized matrices subject to a power constraint are…

信息论 · 计算机科学 2013-03-20 T. Peng , R. C. de Lamare , A. Schmeink

We show that polynomial codes (and some related codes) used for distributed matrix multiplication are interleaved Reed-Solomon codes and, hence, can be collaboratively decoded. We consider a fault tolerant setup where $t$ worker nodes…

信息论 · 计算机科学 2019-06-03 Adarsh M. Subramaniam , Anoosheh Heiderzadeh , Krishna R. Narayanan

Spatially-coupled (SC) codes are a class of low-density parity-check (LDPC) codes that is gaining increasing attention. Multi-dimensional (MD) SC codes are constructed by connecting copies of an SC code via relocations in order to mitigate…

信息论 · 计算机科学 2026-03-30 Ata Tanrıkulu , Mete Yıldırım , Ahmed Hareedy