English
Related papers

Related papers: Do MPI Derived Datatypes Actually Help? A Single-N…

200 papers

Collecting annotated data for semantic segmentation is time-consuming and hard to scale up. In this paper, we for the first time propose a unified framework, termed as Multi-Dataset Pretraining, to take full advantage of the fragmented…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Bowen Shi , Xiaopeng Zhang , Haohang Xu , Wenrui Dai , Junni Zou , Hongkai Xiong , Qi Tian

Coded distributed matrix multiplication (CDMM) schemes, such as MatDot codes, seek efficient ways to distribute matrix multiplication task(s) to a set of $N$ distributed servers so that the answers returned from any $R$ servers are…

Information Theory · Computer Science 2021-05-18 Junge Wang , Zhuqing Jia , Syed A. Jafar

Availability of high performance computing infrastructures such as clusters of GPUs and CPUs have fueled the growth of distributed learning systems. Deep Learning frameworks express neural nets as DAGs and execute these DAGs on computation…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-21 Amith R Mamidala

This paper introduces madupite, a high-performance distributed solver for large-scale Markov Decision Processes (MDPs). MDPs are widely used to model complex dynamical systems in various fields, including finance, epidemiology, and traffic…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-21 Matilde Gargiani , Robin Sieber , Philip Pawlowsky , Václav Hapla , John Lygeros

Multiuser multiple-input multiple-output (MIMO) systems are a prime candidate for use in massive connection density in machine-type communication (MTC) networks. One of the key challenges of MTC networks is to obtain accurate channel state…

Information Theory · Computer Science 2019-04-25 Jiho Song , Byungju Lee , Song Noh , Jong-Ho Lee

Transformer-based NLP models are powerful but have high computational costs that limit deployment. Finetuned encoder-decoder models are popular in specialized domains and can outperform larger more generalized decoder-only models, such as…

Computation and Language · Computer Science 2024-11-19 Bo-Ru Lu , Nikita Haduong , Chien-Yu Lin , Hao Cheng , Noah A. Smith , Mari Ostendorf

Organizations started to adopt differential privacy (DP) techniques hoping to persuade more users to share personal data with them. However, many users do not understand DP techniques, thus may not be willing to share. Previous research…

Human-Computer Interaction · Computer Science 2022-08-05 Jingyu Jia , Zikai Alex Wen , Zheli Liu , Changyu Dong

Employing a single, unified model (UM) for both visual understanding (image-to-text: I2T) and visual generation (text-to-image: T2I) has opened a new direction in Visual Language Model (VLM) research. While UMs can also support broader…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Sabbir Mollah , Rohit Gupta , Sirnam Swetha , Qingyang Liu , Ahnaf Munir , Mubarak Shah

Distributed computing frameworks such as MapReduce and Spark are often used to process large-scale data computing jobs. In wireless scenarios, exchanging data among distributed nodes would seriously suffer from the communication bottleneck…

Information Theory · Computer Science 2023-10-25 Youlong Wu , Zhenhao Huang , Kai Yuan , Shuai Ma , Yue Bi

We discuss the computational bottlenecks in molecular dynamics (MD) and describe the challenges in parallelizing the computation intensive tasks. We present a hybrid algorithm using MPI (Message Passing Interface) with OpenMP threads for…

Computational Physics · Physics 2015-07-28 Anirban Pal , Abhishek Agarwala , Soumyendu Raha , Baidurya Bhattacharya

In this paper, we investigate the joint device activity and data detection in massive machine-type communications (mMTC) with a one-phase non-coherent scheme, where data bits are embedded in the pilot sequences and the base station…

Information Theory · Computer Science 2023-01-03 Zhe Ma , Wen Wu , Feifei Gao , Xuemin , Shen

MatlabMPI is a Matlab implementation of the Message Passing Interface (MPI) standard and allows any Matlab program to exploit multiple processors. MatlabMPI currently implements the basic six functions that are the core of the MPI…

Astrophysics · Physics 2007-05-23 Jeremy Kepner

We present an empirical validation of the directional non-commutative monoidal embedding framework recently introduced in prior work~\cite{Godavarti2025monoidal}. This framework defines learnable compositional embeddings using distinct…

Machine Learning · Computer Science 2025-06-05 Mahesh Godavarti

World models are essential for autonomous robotic planning. However, the substantial computational overhead of existing dense Transformerbased models significantly hinders real-time deployment. To address this efficiency-performance…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Shicheng Yin , Kaixuan Yin , Weixing Chen , Yang Liu , Guanbin Li , Liang Lin

The 3D Discrete Fourier Transform (DFT) is a technique used to solve problems in disparate fields. Nowadays, the commonly adopted implementation of the 3D-DFT is derived from the Fast Fourier Transform (FFT) algorithm. However, evidence…

Computational Physics · Physics 2024-07-10 Nitin Malapally , Viacheslav Bolnykh , Estela Suarez , Paolo Carloni , Thomas Lippert , Davide Mandelli

In large scale distributed computing systems, communication overhead is one of the major bottlenecks. In the map-shuffle-reduce framework, which is one of the major distributed computing frameworks, the communication load among servers can…

Information Theory · Computer Science 2020-05-14 Shunsuke Horii

Developing robust and effective artificial intelligence (AI) models in medicine requires access to large amounts of patient data. The use of AI models solely trained on large multi-institutional datasets can help with this, yet the…

Dantzig-Wolfe decomposition (DWD) is a classical algorithm for solving large-scale linear programs whose constraint matrix involves a set of independent blocks coupled with a set of linking rows. The algorithm decomposes such a model into a…

Optimization and Control · Mathematics 2021-01-12 Mohamed El Tonbari , Shabbir Ahmed

Advances in mobile computing technologies have made it possible to monitor and apply data-driven interventions across complex systems in real time. Markov decision processes (MDPs) are the primary model for sequential decision problems with…

Methodology · Statistics 2018-03-20 Longshaokan Wang , Eric B. Laber , Katie Witkiewitz

The finite-time convergence of off-policy TD learning has been comprehensively studied recently. However, such a type of convergence has not been well established for off-policy TD learning in the multi-agent setting, which covers broader…

Machine Learning · Computer Science 2021-03-25 Ziyi Chen , Yi Zhou , Rongrong Chen