English
Related papers

Related papers: Parallel Write-Efficient Algorithms and Data Struc…

200 papers

The factorization of skew-symmetric matrices is a critically understudied area of dense linear algebra, particularly in comparison to that of general and symmetric matrices. While some algorithms can be adapted from the symmetric case, the…

Mathematical Software · Computer Science 2026-05-06 Ishna Satyarth , Chao Yin , Devin A. Matthews , Maggie Myers , Robert van de Geijn , RuQing G. Xu

We present an algorithm that allows for building left-balanced and complete k-d trees over k-dimensional points in a trivially parallel and GPU friendly way. Our algorithm requires exactly one int per data point as temporary storage, and…

Data Structures and Algorithms · Computer Science 2023-04-06 Ingo Wald

The recent success of neural networks for solving difficult decision tasks has incentivized incorporating smart decision making "at the edge." However, this work has traditionally focused on neural network inference, rather than training,…

Machine Learning · Computer Science 2021-07-16 Albert Gural , Phillip Nadeau , Mehul Tikekar , Boris Murmann

In this paper, we analyze the complexity of natural parallelizations of Delaunay refinement methods for mesh generation. The parallelizations employ a simple strategy: at each iteration, they choose a set of ``independent'' points to insert…

Computational Geometry · Computer Science 2007-05-23 Dan A. Spielman , Shang-hua Teng , Alper Ungor

Recently, Deep Neural Networks (DNNs) have recorded great success in handling medical and other complex classification tasks. However, as the sizes of a DNN model and the available dataset increase, the training process becomes more complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-02-08 Samson B. Akintoye , Liangxiu Han , Xin Zhang , Haoming Chen , Daoqiang Zhang

The effective use of parallel computing resources to speed up algorithms in current multi-core parallel architectures remains a difficult challenge, with ease of programming playing a key role in the eventual success of various parallel…

Data Structures and Algorithms · Computer Science 2014-12-09 Arash Farzan , Alejandro López-Ortiz , Patrick K. Nicholson , Alejandro Salinger

Parallel thinking has emerged as a promising paradigm for reasoning, yet it imposes significant computational burdens. Existing efficiency methods primarily rely on local, per-trajectory signals and lack principled mechanisms to exploit…

Computation and Language · Computer Science 2026-02-12 Tong Zheng , Chengsong Huang , Runpeng Dai , Yun He , Rui Liu , Xin Ni , Huiwen Bao , Kaishen Wang , Hongtu Zhu , Jiaxin Huang , Furong Huang , Heng Huang

Computer vision on low-power edge devices enables applications including search-and-rescue and security. State-of-the-art computer vision algorithms, such as Deep Neural Networks (DNNs), are too large for inference on low-power edge…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Abhinav Goel , Caleb Tung , Xiao Hu , George K. Thiruvathukal , James C. Davis , Yung-Hsiang Lu

The PC algorithm is the state-of-the-art algorithm for causal structure discovery on observational data. It can be computationally expensive in the worst case due to the conditional independence tests are performed in an…

Machine Learning · Computer Science 2021-09-13 Kai Zhang , Chao Tian , Kun Zhang , Todd Johnson , Xiaoqian Jiang

We show that Delaunay triangulations and compressed quadtrees are equivalent structures. More precisely, we give two algorithms: the first computes a compressed quadtree for a planar point set, given the Delaunay triangulation; the second…

Computational Geometry · Computer Science 2012-08-27 Maarten Löffler , Wolfgang Mulzer

A new scalable parallel math library, dMath, is presented in this paper that demonstrates leading scaling when using intranode, or internode, hybrid-parallelism for deep-learning. dMath provides easy-to-use distributed base primitives and a…

Neural and Evolutionary Computing · Computer Science 2016-04-07 Steven Eliuk , Cameron Upright , Anthony Skjellum

In embedded vision systems, parallel computation of the integral image presents several design challenges in terms of hardware resources, speed and power consumption. Although recursive equations significantly reduce the number of…

Computer Vision and Pattern Recognition · Computer Science 2015-10-20 Shoaib Ehsan , Adrian F. Clark , Wah M. Cheung , Arjunsingh M. Bais , Bayar I. Menzat , Nadia Kanwal , Klaus D. McDonald-Maier

The research in parallel machine scheduling in combinatorial optimization suggests that the desirable parallel efficiency could be achieved when the jobs are sorted in the non-increasing order of processing times. In this paper, we find…

Numerical Analysis · Mathematics 2012-02-15 Lei Wang , Heng Liang , Fengshan Bai , Yan Huo

The growing interest for high dimensional and functional data analysis led in the last decade to an important research developing a consequent amount of techniques. Parallelized algorithms, which consist in distributing and treat the data…

Statistics Theory · Mathematics 2017-10-24 Antoine Godichon-Baggioni , Sofiane Saadane

We investigate the problem of minimizing the expectation of smooth nonconvex functions in a distributed setting with multiple parallel workers that are able to compute stochastic gradients. A significant challenge in this context is the…

Optimization and Control · Mathematics 2025-06-16 Artavazd Maranjyan , Omar Shaikh Omar , Peter Richtárik

Finding the number of triangles in a network is an important problem in the analysis of complex networks. The number of triangles also has important applications in data mining. Existing distributed memory parallel algorithms for counting…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-06-24 Shaikh Arifuzzaman , Maleq Khan , Madhav Marathe

The implementation of a vast majority of machine learning (ML) algorithms boils down to solving a numerical optimization problem. In this context, Stochastic Gradient Descent (SGD) methods have long proven to provide good results, both in…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-10-06 Janis Keuper , Franz-Josef Pfreundt

Stochastic gradient descent (SGD) algorithm and its variations have been effectively used to optimize neural network models. However, with the rapid growth of big data and deep learning, SGD is no longer the most suitable choice due to its…

Machine Learning · Computer Science 2024-02-13 Anuraganand Sharma

The growing demand for real-time DNN applications on edge devices necessitates faster inference of increasingly complex models. Although many devices include specialized accelerators (e.g., mobile GPUs), dynamic control-flow operators and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-15 Chong Tang , Hao Dai , Jagmohan Chauhan

Learning-based planners leveraging Graph Neural Networks can learn search guidance applicable to large search spaces, yet their potential to address symmetries remains largely unexplored. In this paper, we introduce a graph representation…

Artificial Intelligence · Computer Science 2025-04-29 Yingbin Bai , Sylvie Thiebaux , Felipe Trevizan