English
Related papers

Related papers: Experimental Evaluation of Multi-Round Matrix Mult…

200 papers

Fast combinational multipliers with large bit widths can occupy significant silicon area, which also drives up power consumption. Area can be reduced through resource sharing (i.e., folding) at the expense of lower throughput, which is…

Hardware Architecture · Computer Science 2025-09-03 Ahmad Houraniah , H. Fatih Ugurdag , C. Emre Dedeagac

This paper concerns the distributed training of nonlinear kernel machines on Map-Reduce. We show that a re-formulation of Nystr\"om approximation based solution which is solved using gradient based techniques is well suited for this,…

Machine Learning · Computer Science 2014-05-20 Dhruv Mahajan , S. Sathiya Keerthi , S. Sundararajan

We study an online mixed discrete and continuous optimization problem where a decision maker interacts with an unknown environment for a number of $T$ rounds. At each round, the decision maker needs to first jointly choose a discrete and a…

Optimization and Control · Mathematics 2024-08-27 Lintao Ye , Ming Chi , Zhi-Wei Liu , Xiaoling Wang , Vijay Gupta

This paper is aimed at designing efficient parallel matrix-product algorithms for heterogeneous master-worker platforms. While matrix-product is well-understood for homogeneous 2D-arrays of processors (e.g., Cannon algorithm and ScaLAPACK…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Jack Dongarra , Jean-Francois Pineau , Yves Robert , Zhiao Shi , Frederic Vivien

Modern platforms are using accelerators in conjunction with standard processing units in order to reduce the running time of specific operations, such as matrix operations, and improve their performance. Scheduling on such hybrid platforms…

Data Structures and Algorithms · Computer Science 2020-02-11 Vincent Fagnon , Imed Kacem , Giorgio Lucarelli , Bertrand Simon

Applications such as employees sharing office spaces over a workweek can be modeled as problems where agents are matched to resources over multiple rounds. Agents' requirements limit the set of compatible resources and the rounds in which…

Artificial Intelligence · Computer Science 2022-12-01 Yohai Trabelsi , Abhijin Adiga , Sarit Kraus , S. S. Ravi , Daniel J. Rosenkrantz

Distributed maximization of a submodular function in the MapReduce (MR) model has received much attention, culminating in two frameworks that allow a centralized algorithm to be run in the MR setting without loss of approximation, as long…

Data Structures and Algorithms · Computer Science 2024-09-17 Yixin Chen , Tonmoy Dey , Alan Kuhnle

Eliminating duplicate data in primary storage of clouds increases the cost-efficiency of cloud service providers as well as reduces the cost of users for using cloud services. Existing primary deduplication techniques either use inline…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-18 Huijun Wu , Chen Wang , Yinjin Fu , Sherif Sakr , Liming Zhu , Kai Lu

Despite the prominence of neural network approaches in the field of recommender systems, simple methods such as matrix factorization with quadratic loss are still used in industry for several reasons. These models can be trained with…

Information Retrieval · Computer Science 2022-05-24 Dmitrii Beloborodov , Andrei Zimovnov , Petr Molodyk , Dmitrii Kirillov

Fast matrix multiplication algorithms may be useful, provided that their running time is good in practice. Particularly, the leading coefficient of their arithmetic complexity needs to be small. Many sub-cubic algorithms have large leading…

Data Structures and Algorithms · Computer Science 2020-08-11 Gal Beniamini , Nathan Cheng , Olga Holtz , Elaye Karstadt , Oded Schwartz

Designing the topology of three-dimensional structures is a challenging problem due to its memory and time consumption. In this paper, we present a robust and efficient algorithm for solving large-scale 3D topology optimization problems.…

Optimization and Control · Mathematics 2024-03-01 Alfredo Vitorino , Francisco A. M. Gomes

The rapid development of cloud-native architecture has promoted the widespread application of container technology, but the optimization problems in container scheduling and resource management still face many challenges. This paper…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-24 Xiaoye Wang

MapReduce has become the de facto standard model for designing distributed algorithms to process big data on a cluster. There has been considerable research on designing efficient MapReduce algorithms for clustering, graph optimization, and…

Data Structures and Algorithms · Computer Science 2018-06-19 Nicholas J. A. Harvey , Christopher Liaw , Paul Liu

As the ratio between the rate of computation and rate with which data can be retrieved from various layers of memory continues to deteriorate, a question arises: Will the current best algorithms for computing matrix-matrix multiplication on…

Mathematical Software · Computer Science 2019-04-12 Tyler M. Smith , Robert A. van de Geijn

The rise of the Internet of Things and edge computing has shifted computing resources closer to end-users, benefiting numerous delay-sensitive, computation-intensive applications. To speed up computation, distributed computing is a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-10 Ke Ma , Junfei Xie

This paper develops a clustering method that takes advantage of the sturdiness of model-based clustering, while attempting to mitigate some of its pitfalls. First, we note that standard model-based clustering likely leads to the same number…

Machine Learning · Statistics 2022-12-09 Miguel de Carvalho , Gabriel Martos Venturini , Andrej Svetlošák

The design of compact deep neural networks is a crucial task to enable widespread adoption of deep neural networks in the real-world, particularly for edge and mobile scenarios. Due to the time-consuming and challenging nature of manually…

Neural and Evolutionary Computing · Computer Science 2019-10-16 Mohammad Javad Shafiee , Andrew Hryniowski , Francis Li , Zhong Qiu Lin , Alexander Wong

Minimax designs provide a uniform coverage of a design space $\mathcal{X} \subseteq \mathbb{R}^p$ by minimizing the maximum distance from any point in this space to its nearest design point. Although minimax designs have many useful…

Computation · Statistics 2016-11-01 Simon Mak , V. Roshan Joseph

We consider the task of decentralized minimization of the sum of smooth strongly convex functions stored across the nodes of a network. For this problem, lower bounds on the number of gradient computations and the number of communication…

Optimization and Control · Mathematics 2020-11-16 Dmitry Kovalev , Adil Salim , Peter Richtárik

While high-level data parallel frameworks, like MapReduce, simplify the design and implementation of large-scale data processing systems, they do not naturally or efficiently support many important data mining and machine learning…

Databases · Computer Science 2012-04-30 Yucheng Low , Joseph Gonzalez , Aapo Kyrola , Danny Bickson , Carlos Guestrin , Joseph M. Hellerstein