English
Related papers

Related papers: Accelerating Communications in Federated Applicati…

200 papers

The last decades have seen a surge of interests in distributed computing thanks to advances in clustered computing and big data technology. Existing distributed algorithms typically assume {\it all the data are already in one place}, and…

Machine Learning · Computer Science 2019-05-07 Donghui Yan , Yingjie Wang , Jin Wang , Guodong Wu , Honggang Wang

Scaling neural network models has delivered dramatic quality gains across ML problems. However, this scaling has increased the reliance on efficient distributed training techniques. Accordingly, as with other distributed computing…

Hardware Architecture · Computer Science 2023-05-04 Suchita Pati , Shaizeen Aga , Mahzabeen Islam , Nuwan Jayasena , Matthew D. Sinclair

Exploding data volumes and velocities, new computational methods and platforms, and ubiquitous connectivity demand new approaches to computation in the sciences. These new approaches must enable computation to be mobile, so that, for…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-12 Ryan Chard , Yadu Babuji , Zhuozhao Li , Tyler Skluzacek , Anna Woodard , Ben Blaiszik , Ian Foster , Kyle Chard

Remote procedure calls are the workhorse of distributed systems. However, as software engineering trends, such as micro-services and serverless computing, push applications towards ever finer-grained decompositions, the overhead of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-11 Peter Alvaro , Matthew Adiletta , Adrian Cockroft , Frank Hady , Ramesh Illikkal , Esteban Ramos , James Tsai , Robert Soulé

Dataflow languages provide natural support for specifying constraints between objects in dynamic applications, where programs need to react efficiently to changes of their environment. Researchers have long investigated how to take…

Programming Languages · Computer Science 2011-04-13 Camil Demetrescu , Irene Finocchi , Andrea Ribichini

Problems such as equipment defects or limited viewpoints will lead the captured point clouds to be incomplete. Therefore, recovering the complete point clouds from the partial ones plays an vital role in many practical tasks, and one of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Shanshan Li , Pan Gao , Xiaoyang Tan , Mingqiang Wei

In a new effort to make our research transparent and reproducible by others, we developed a workflow to run and share computational studies on the public cloud Microsoft Azure. It uses Docker containers to create an image of the application…

Computational Engineering, Finance, and Science · Computer Science 2020-07-24 Olivier Mesnard , Lorena A. Barba

The integration of artificial intelligence capabilities into modern software systems is increasingly being simplified through the use of cloud-based machine learning services and representational state transfer architecture design. However,…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-04 Edward Verenich , Alvaro Velasquez , M. G. Sarwar Murshed , Faraz Hussain

A considerable amount of research and engineering went into designing proxy applications, which represent common high-performance computing workloads, to co-design and evaluate the current generation of supercomputers, e.g., RIKEN's…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-18 Satoshi Matsuoka , Jens Domke , Mohamed Wahib , Aleksandr Drozd , Ray Bair , Andrew A. Chien , Jeffrey S. Vetter , John Shalf

HPC and Cloud have evolved independently, specializing their innovations into performance or productivity. Acceleration as a Service (XaaS) is a recipe to empower both fields with a shared execution platform that provides transparent access…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-10 Torsten Hoefler , Marcin Copik , Pete Beckman , Andrew Jones , Ian Foster , Manish Parashar , Daniel Reed , Matthias Troyer , Thomas Schulthess , Dan Ernst , Jack Dongarra

Transformers are central to advances in artificial intelligence (AI), excelling in fields ranging from computer vision to natural language processing. Despite their success, their large parameter count and computational demands challenge…

Hardware Architecture · Computer Science 2025-03-10 Qunyou Liu , Marina Zapater , David Atienza

Function as a Service (FaaS) paradigm is becoming widespread and is envisioned as the next generation of cloud systems that mitigate the burden for programmers and cloud solution architects. However, the FaaS abstraction only makes the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-07 Pawissanutt Lertpongrujikorn , Mohsen Amini Salehi

Service mesh is a fundamental technology for building cloud-native applications, which ensures the stable running of a large number of services by an intermediate layer that governs communication between services. However, service mesh is…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-05 Ming Li , Wenyan Lu , Hanyue Lin , Jingya Wu , Yu Zhang , Guihai Yan

Serverless computing has emerged as a promising alternative to infrastructure- (IaaS) and platform-as-a-service (PaaS)cloud platforms for applications with ample parallelism and intermittent activity. Serverless promises greater resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-03 Shannon Joyner , Michael MacCoss , Christina Delimitrou , Hakim Weatherspoon

The Distributed object computing is a paradigm that allows objects to be distributed across a heterogeneous network, and allows each of the components to interoperate as a unified whole. A new generation of distributed applications, such as…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-02-18 Usha Batra , Deepak Dahiya , Sachin Bhardwaj

In the present-day, distributed applications are commonly spread across multiple datacenters, reaching out to edge and fog computing locations. The transition away from single datacenter hosting is driven by capacity constraints in…

Networking and Internet Architecture · Computer Science 2024-06-19 Berta Serracanta , Alberto Rodriguez-Natal , Fabio Maino , Albert Cabellos

With the introduction of various hardware/software technologies such as Cloud Technologies or Virtualization technologies, there has been a great potential to reuse ICT artifacts thanks to Abstraction and also Exchangeability features…

Networking and Internet Architecture · Computer Science 2016-09-05 Reza Farrahi Moghaddam , Yves Lemieux , Mohamed Cheriet

Modern applications commonly need to manage dataset types composed of heterogeneous data and schemas, making it difficult to access them in an integrated way. A single data store to manage heterogeneous data using a common data model is not…

Multicore parallel programming has some very difficult problems such as deadlocks during synchronizations and race conditions brought by concurrency. Added to the difficulty is the lack of a simple, well-accepted computing model for…

Programming Languages · Computer Science 2010-12-09 Yibing Wang

Applications that fuse machine learning and simulation can benefit from the use of multiple computing resources, with, for example, simulation codes running on highly parallel supercomputers and AI training and inference tasks on…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-04 Logan Ward , J. Gregory Pauloski , Valerie Hayot-Sasson , Ryan Chard , Yadu Babuji , Ganesh Sivaraman , Sutanay Choudhury , Kyle Chard , Rajeev Thakur , Ian Foster