English
Related papers

Related papers: Distributed and Decentralised Training: Technical …

200 papers

When training a machine learning model, it is standard procedure for the researcher to have full knowledge of both the data and model. However, this engenders a lack of trust between data owners and data scientists. Data owners are…

Cryptography and Security · Computer Science 2020-09-24 Will Abramson , Adam James Hall , Pavlos Papadopoulos , Nikolaos Pitropakis , William J Buchanan

The study of complex adaptive systems, pioneered in physics, biology, and the social sciences, offers important lessons for AI governance. Contemporary AI systems and the environments in which they operate exhibit many of the properties…

Computers and Society · Computer Science 2025-03-04 Noam Kolt , Michal Shur-Ofry , Reuven Cohen

Evaluating the safety of AI Systems is a pressing concern for organizations deploying them. In addition to the societal damage done by the lack of fairness of those systems, deployers are concerned about the legal repercussions and the…

Facing the trend of merging wireless communications and multi-access edge computing (MEC), this article studies computation offloading in the beyond fifth-generation networks. To address the technical challenges originating from the…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-17 Xianfu Chen , Celimuge Wu , Zhi Liu , Ning Zhang , Yusheng Ji

We develop and apply epistemic tests to various decentralized governance methods as well as to study the impact of participation. These tests probe the ability to reach a correct outcome when there is one. We find that partial abstention is…

Social and Information Networks · Computer Science 2025-05-08 Jeff Strnad

Due to their great performance and scalability properties neural networks have become ubiquitous building blocks of many applications. With the rise of mobile and IoT, these models now are also being increasingly applied in distributed…

Machine Learning · Computer Science 2020-03-09 Felix Sattler , Thomas Wiegand , Wojciech Samek

This paper addresses privacy protection in decentralized Artificial Intelligence (AI) using Confidential Computing (CC) within the Atoma Network, a decentralized AI platform designed for the Web3 domain. Decentralized AI distributes AI…

Cryptography and Security · Computer Science 2024-10-21 Dayeol Lee , Jorge António , Hisham Khan

The disruptive potential of AI systems roots in the emergence of big data. Yet, a significant portion is scattered and locked in data silos, leaving its potential untapped. Federated Machine Learning is a novel AI paradigm enabling the…

Artificial Intelligence · Computer Science 2023-05-02 Tobias Müller , Milena Zahn , Florian Matthes

The growth and permeation of artificial intelligence (AI) technologies across society has drawn focus to the ways in which the responsible use of these technologies can be facilitated through AI governance. Increasingly, large companies and…

Computers and Society · Computer Science 2025-10-02 James Weichert , Hoda Eldardiry

Decentralized optimization has become a standard paradigm for solving large-scale decision-making problems and training large machine learning models without centralizing data. However, this paradigm introduces new privacy and security…

Machine Learning · Computer Science 2024-08-19 Changxin Liu , Nicola Bastianello , Wei Huo , Yang Shi , Karl H. Johansson

Valuable training data is often owned by independent organizations and located in multiple data centers. Most deep learning approaches require to centralize the multi-datacenter data for performance purpose. In practice, however, it is…

Machine Learning · Computer Science 2018-10-17 Kele Xu , Haibo Mi , Dawei Feng , Huaimin Wang , Chuan Chen , Zibin Zheng , Xu Lan

Contemporary Distributed Computing Systems (DCS) such as Cloud Data Centres are large scale, complex, heterogeneous, and distributed across multiple networks and geographical boundaries. On the other hand, the Internet of Things…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-10 Shashikant Ilager , Rajeev Muralidhar , Rajkumar Buyya

Large language models (LLM) are advanced AI systems trained on extensive textual data, leveraging deep learning techniques to understand and generate human-like language. Today's LLMs with billions of parameters are so huge that hardly any…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Sheikh Azizul Hakim , Saem Hasan

Appropriately regulating artificial intelligence is an increasingly urgent and widespread policy challenge. We identify two primary, competing problem. First is a technical deficit: Legislatures and regulatory face significant challenges in…

Artificial Intelligence · Computer Science 2026-02-04 Gillian K. Hadfield , Jack Clark

Artificial intelligence (AI) is increasingly integrated into society, from financial services and traffic management to creative writing. Academic literature on the deployment of AI has mostly focused on the risks and harms that result from…

Federated Learning (FL) has emerged as a transformative paradigm in the field of distributed machine learning, enabling multiple clients such as mobile devices, edge nodes, or organizations to collaboratively train a shared global model…

Machine Learning · Computer Science 2026-03-09 Ratun Rahman

We introduce a new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes. The goal is to train a…

Machine Learning · Computer Science 2016-10-11 Jakub Konečný , H. Brendan McMahan , Daniel Ramage , Peter Richtárik

We use ideas from distributed computing and game theory to study dynamic and decentralized environments in which computational nodes, or decision makers, interact strategically and with limited information. In such environments, which arise…

Computer Science and Game Theory · Computer Science 2017-04-06 Aaron D. Jaggard , Neil Lutz , Michael Schapira , Rebecca N. Wright

Embodied AI is widely discussed as a job-displacement problem. The deeper risk, however, is governance lag: the inability of public institutions to keep pace with how fast the technology spreads through the physical economy. As reusable…

Computers and Society · Computer Science 2026-04-27 Shaoshan Liu

Trade-offs between accuracy and efficiency pervade law, public health, and other non-computing domains, which have developed policies to guide how to balance the two in conditions of uncertainty. While computer science also commonly studies…

Computers and Society · Computer Science 2021-10-05 A. Feder Cooper , Karen Levy , Christopher De Sa