English
Related papers

Related papers: TF.Learn: TensorFlow's High-level Module for Distr…

200 papers

Over the past decade, machine learning model complexity has grown at an extraordinary rate, as has the scale of the systems training such large models. However there is an alarmingly low hardware utilization (5-20%) in large scale AI…

Hardware Architecture · Computer Science 2022-11-14 Newsha Ardalani , Saptadeep Pal , Puneet Gupta

Federated learning has been a hot research topic in enabling the collaborative training of machine learning models among different organizations under the privacy restrictions. As researchers try to support more machine learning models with…

Machine Learning · Computer Science 2021-12-07 Qinbin Li , Zeyi Wen , Zhaomin Wu , Sixu Hu , Naibo Wang , Yuan Li , Xu Liu , Bingsheng He

Federated learning (FL) is a novel distributed machine learning paradigm that enables participants to collaboratively train a centralized model with privacy preservation by eliminating the requirement of data sharing. In practice, FL often…

Machine Learning · Computer Science 2024-03-05 Wei Guo , Fuzhen Zhuang , Xiao Zhang , Yiqi Tong , Jin Dong

Deep Learning (DL) algorithms have become the {\em de facto} choice for data analysis. Several DL implementations -- primarily limited to a single compute node -- such as Caffe, TensorFlow, Theano and Torch have become readily available.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-18 Abhinav Vishnu , Joseph Manzano , Charles Siegel , Jeff Daily

Federated learning (FL) refers to a distributed machine learning framework involving learning from several decentralized edge clients without sharing local dataset. This distributed strategy prevents data leakage and enables on-device…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-28 Taki Hasan Rafi , Faiza Anan Noor , Tahmid Hussain , Dong-Kyu Chae , Zhaohui Yang

TensorFlow is a popular cloud computing framework that targets machine learning applications. It separates the specification of application logic (in a dataflow graph) from the execution of the logic. TensorFlow's native runtime executes…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-27 Sam Whitlock , James Larus , Edouard Bugnion

Machine learning techniques are becoming a fundamental tool for scientific and engineering progress. These techniques are applied in contexts as diverse as astronomy and spam filtering. However, correctly applying these techniques requires…

Federated learning (FL) is a distributed machine learning paradigm enabling collaborative model training while preserving data privacy. In today's landscape, where most data is proprietary, confidential, and distributed, FL has become a…

Machine Learning · Computer Science 2025-03-11 Zilinghan Li , Shilan He , Ze Yang , Minseok Ryu , Kibaek Kim , Ravi Madduri

Federated Learning (FL) is a method of training machine learning models on private data distributed over a large number of possibly heterogeneous clients such as mobile phones and IoT devices. In this work, we propose a new federated…

Machine Learning · Computer Science 2021-12-15 Enmao Diao , Jie Ding , Vahid Tarokh

Academia and industry have developed several platforms to support the popular privacy-preserving distributed learning method -- Federated Learning (FL). However, these platforms are complex to use and require a deep understanding of FL,…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-21 Weiming Zhuang , Xin Gan , Yonggang Wen , Shuai Zhang

Federated machine learning is a versatile and flexible tool to utilize distributed data from different sources, especially when communication technology develops rapidly and an unprecedented amount of data could be collected on mobile…

Machine Learning · Computer Science 2024-03-12 Tianyi Zhang , Shirui Zhang , Ziwei Chen , Dianbo Liu

We present a framework for experimenting with secure multi-party computation directly in TensorFlow. By doing so we benefit from several properties valuable to both researchers and practitioners, including tight integration with ordinary…

Cryptography and Security · Computer Science 2018-10-24 Morten Dahl , Jason Mancuso , Yann Dupis , Ben Decoste , Morgan Giraud , Ian Livingstone , Justin Patriquin , Gavin Uhma

Federated learning (FL) is a machine learning paradigm in which distributed local nodes collaboratively train a central model without sharing individually held private data. Existing FL methods either iteratively share local model…

Machine Learning · Computer Science 2023-12-25 Xuan Gong , Shanglin Li , Yuxiang Bao , Barry Yao , Yawen Huang , Ziyan Wu , Baochang Zhang , Yefeng Zheng , David Doermann

Scikit-learn is an increasingly popular machine learning li- brary. Written in Python, it is designed to be simple and efficient, accessible to non-experts, and reusable in various contexts. In this paper, we present and discuss our design…

Federated Learning (FL) allows collaborative model training among distributed parties without pooling local datasets at a central server. However, the distributed nature of FL poses challenges in training fair federated learning models. The…

Machine Learning · Computer Science 2025-01-28 Yi Zhou , Naman Goel

Federated Learning (FL) enables distributed machine learning training while preserving privacy, representing a paradigm shift for data-sensitive and decentralized environments. Despite its rapid advancements, FL remains a complex and…

Machine Learning · Computer Science 2025-05-14 Frederico Vicente , Cláudia Soares , Dušan Jakovetić

State-of-the-art deep learning systems such as TensorFlow and PyTorch tightly couple the model with the underlying hardware. This coupling requires the user to modify application logic in order to run the same job across a different set of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-13 Andrew Or , Haoyu Zhang , Michael J. Freedman

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

TF Boosted Trees (TFBT) is a new open-sourced frame-work for the distributed training of gradient boosted trees. It is based on TensorFlow, and its distinguishing features include a novel architecture, automatic loss differentiation,…

Tensor Train decomposition is used across many branches of machine learning. We present T3F -- a library for Tensor Train decomposition based on TensorFlow. T3F supports GPU execution, batch processing, automatic differentiation, and…

Mathematical Software · Computer Science 2020-03-04 Alexander Novikov , Pavel Izmailov , Valentin Khrulkov , Michael Figurnov , Ivan Oseledets