English
Related papers

Related papers: TFLMS: Large Model Support in TensorFlow by Graph …

200 papers

Training large transformer models is one of the most important computational challenges of modern AI. In this paper, we show how to significantly accelerate training of large transformer models by reducing activation recomputation.…

Machine Learning · Computer Science 2022-05-12 Vijay Korthikanti , Jared Casper , Sangkug Lym , Lawrence McAfee , Michael Andersch , Mohammad Shoeybi , Bryan Catanzaro

We introduce tf_geometric, an efficient and friendly library for graph deep learning, which is compatible with both TensorFlow 1.x and 2.x. tf_geometric provides kernel libraries for building Graph Neural Networks (GNNs) as well as…

Machine Learning · Computer Science 2021-01-28 Jun Hu , Shengsheng Qian , Quan Fang , Youze Wang , Quan Zhao , Huaiwen Zhang , Changsheng Xu

This paper presents a framework that supports the implementation of parallel solutions for the widespread parametric maximum flow computational routines used in image segmentation algorithms. The framework is based on supergraphs, a special…

Computer Vision and Pattern Recognition · Computer Science 2015-12-08 Vlad Olaru , Mihai Florea , Cristian Sminchisescu

Training neural networks to perform different tasks is relevant across various disciplines. In particular, Recurrent Neural Networks (RNNs) are of great interest in Computational Neuroscience. Open-source frameworks dedicated to Machine…

Machine Learning · Computer Science 2023-08-01 Cecilia Jarne

We use TensorNetwork [C. Roberts et al., arXiv: 1905.01330], a recently developed API for performing tensor network contractions using accelerated backends such as TensorFlow, to implement an optimization algorithm for the Multi-scale…

Computational Physics · Physics 2019-07-01 Martin Ganahl , Ashley Milsted , Stefan Leichenauer , Jack Hidary , Guifre Vidal

Greedy layer-wise or module-wise training of neural networks is compelling in constrained and on-device settings where memory is limited, as it circumvents a number of problems of end-to-end back-propagation. However, it suffers from a…

Machine Learning · Computer Science 2023-10-06 Skander Karkar , Ibrahim Ayed , Emmanuel de Bézenac , Patrick Gallinari

Training neural network often uses a machine learning framework such as TensorFlow and Caffe2. These frameworks employ a dataflow model where the NN training is modeled as a directed graph composed of a set of nodes. Operations in neural…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-20 Jiawen Liu , Dong Li , Gokcen Kestor , Jeffrey Vetter

While large neural networks demonstrate higher performance in various tasks, training large networks is difficult due to limitations on GPU memory size. We propose a novel out-of-core algorithm that enables faster training of extremely…

Machine Learning · Computer Science 2020-10-28 Akio Hayakawa , Takuya Narihira

TensorFlow is a popular cloud computing framework that targets machine learning applications. It separates the specification of application logic (in a dataflow graph) from the execution of the logic. TensorFlow's native runtime executes…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-27 Sam Whitlock , James Larus , Edouard Bugnion

Building efficient and effective generative models for neural network weights has been a research focus of significant interest that faces challenges posed by the high-dimensional weight spaces of modern neural networks and their…

Machine Learning · Computer Science 2026-05-01 Saumya Gupta , Scott Biggs , Moritz Laber , Zohair Shafi , Robin Walters , Ayan Paul

Large language models (LLMs) are increasingly being deployed on mobile devices, but the limited DRAM capacity constrains the deployable model size. This paper introduces ActiveFlow, the first LLM inference framework that can achieve…

Machine Learning · Computer Science 2025-09-24 Fucheng Jia , Zewen Wu , Shiqi Jiang , Huiqiang Jiang , Qianxi Zhang , Yuqing Yang , Yunxin Liu , Ju Ren , Deyu Zhang , Ting Cao

Graphs are a representation of structured data that captures the relationships between sets of objects. With the ubiquity of available network data, there is increasing industrial and academic need to quickly analyze graphs with billions of…

Machine Learning · Computer Science 2023-07-28 Brandon Mayer , Anton Tsitsulin , Hendrik Fichtenberger , Jonathan Halcrow , Bryan Perozzi

Large Language Models (LLMs) have demonstrated profound impact on Natural Language Processing (NLP) tasks. However, their effective deployment across diverse domains often require domain-specific adaptation strategies, as generic models may…

Artificial Intelligence · Computer Science 2025-10-15 Jingyi Wang , Hongyuan Zhu , Ye Niu , Yunhui Deng

Tensor Train decomposition is used across many branches of machine learning. We present T3F -- a library for Tensor Train decomposition based on TensorFlow. T3F supports GPU execution, batch processing, automatic differentiation, and…

Mathematical Software · Computer Science 2020-03-04 Alexander Novikov , Pavel Izmailov , Valentin Khrulkov , Michael Figurnov , Ivan Oseledets

We introduce graph normalizing flows: a new, reversible graph neural network model for prediction and generation. On supervised tasks, graph normalizing flows perform similarly to message passing neural networks, but at a significantly…

Machine Learning · Computer Science 2019-05-31 Jenny Liu , Aviral Kumar , Jimmy Ba , Jamie Kiros , Kevin Swersky

Graphs are omnipresent and GNNs are a powerful family of neural networks for learning over graphs. Despite their popularity, scaling GNNs either by deepening or widening suffers from prevalent issues of unhealthy gradients,…

Machine Learning · Computer Science 2023-08-25 Ajay Jaiswal , Shiwei Liu , Tianlong Chen , Ying Ding , Zhangyang Wang

In this paper, we propose a novel tensor graph convolutional neural network (TGCNN) to conduct convolution on factorizable graphs, for which here two types of problems are focused, one is sequential dynamic graphs and the other is…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Tong Zhang , Wenming Zheng , Zhen Cui , Yang Li

Many state-of-the-art Deep Neural Networks (DNNs) have substantial memory requirements. Limited device memory becomes a bottleneck when training those models. We propose ParDNN, an automatic, generic, and non-intrusive partitioning strategy…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-06 Fareed Qararyah , Mohamed Wahib , Doğa Dikbayır , Mehmet Esat Belviranli , Didem Unat

In the management of computer network systems, the service function chaining (SFC) modules play an important role by generating efficient paths for network traffic through physical servers with virtualized network functions (VNF). To…

Artificial Intelligence · Computer Science 2020-11-18 DongNyeong Heo , Doyoung Lee , Hee-Gon Kim , Suhyun Park , Heeyoul Choi

Large Language Models (LLMs) have fundamentally altered how we approach scaling in machine learning. However, these models pose substantial computational and memory challenges, primarily due to the reliance on matrix multiplication (MatMul)…