English

Transparent Synchronous Dataflow

Programming Languages 2021-03-03 v2
Authors: Steven W. T. Cheung , Dan R. Ghica , Koko Muroya
View on arXiv ↗ PDF ↗ DOI ↗

Abstract

Dataflow programming is a popular and convenient programming paradigm in systems modelling, optimisation, and machine learning. It has a number of advantages, for instance the lacks of control flow allows computation to be carried out in parallel as well as in distributed machines. More recently the idea of dataflow graphs has also been brought into the design of various deep learning frameworks. They facilitate an easy and efficient implementation of automatic differentiation, which is the heart of modern deep learning paradigm. [abstract abridged]

Keywords

flow matching optical flow data processing

Cite

@article{arxiv.1910.09579,
  title  = {Transparent Synchronous Dataflow},
  author = {Steven W. T. Cheung and Dan R. Ghica and Koko Muroya},
  journal= {arXiv preprint arXiv:1910.09579},
  year   = {2021}
}

Related papers

View all related →
Programming Languages · Computer Science
Almost Continuous Transformations of Software and Higher-order Dataflow Programming
Michael Bukatin, Steve Matthews
2016-01-06
Distributed, Parallel, and Cluster Computing · Computer Science
TensorFlow: A system for large-scale machine learning
Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen +18
2016-06-01
Distributed, Parallel, and Cluster Computing · Computer Science
Dynamic Control Flow in Large-Scale Machine Learning
Yuan Yu, Martín Abadi, Paul Barham, Eugene Brevdo +11
2018-05-09
Programming Languages · Computer Science
Programming Patterns in Dataflow Matrix Machines and Generalized Recurrent Neural Nets
Michael Bukatin, Steve Matthews, Andrey Radul
2018-08-07
Distributed, Parallel, and Cluster Computing · Computer Science
A Comparison of Big Data Frameworks on a Layered Dataflow Model
Claudia Misale, Maurizio Drocco, Marco Aldinucci, Guy Tremblay
2016-06-17
Distributed, Parallel, and Cluster Computing · Computer Science
Taskflow: A Lightweight Parallel and Heterogeneous Task Graph Computing System
Tsung-Wei Huang, Dian-Lun Lin, Chun-Xun Lin, Yibo Lin
2021-09-08
Neural and Evolutionary Computing · Computer Science
Dataflow Matrix Machines as a Generalization of Recurrent Neural Networks
Michael Bukatin, Steve Matthews, Andrey Radul
2018-05-29
Neural and Evolutionary Computing · Computer Science
Dataflow matrix machines as programmable, dynamically expandable, self-referential generalized recurrent neural networks
Michael Bukatin, Steve Matthews, Andrey Radul
2018-06-22
Machine Learning · Computer Science
Causify DataFlow: A Framework For High-performance Machine Learning Stream Computing
Giacinto Paolo Saggese, Paul Smith
2026-01-01
Distributed, Parallel, and Cluster Computing · Computer Science
FastFlow tutorial
Marco Aldinucci, Marco Danelutto, Massimo Torquati
2012-04-25
Distributed, Parallel, and Cluster Computing · Computer Science
Pipeflow: An Efficient Task-Parallel Pipeline Programming Framework using Modern C++
Cheng-Hsiang Chiu, Tsung-Wei Huang, Zizheng Guo, Yibo Lin
2022-02-03
Databases · Computer Science
Spinning Fast Iterative Data Flows
Stephan Ewen, Kostas Tzoumas, Moritz Kaufmann, Volker Markl
2012-08-02
Distributed, Parallel, and Cluster Computing · Computer Science
A Framework for Computing on Large Dynamic Graphs
Zhao Yu Dong
2015-12-08
Programming Languages · Computer Science
Recursive Function Definitions in Static Dataflow Graphs and their Implementation in TensorFlow
Kelly Kostopoulou, Angelos Charalambidis, Panos Rondogiannis
2024-10-29
Programming Languages · Computer Science
Scaling Inter-procedural Dataflow Analysis on the Cloud
Zewen Sun, Yujin Zhang, Duanchen Xu, Yiyu Zhang +10
2024-12-18
Programming Languages · Computer Science
Dataflow Graphs as Matrices and Programming with Higher-order Matrix Elements
Michael Bukatin, Steve Matthews
2016-01-12
Distributed, Parallel, and Cluster Computing · Computer Science
DynaFlow: Transparent and Flexible Intra-Device Parallelism via Programmable Operator Scheduling
Yi Pan, Yile Gu, Jinbin Luo, Yibo Wu +6
2026-05-22
Distributed, Parallel, and Cluster Computing · Computer Science
Exploring the Equivalence between Dynamic Dataflow Model and Gamma - General Abstract Model for Multiset mAnipulation
Rui R. Mello Junior, Leandro S. Araujo, Tiago A. O. Alves, Leandro A. J. Marzulo +2
2018-11-05
Programming Languages · Computer Science
Foundations of Total Functional Data-Flow Programming
Baltasar Trancón y Widemann, Markus Lepper
2014-06-10
Programming Languages · Computer Science
Stateful Dataflow Multigraphs: A Data-Centric Model for Performance Portability on Heterogeneous Architectures
Tal Ben-Nun, Johannes de Fine Licht, Alexandros Nikolaos Ziogas, Timo Schneider +1
2020-01-06
Distributed, Parallel, and Cluster Computing · Computer Science
Streaming Task Graph Scheduling for Dataflow Architectures
Tiziano De Matteis, Lukas Gianinazzi, Johannes de Fine Licht, Torsten Hoefler
2023-06-06
Machine Learning · Computer Science
DataFlow: An LLM-Driven Framework for Unified Data Preparation and Workflow Automation in the Era of Data-Centric AI
Hao Liang, Xiaochen Ma, Zhou Liu, Zhen Hao Wong +31
2025-12-19
Distributed, Parallel, and Cluster Computing · Computer Science
Labyrinth: Compiling Imperative Control Flow to Parallel Dataflows
Gábor E. Gévay, Tilmann Rabl, Sebastian Breß, Loránd Madai-Tahy +1
2018-10-16
Computation and Language · Computer Science
General-purpose Dataflow Model with Neuromorphic Primitives
Weihao Zhang, Yu Du, Hongyi Li, Songchen Ma +1
2024-08-05
Distributed, Parallel, and Cluster Computing · Computer Science
DataFlower: Exploiting the Data-flow Paradigm for Serverless Workflow Orchestration
Zijun Li, Chuhao Xu, Quan Chen, Jieru Zhao +2
2023-05-01