English
Related papers

Related papers: Restructuring expression dags for efficient parall…

200 papers

Workloads in data processing clusters are often represented in the form of DAG (Directed Acyclic Graph) jobs. Scheduling DAG jobs is challenging. Simple heuristic scheduling algorithms are often adopted in practice in production data…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-30 Zhibo Hu , Chen Wang , Helen , Paik , Yanfeng Shu , Liming Zhu

While deep learning excels in natural image and language processing, its application to high-dimensional data faces computational challenges due to the dimensionality curse. Current large-scale data tools focus on business-oriented…

Machine Learning · Computer Science 2025-07-01 Chen Zhang

How chaos is useful in the brain information processing is greatly unknown. Here, we show that the statistical property of chaos such as invariant measures naturally organized under a great number of iterations of chaotic mappings can be…

chao-dyn · Physics 2008-02-03 Ken Umeno

We study the problem of scheduling a general computational DAG on multiple processors in a 2-level memory hierarchy. This setting is a natural generalization of several prominent models in the literature, and it simultaneously captures…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-24 Pál András Papp , Toni Böhnlein , A. N. Yzelman

With the growing complexity and capability of contemporary robotic systems, the necessity of sophisticated computing solutions to efficiently handle tasks such as real-time processing, sensor integration, decision-making, and control…

Robotics · Computer Science 2025-09-09 Md Rafid Islam

We study the problem of efficiently scheduling a computational DAG on multiple processors. The majority of previous works have developed and compared algorithms for this problem in relatively simple models; in contrast to this, we analyze…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-24 Pál András Papp , Georg Anegg , Aikaterini Karanasiou , A. N. Yzelman

Directed acyclic graph (DAG) tasks are currently adopted in the real-time domain to model complex applications from the automotive, avionics, and industrial domains that implement their functionalities through chains of intercommunicating…

Machine Learning · Computer Science 2024-01-12 Binqi Sun , Mirco Theile , Ziyuan Qin , Daniele Bernardini , Debayan Roy , Andrea Bastoni , Marco Caccamo

This article studies the problem of modifying the action ordering of a plan in order to optimise the plan according to various criteria. One of these criteria is to make a plan less constrained and the other is to minimize its parallel…

Artificial Intelligence · Computer Science 2011-05-30 C. Backstrom

Recent advances in reasoning models have demonstrated significant improvements in accuracy by employing detailed and comprehensive reasoning processes. However, generating these lengthy reasoning sequences is computationally expensive and…

Computation and Language · Computer Science 2025-08-27 Yijiong Yu

Optimization of directed acyclic graph (DAG) structures has many applications, such as neural architecture search (NAS) and probabilistic graphical model learning. Encoding DAGs into real vectors is a dominant component in most…

Machine Learning · Computer Science 2022-12-14 Zehao Dong , Muhan Zhang , Fuhai Li , Yixin Chen

As datasets grow it becomes infeasible to process them completely with a desired model. For giant datasets, we frame the order in which computation is performed as a decision problem. The order is designed so that partial computations are…

Computation · Statistics 2014-03-18 Daniel John Lawson , Niall M Adams

One typical use case of large-scale distributed computing in data centers is to decompose a computation job into many independent tasks and run them in parallel on different machines, sometimes known as the "embarrassingly parallel"…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-04-07 Da Wang , Gauri Joshi , Gregory Wornell

As numerous machine learning and other algorithms increase in complexity and data requirements, distributed computing becomes necessary to satisfy the growing computational and storage demands, because it enables parallel execution of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-21 Pei Peng , Emina Soljanin , Philip Whiting

Previous work has shown that there are two major complexity barriers in the synthesis of fault-tolerant distributed programs: (1) generation of fault-span, the set of states reachable in the presence of faults, and (2) resolving deadlock…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-12-15 Fuad Abujarad , Borzoo Bonakdarpour , Sandeep S. Kulkarni

We study the problem of scheduling an arbitrary computational DAG on a fixed number of processors while minimizing the makespan. While previous works have mostly studied this problem in fairly restricted models, we define and analyze DAG…

Computational Complexity · Computer Science 2024-07-18 Pál András Papp , Georg Anegg , A. N. Yzelman

Multiprocessor scheduling of hard real-time tasks modeled by directed acyclic graphs (DAGs) exploits the inherent parallelism presented by the model. For DAG tasks, a node represents a request to execute an object on one of the available…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-02 Corey Tessler , Venkata P. Modekurthy , Nathan Fisher , Abusayeed Saifullah

Contemporary macro energy systems modelling is characterized by the need to represent strategic and operational decisions with high temporal and spatial resolution and represent discrete investment and retirement decisions. This drive…

Optimization and Control · Mathematics 2025-10-31 Michael Lau , Filippo Pecci , Jesse D. Jenkins

Recent commercial hardware platforms for embedded real-time systems feature heterogeneous processing units and computing accelerators on the same System-on-Chip. When designing complex real-time application for such architectures, the…

Operating Systems · Computer Science 2019-01-10 Houssam-Eddine Zahaf , Nicola Capodieci , Roberto Cavicchioli , Marko Bertogna , Giuseppe Lipari

Numerically solving ordinary differential equations (ODEs) is a naturally serial process and as a result the vast majority of ODE solver software are serial. In this manuscript we developed a set of parallelized ODE solvers using…

Numerical Analysis · Mathematics 2022-09-13 Utkarsh , Chris Elrod , Yingbo Ma , Christopher Rackauckas

DAG (directed acyclic graph) tasks are widely used to model parallel real-time workload. The real-time performance of a DAG task not only depends on its total workload, but also its graph structure. Intuitively, with the same total…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-26 Qingqiang He , Nan Guan , Mingsong Lv