English
Related papers

Related papers: Optimal Resource Allocation for ML Model Training …

200 papers

We study the problem of forecasting the number of units fulfilled (or ``drained'') from each inventory warehouse to meet customer demand, along with the associated outbound shipping costs. The actual drain and shipping costs are determined…

Machine Learning · Computer Science 2025-07-16 Riccardo Savorgnan , Udaya Ghai , Carson Eisenach , Dean Foster

In an era defined by rapid data evolution, traditional Machine Learning (ML) models often struggle to adapt to dynamic environments. Evolving Machine Learning (EML) has emerged as a pivotal paradigm, enabling continuous learning and…

The growing demand for large-scale GPU clusters in distributed model training presents a significant barrier to innovation, particularly in model optimization, performance tuning, and system-level enhancements. To address this challenge,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-08 Sumit Kumar , Arjun Temura , Naman Sharma , Ramanjeet Singh , Meet Dadhania , Praveen Tammana , Satananda Burla , Abed Mohammad Kamaluddin , Rinku Shah

In edge intelligence systems, deep neural network (DNN) partitioning and data offloading can provide real-time task inference for resource-constrained mobile devices. However, the inference time of DNNs is typically uncertain and cannot be…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-24 Zhaojun Nan , Yunchu Han , Sheng Zhou , Zhisheng Niu

This paper investigates the optimal allocation of large language model (LLM) inference workloads across heterogeneous edge data centers over time. Each data center features on-site renewable generation and faces dynamic electricity prices…

Networking and Internet Architecture · Computer Science 2026-04-10 Jiaming Cheng , Duong Tung Nguyen

Learning control policies for multi-robot systems (MRS) remains a major challenge due to long-term coordination and the difficulty of obtaining realistic training data. In this work, we address both limitations within an imitation learning…

Robotics · Computer Science 2025-10-03 Jesús Roche , Eduardo Sebastián , Eduardo Montijano

We study continuity and robustness properties of infinite-horizon average expected cost problems with respect to (controlled) transition kernels, and applications of these results to the problem of robustness of control policies designed…

Systems and Control · Electrical Eng. & Systems 2020-12-22 Ali Devran Kara , Maxim Raginsky , Serdar Yuksel

Current techniques and systems for distributed model training mostly assume that clusters are comprised of homogeneous servers with a constant resource availability. However, cluster heterogeneity is pervasive in computing infrastructure,…

Machine Learning · Computer Science 2023-07-25 Sahil Tyagi , Prateek Sharma

We study a general model on reusable resource allocation under model uncertainty. A heterogeneous population of customers arrive at the decision maker's (DM's) platform sequentially. Upon observing a customer's type, the DM selects an…

Optimization and Control · Mathematics 2022-12-07 Xilin Zhang , Wang Chi Cheung

The emergence of data-driven machine learning (ML) has facilitated significant progress in many complicated tasks such as highly-automated driving. While much effort is put into improving the ML models and learning algorithms in such…

Computer Vision and Pattern Recognition · Computer Science 2022-06-02 Marvin Klingner , Konstantin Müller , Mona Mirzaie , Jasmin Breitenstein , Jan-Aike Termöhlen , Tim Fingscheidt

Resource-constrained systems are prevalent in communications. Such a system is composed of many components but only some of them can be allocated with resources such as time slots. According to the amount of information about the system,…

Information Theory · Computer Science 2014-04-02 Albert Y. S. Lam , Yanhui Geng , Victor O. K. Li

With the rapid development of Deep Learning, more and more applications on the cloud and edge tend to utilize large DNN (Deep Neural Network) models for improved task execution efficiency as well as decision-making quality. Due to memory…

Machine Learning · Computer Science 2024-07-02 Jingran Shen , Nikos Tziritas , Georgios Theodoropoulos

In recent years, Large Language Models (LLM) such as ChatGPT, CoPilot, and Gemini have been widely adopted in different areas. As the use of LLMs continues to grow, many efforts have focused on reducing the massive training overheads of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-30 Hayden Moore , Sirui Qi , Ninad Hogade , Dejan Milojicic , Cullen Bash , Sudeep Pasricha

Human drivers have limited and time-varying cognitive resources when making decisions in real-world traffic scenarios, which often leads to unique and stochastic behaviors that can not be explained by perfect rationality assumption, a…

Systems and Control · Electrical Eng. & Systems 2022-07-15 Mehmet Ozkan , Yao Ma

Resource-constrained robots often suffer from energy inefficiencies, underutilized computational abilities due to inadequate task allocation, and a lack of robustness in dynamic environments, all of which strongly affect their performance.…

Robotics · Computer Science 2023-10-02 Dipam Patel , Phu Pham , Kshitij Tiwari , Aniket Bera

Distributionally robust optimization (DRO) provides a framework for training machine learning models that are able to perform well on a collection of related data distributions (the "uncertainty set"). This is done by solving a min-max…

Machine Learning · Computer Science 2021-04-01 Paul Michel , Tatsunori Hashimoto , Graham Neubig

Our goal is to improve reliability of Machine Learning (ML) systems deployed in the wild. ML models perform exceedingly well when test examples are similar to train examples. However, real-world applications are required to perform on any…

Machine Learning · Computer Science 2023-03-07 Vihari Piratla

It is important to retrain a machine learning (ML) model in order to maintain its performance as the data changes over time. However, this can be costly as it usually requires processing the entire dataset again. This creates a trade-off…

Machine Learning · Computer Science 2023-10-09 Ananth Mahadevan , Michael Mathioudakis

Data stream forecasts are essential inputs for decision making at digital platforms. Machine learning algorithms are appealing candidates to produce such forecasts. Yet, digital platforms require a large-scale forecast framework that can…

Applications · Statistics 2024-01-18 Jeroen Rombouts , Ines Wilms

Emerging technologies and applications including Internet of Things (IoT), social networking, and crowd-sourcing generate large amounts of data at the network edge. Machine learning models are often built from the collected data, to enable…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-19 Shiqiang Wang , Tiffany Tuor , Theodoros Salonidis , Kin K. Leung , Christian Makaya , Ting He , Kevin Chan