中文
相关论文

相关论文: The Case for Task Sampling based Learning for Clus…

200 篇论文

We consider learning a predictive model to be subsequently used for a given downstream task (described by an algorithm) that requires access to the model evaluation. This task need not be prediction, and this situation is frequently…

机器学习 · 计算机科学 2025-06-05 Jianyuan Yin , Qianxiao Li

Nowadays large-scale distributed machine learning systems have been deployed to support various analytics and intelligence services in IT firms. To train a large dataset and derive the prediction/inference model, e.g., a deep neural…

分布式、并行与集群计算 · 计算机科学 2018-01-04 Yixin Bao , Yanghua Peng , Chuan Wu , Zongpeng Li

We introduce an adaptive scheduling for adaptive sampling as a novel way of machine learning in the construction of part-of-speech taggers. The goal is to speed up the training on large data sets, without significant loss of performance…

计算与语言 · 计算机科学 2024-02-06 Manuel Vilares Ferro , Victor M. Darriba Bilbao , Jesús Vilares Ferro

Infrastructure as a service clouds hide the complexity of maintaining the physical infrastructure with a slight disadvantage: they also hide their internal working details. Should users need knowledge about these details e.g., to increase…

分布式、并行与集群计算 · 计算机科学 2018-03-20 Gabor Kecskemeti , Zsolt Nemeth , Attila Kertesz , Rajiv Ranjan

Task-based programming models are emerging as a promising alternative to make the most of multi-/many-core systems. These programming models rely on runtime systems, and their goal is to improve application performance by properly…

分布式、并行与集群计算 · 计算机科学 2020-09-24 Antoni Navarro , Arthur F. Lorenzon , Eduard Ayguadé , Vicenç Beltran

Robot skills systems are meant to reduce robot setup time for new manufacturing tasks. Yet, for dexterous, contact-rich tasks, it is often difficult to find the right skill parameters. One strategy is to learn these parameters by allowing…

机器人学 · 计算机科学 2022-08-03 Matthias Mayr , Carl Hvarfner , Konstantinos Chatzilygeroudis , Luigi Nardi , Volker Krueger

This study presents a novel computer system performance optimization and adaptive workload management scheduling algorithm based on Q-learning. In modern computing environments, characterized by increasing data volumes, task complexity, and…

机器学习 · 计算机科学 2024-11-11 Pochun Li , Yuyang Xiao , Jinghua Yan , Xuan Li , Xiaoye Wang

We present a machine learning framework and a new test bed for data mining from the Slurm Workload Manager for high-performance computing (HPC) clusters. The focus was to find a method for selecting features to support decisions: helping…

机器学习 · 计算机科学 2020-12-16 Adedolapo Okanlawon , Huichen Yang , Avishek Bose , William Hsu , Dan Andresen , Mohammed Tanash

Distributed data processing systems like MapReduce, Spark, and Flink are popular tools for analysis of large datasets with cluster resources. Yet, users often overprovision resources for their data processing jobs, while the resource usage…

分布式、并行与集群计算 · 计算机科学 2021-02-16 Lauritz Thamsen , Ilya Verbitskiy , Sasho Nedelkoski , Vinh Thuy Tran , Vinicius Meyer , Miguel G. Xavier , Odej Kao , Cesar A. F. De Rose

Constructing good representations is critical for learning complex tasks in a sample efficient manner. In the context of meta-learning, representations can be constructed from common patterns of previously seen tasks so that a future task…

机器学习 · 计算机科学 2021-03-02 Halil Ibrahim Gulluk , Yue Sun , Samet Oymak , Maryam Fazel

Large, pre-trained models are problematic to use in resource constrained applications. Fortunately, task-aware structured pruning methods offer a solution. These approaches reduce model size by dropping structural units like layers and…

计算与语言 · 计算机科学 2023-11-14 Lucio Dery , David Grangier , Awni Hannun

A smart city improves operational efficiency and comfort of living by harnessing techniques such as the Internet of Things (IoT) to collect and process data for decision making. To better support smart cities, data collected by IoT should…

网络与互联网体系结构 · 计算机科学 2021-06-10 Laha Ale , Ning Zhang , Scott A. King , Jose Guardiola

Humans learn adaptively and efficiently throughout their lives. However, incrementally learning tasks causes artificial neural networks to overwrite relevant information learned about older tasks, resulting in 'Catastrophic Forgetting'.…

机器学习 · 计算机科学 2021-02-04 Gobinda Saha , Isha Garg , Aayush Ankit , Kaushik Roy

In multi-task learning (MTL), we improve the performance of key machine learning algorithms by training various tasks jointly. When the number of tasks is large, modeling task structure can further refine the task relationship model. For…

机器学习 · 计算机科学 2020-11-25 Xiangyu Niu , Yifan Sun , Jinyuan Sun

Reservoir computing is a machine learning paradigm that uses a structure called a reservoir, which has nonlinearities and short-term memory. In recent years, reservoir computing has expanded to new functions such as the autonomous…

机器学习 · 计算机科学 2023-07-05 Kohei Tsuchiyama , André Röhm , Takatomo Mihana , Ryoichi Horisaki , Makoto Naruse

Allocating resources to distributed machine learning jobs in multi-tenant torus-topology clusters must meet each job's specific placement and communication requirements, which are typically described using shapes. There is an inherent…

分布式、并行与集群计算 · 计算机科学 2025-10-07 Shawn Shuoshuo Chen , Daiyaan Arfeen , Minlan Yu , Peter Steenkiste , Srinivasan Seshan

It is well known that size-based scheduling policies, which take into account job size (i.e., the time it takes to run them), can perform very desirably in terms of both response time and fairness. Unfortunately, the requirement of knowing…

性能 · 计算机科学 2019-07-11 Matteo Dell'Amico

Runtime variability in computing systems causes some tasks to straggle and take much longer than expected to complete. These straggler tasks are known to significantly slowdown distributed computation. Job execution with speculative…

性能 · 计算机科学 2019-06-14 Mehmet Fatih Aktas , Emina Soljanin

Cloud computing is a newly emerging distributed computing which is evolved from Grid computing. Task scheduling is the core research of cloud computing which studies how to allocate the tasks among the physical nodes so that the tasks can…

分布式、并行与集群计算 · 计算机科学 2014-04-21 Kai Li , Yong Wang , Meilin Liu

In the rapidly expanding field of parallel processing, job schedulers are the "operating systems" of modern big data architectures and supercomputing systems. Job schedulers allocate computing resources and control the execution of…