English
Related papers

Related papers: An Open-Source Project for MapReduce Performance S…

200 papers

MapReduce has emerged as a popular method to process big data. In the past few years, however, not just big data, but fast data has also exploded in volume and availability. Examples of such data include sensor data streams, the Twitter…

Databases · Computer Science 2012-08-22 Wang Lam , Lu Liu , STS Prasad , Anand Rajaraman , Zoheb Vacheri , AnHai Doan

Scientific software applications are increasingly developed by large interdiscplinary teams operating on functional modules organized around a common software framework, which is capable of integrating new functional capabilities without…

Performance · Computer Science 2013-09-10 Azamat Mametjanov , Boyana Norris

As we enter the exascale computing era, efficiently utilizing power and optimizing the performance of scientific applications under power and energy constraints has become critical and challenging. We propose a low-overhead autotuning…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-30 Xingfu Wu , Prasanna Balaprakash , Michael Kruse , Jaehoon Koo , Brice Videau , Paul Hovland , Valerie Taylor , Brad Geltz , Siddhartha Jana , Mary Hall

Parameter Efficient Finetuning (PEFT) has emerged as a viable solution for improving the performance of Large Language Models (LLMs) without requiring massive resources and compute. Prior work on multilingual evaluation has shown that there…

Computation and Language · Computer Science 2024-07-23 Divyanshu Aggarwal , Ashutosh Sathe , Ishaan Watts , Sunayana Sitaram

This paper presents a systematic overview of parameter-efficient fine-tuning methods, covering over 50 papers published between early 2019 and mid-2024. These methods aim to address the challenges of fine-tuning large language models by…

Computation and Language · Computer Science 2024-11-25 Vladislav Lialin , Vijeta Deshpande , Xiaowei Yao , Anna Rumshisky

Recently, businesses have started using MapReduce as a popular computation framework for processing large amount of data, such as spam detection, and different data mining tasks, in both public and private clouds. Two of the challenging…

Distributed, Parallel, and Cluster Computing · Computer Science 2012-07-30 Nikzad Babaii Rizvandi , Javid Taheri , Reza Moraveji , Albert Y. Zomaya

Applications' performance is influenced by the mapping of processes to computing nodes, the frequency and volume of exchanges among processing elements, the network capacity, and the routing protocol. A poor mapping of application processes…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-11 Jonas H. Müller Korndörfer , Mario Bielert , Laércio L. Pilla , Florina M. Ciorba

The efficiency of MapReduce is closely related to its load balance. Existing works on MapReduce load balance focus on coarse-grained scheduling. This study concerns fine-grained scheduling on MapReduce operations, with each operation…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-06-17 Liya Fan , Bo Gao , Fa Zhang , Zhiyong Liu

The performance of many algorithms in the fields of hard combinatorial problem solving, machine learning or AI in general depends on tuned hyperparameter configurations. Automated methods have been proposed to alleviate users from the…

Machine Learning · Computer Science 2019-08-23 André Biedenkapp , H. Furkan Bozkurt , Frank Hutter , Marius Lindauer

Distributed processing frameworks, such as MapReduce, Hadoop, and Spark are popular systems for processing large amounts of data. The design of efficient algorithms in these frameworks is a challenging problem, as the systems both require…

Data Structures and Algorithms · Computer Science 2019-05-07 MohammadTaghi Hajiaghayi , Silvio Lattanzi , Saeed Seddighin , Cliff Stein

Transitioning cloud-based Hadoop from IaaS to PaaS, which are commercially conceptualized as pay-as-you-go or pay-per-use, often reduces the associated system costs. However, managed Hadoop systems do present a black-box behavior to the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-21 Uluer Emre Ozdil , Serkan Ayvaz

Nowadays, GPU accelerators are commonly used to speed up general-purpose computing tasks on a variety of hardware. However, due to the diversity of GPU architectures and processed data, optimization of codes for a particular type of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-20 Jiří Filipovič , Jana Hozzová , Amin Nezarat , Jaroslav Oľha , Filip Petrovič

The ever-growing demand and complexity of machine learning are putting pressure on hyper-parameter tuning systems: while the evaluation cost of models continues to increase, the scalability of state-of-the-arts starts to become a crucial…

Machine Learning · Computer Science 2022-01-19 Yang Li , Yu Shen , Huaijun Jiang , Wentao Zhang , Jixiang Li , Ji Liu , Ce Zhang , Bin Cui

Parameter-efficient transfer learning (PETL) based on large-scale pre-trained foundation models has achieved great success in various downstream applications. Existing tuning methods, such as prompt, prefix, and adapter, perform…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zeyinzi Jiang , Chaojie Mao , Ziyuan Huang , Yiliang Lv , Deli Zhao , Jingren Zhou

The distributed data analytic system -- Spark is a common choice for processing massive volumes of heterogeneous data, while it is challenging to tune its parameters to achieve high performance. Recent studies try to employ auto-tuning…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Yang Li , Huaijun Jiang , Yu Shen , Yide Fang , Xiaofeng Yang , Danqing Huang , Xinyi Zhang , Wentao Zhang , Ce Zhang , Peng Chen , Bin Cui

We have developed several autotuning benchmarks in CUDA that take into account performance-relevant source-code parameters and reach near peak-performance on various GPU architectures. We have used them during the development and evaluation…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-11 Jiří Filipovič , Jana Hozzová , Amin Nezarat , Jaroslav Oľha , Filip Petrovič

Tuning a database system to achieve optimal performance on a given workload is a long-standing problem in the database community. A number of recent works have leveraged ML-based approaches to guide the sampling of large parameter spaces…

Machine learning applications often require hyperparameter tuning. The hyperparameters usually drive both the efficiency of the model training process and the resulting model quality. For hyperparameter tuning, machine learning algorithms…

Machine Learning · Computer Science 2018-08-06 Patrick Koch , Oleg Golovidov , Steven Gardner , Brett Wujek , Joshua Griffin , Yan Xu

The performance of an algorithm often critically depends on its parameter configuration. While a variety of automated algorithm configuration methods have been proposed to relieve users from the tedious and error-prone task of manually…

Artificial Intelligence · Computer Science 2022-05-30 Steven Adriaensen , André Biedenkapp , Gresa Shala , Noor Awad , Theresa Eimer , Marius Lindauer , Frank Hutter

Most large web-scale applications are now built by composing collections (from a few up to 100s or 1000s) of microservices. Operators need to decide how many resources are allocated to each microservice, and these allocations can have a…

Performance · Computer Science 2021-06-30 Michael Alan Chang , Aurojit Panda , Hantao Wang , Yuancheng Tsai , Rahul Balakrishnan , Scott Shenker