English
Related papers

Related papers: MLBench: How Good Are Machine Learning Clouds for …

200 papers

Despite the advancements and impressive performance of Multimodal Large Language Models (MLLMs) on benchmarks, their effectiveness in real-world, long-context, and multi-image tasks is unclear due to the benchmarks' limited scope. Existing…

Computation and Language · Computer Science 2024-05-16 Dingjie Song , Shunian Chen , Guiming Hardy Chen , Fei Yu , Xiang Wan , Benyou Wang

Machine Learning (ML) has been widely applied to cybersecurity and is considered state-of-the-art for solving many of the open issues in that field. However, it is very difficult to evaluate how good the produced solutions are, since the…

Cryptography and Security · Computer Science 2023-09-06 Fabrício Ceschin , Marcus Botacin , Albert Bifet , Bernhard Pfahringer , Luiz S. Oliveira , Heitor Murilo Gomes , André Grégio

Reliability is a fundamental challenge in operating large-scale machine learning (ML) infrastructures, particularly as the scale of ML models and training clusters continues to grow. Despite decades of research on infrastructure failures,…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-10 Apostolos Kokolis , Michael Kuchnik , John Hoffman , Adithya Kumar , Parth Malani , Faye Ma , Zachary DeVito , Shubho Sengupta , Kalyan Saladi , Carole-Jean Wu

Long-context capability is considered one of the most important abilities of LLMs, as a truly long context-capable LLM enables users to effortlessly process many originally exhausting tasks -- e.g., digesting a long-form document to find…

Computation and Language · Computer Science 2025-05-27 Wang Yang , Hongye Jin , Shaochen Zhong , Song Jiang , Qifan Wang , Vipin Chaudhary , Xiaotian Han

Cloud computing has become the ubiquitous computing and storage paradigm. It is also attractive for scientists, because they do not have to care any more for their own IT infrastructure, but can outsource it to a Cloud Service Provider of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-11 Harald Richter

Cloud services have recently started undergoing a major shift from monolithic applications, to graphs of hundreds of loosely-coupled microservices. Microservices fundamentally change a lot of assumptions current cloud systems are designed…

Recent advancements in learning-based query performance prediction models have demonstrated remarkable efficacy. However, these models are predominantly validated using synthetic datasets focused on cardinality or latency estimations. This…

Databases · Computer Science 2025-04-25 Chujun Song , Slim Bouguerra , Erik Krogen , Daniel Abadi

Over the past few years, providers such as Google, Microsoft, and Amazon have started to provide customers with access to software interfaces allowing them to easily embed machine learning tasks into their applications. Overall,…

Machine Learning · Computer Science 2020-05-20 Emiliano De Cristofaro

This research investigates how Machine Learning (ML) algorithms can assist in workload allocation strategies by detecting tasks with node affinity operators (referred to as constraint operators), which constrain their execution to a limited…

Machine Learning · Computer Science 2025-09-25 Leszek Sliwko

Machine Learning (ML) algorithms are used to train computers to perform a variety of complex tasks and improve with experience. Computers learn how to recognize patterns, make unintended decisions, or react to a dynamic environment. Certain…

Cryptography and Security · Computer Science 2013-06-20 Giuseppe Ateniese , Giovanni Felici , Luigi V. Mancini , Angelo Spognardi , Antonio Villani , Domenico Vitali

One of the most promising areas of research to obtain practical advantage is Quantum Machine Learning which was born as a result of cross-fertilisation of ideas between Quantum Computing and Classical Machine Learning. In this paper, we…

Quantum Physics · Physics 2021-11-08 N. Schetakis , D. Aghamalyan , M. Boguslavsky , P. Griffin

The area of online machine learning in big data streams covers algorithms that are (1) distributed and (2) work from data streams with only a limited possibility to store past data. The first requirement mostly concerns software…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-19 András A. Benczúr , Levente Kocsis , Róbert Pálovics

Data quality affects machine learning (ML) model performances, and data scientists spend considerable amount of time on data cleaning before model training. However, to date, there does not exist a rigorous study on how exactly cleaning…

Databases · Computer Science 2021-04-07 Peng Li , Xi Rao , Jennifer Blase , Yue Zhang , Xu Chu , Ce Zhang

In [1, 2], we have explored the theoretical aspects of feature extraction optimization processes for solving largescale problems and overcoming machine learning limitations. Majority of optimization algorithms that have been introduced in…

Machine Learning · Computer Science 2019-08-28 Farid Ghareh Mohammadi , M. Hadi Amini , Hamid R. Arabnia

Model evaluation is a critical component in supervised machine learning classification analyses. Traditional metrics do not currently incorporate case difficulty. This renders the classification results unbenchmarked for generalization.…

Machine Learning · Computer Science 2023-02-10 Adrienne Kline , Joon Lee

As machine learning (ML) is more tightly woven into society, it is imperative that we better characterize ML's strengths and limitations if we are to employ it responsibly. Existing benchmark environments for ML, such as board and video…

Machine Learning · Computer Science 2022-07-22 Eric Pulick , Shubham Bharti , Yiding Chen , Vladimir Menkov , Yonatan Mintz , Paul Kantor , Vicki M. Bier

Model merging provides a scalable alternative to multi-task training by combining specialized finetuned models through parameter arithmetic, enabling efficient deployment without the need for joint training or access to all task data. While…

Machine Learning · Computer Science 2025-10-21 Yifei He , Siqi Zeng , Yuzheng Hu , Rui Yang , Tong Zhang , Han Zhao

Cloud Computing is a new trend emerging in IT environment with huge requirements of infrastructure and resources. Load Balancing is an important aspect of cloud computing environment. Efficient load balancing scheme ensures efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-03-28 Mayanka Katyal , Atul Mishra

The binary neural network, largely saving the storage and computation, serves as a promising technique for deploying deep models on resource-limited devices. However, the binarization inevitably causes severe information loss, and even…

Neural and Evolutionary Computing · Computer Science 2020-04-08 Haotong Qin , Ruihao Gong , Xianglong Liu , Xiao Bai , Jingkuan Song , Nicu Sebe

Context: Machine Learning (ML) is integrated into a growing number of systems for various applications. Because the performance of an ML model is highly dependent on the quality of the data it has been trained on, there is a growing…

Machine Learning · Computer Science 2024-06-03 Pierre-Olivier Côté , Amin Nikanjam , Nafisa Ahmed , Dmytro Humeniuk , Foutse Khomh