English
Related papers

Related papers: Reasonable Scale Machine Learning with Open-Source…

200 papers

Machine Learning (ML) has been successfully applied to a wide range of domains and applications. One of the techniques behind most of these successful applications is Ensemble Learning (EL), the field of ML that gave birth to methods such…

Machine Learning · Statistics 2017-06-29 Fábio Pinto , Vítor Cerqueira , Carlos Soares , João Mendes-Moreira

Machine learning (ML) components are being added to more and more critical and impactful software systems, but the software development process of real-world production systems from prototyped ML models remains challenging with additional…

Software Engineering · Computer Science 2024-05-07 Jie JW Wu

Powerful machine learning (ML) models are now readily available online, which creates exciting possibilities for users who lack the deep technical expertise or substantial computing resources needed to develop them. On the other hand, this…

Machine Learning · Computer Science 2025-05-30 Sarah Meiklejohn , Hayden Blauzvern , Mihai Maruseac , Spencer Schrock , Laurent Simon , Ilia Shumailov

Accurate prediction of resource consumption and runtime for cloud workflow jobs is critical for scheduling efficiency, yet remains challenging due to the semi-structured nature of job configurations -- comprising shell commands,…

Machine Learning · Computer Science 2026-05-18 Yuxuan Yin , Shengke Zhou , Yunjie Zhang , Ajay Mohindra , Boxun Xu , Peng Li

As machine learning (ML) and artificial intelligence (AI) technologies become more widespread, concerns about their environmental impact are increasing due to the resource-intensive nature of training and inference processes. Green AI…

Software Engineering · Computer Science 2025-01-06 Vincenzo De Martino , Silverio Martínez-Fernández , Fabio Palomba

Large Language Models (LLMs) have demonstrated profound impact on Natural Language Processing (NLP) tasks. However, their effective deployment across diverse domains often require domain-specific adaptation strategies, as generic models may…

Artificial Intelligence · Computer Science 2025-10-15 Jingyi Wang , Hongyuan Zhu , Ye Niu , Yunhui Deng

To address the challenges associated with data processing at scale, we propose Dataverse, a unified open-source Extract-Transform-Load (ETL) pipeline for large language models (LLMs) with a user-friendly design at its core. Easy addition of…

Computation and Language · Computer Science 2025-03-05 Hyunbyung Park , Sukyung Lee , Gyoungjin Gim , Yungi Kim , Dahyun Kim , Chanjun Park

Motivation: Building and iterating machine learning models is often a resource-intensive process. In biomedical research, scientific codebases can lack scalability and are not easily transferable to work beyond what they were intended.…

Machine Learning · Computer Science 2025-04-03 Khoa A. Tran , John V. Pearson , Nicola Waddell

Interpretable machine learning has exploded as an area of interest over the last decade, sparked by the rise of increasingly large datasets and deep neural networks. Simultaneously, large language models (LLMs) have demonstrated remarkable…

Computation and Language · Computer Science 2024-02-06 Chandan Singh , Jeevana Priya Inala , Michel Galley , Rich Caruana , Jianfeng Gao

The rise of artificial intelligence and data science across industries underscores the pressing need for effective management and governance of machine learning (ML) models. Traditional approaches to ML models management often involve…

Machine Learning · Computer Science 2025-04-01 Moncef Garouani , Franck Ravat , Nathalie Valles-Parlangeau

The boom of deep learning induced many industries and academies to introduce machine learning based approaches into their concern, competitively. However, existing machine learning frameworks are limited to sufficiently fulfill the…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-24 Hanjoo Kim , Minkyu Kim , Dongjoo Seo , Jinwoong Kim , Heungseok Park , Soeun Park , Hyunwoo Jo , KyungHyun Kim , Youngil Yang , Youngkwan Kim , Nako Sung , Jung-Woo Ha

Automated machine learning (AutoML) strives for the automatic configuration of machine learning algorithms and their composition into an overall (software) solution - a machine learning pipeline - tailored to the learning task (dataset) at…

Machine Learning · Computer Science 2023-06-16 Tanja Tornede , Alexander Tornede , Jonas Hanselle , Marcel Wever , Felix Mohr , Eyke Hüllermeier

As AI moves beyond text, large language models (LLMs) increasingly power vision, audio, and document understanding; however, their high inference costs hinder real-time, scalable deployment. Conversely, smaller open-source models offer cost…

Computation and Language · Computer Science 2025-11-11 Mayank Saini , Arit Kumar Bishwas

Machine learning (ML) pervades an increasing number of academic disciplines and industries. Its impact is profound, and several fields have been fundamentally altered by it, autonomy and computer vision for example; reliability engineering…

Machine Learning · Computer Science 2020-08-20 Zhaoyi Xu , Joseph Homer Saleh

The popularity of data science as a discipline and its importance in the emerging economy and industrial progress dictate that machine learning be democratized for the masses. This also means that the current practice of workforce training…

Machine Learning · Computer Science 2024-05-28 Hasan M Jamil

New technologies such as Machine Learning (ML) gave great potential for evaluating industry workflows and automatically generating key performance indicators (KPIs). However, despite established standards for measuring the efficiency of…

Software developers often submit questions to technical Q&A sites like Stack Overflow (SO) to resolve code-level problems. In practice, they include example code snippets with questions to explain the programming issues. Existing research…

Software Engineering · Computer Science 2024-07-16 Saikat Mondal , Banani Roy

Agentic workflows in large language model systems integrate retrieval, reasoning, and memory, but existing frameworks suffer from scalability and reproducibility limitations due to fragmented data orchestration, serialization overhead, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Arup Kumar Sarker , Mills Staylor , Aymen Alsaadi , Gregor von Laszewski , Shantenu Jha , Geoffrey Fox

Machine Learning (ML) and Deep Learning (DL) innovations are being introduced at such a rapid pace that model owners and evaluators are hard-pressed analyzing and studying them. This is exacerbated by the complicated procedures for…

Machine Learning · Computer Science 2019-06-26 Abdul Dakkak , Cheng Li , Jinjun Xiong , Wen-Mei Hwu

Machine learning (ML) methods have been developing rapidly, but configuring and selecting proper methods to achieve a desired performance is increasingly difficult and tedious. To address this challenge, automated machine learning (AutoML)…

Artificial Intelligence · Computer Science 2024-02-28 Zhenqian Shen , Yongqi Zhang , Lanning Wei , Huan Zhao , Quanming Yao