English
Related papers

Related papers: MLlib: Machine Learning in Apache Spark

200 papers

This paper is about a machine learning approach based on the multilinear projection of an unknown function (or probability distribution) to be estimated towards a linear (or multilinear) dimensional space E'. The proposal transforms the…

Machine Learning · Computer Science 2019-08-20 Steve Tueno

OpenML is an online platform for open science collaboration in machine learning, used to share datasets and results of machine learning experiments. In this paper we introduce OpenML-Python, a client API for Python, opening up the OpenML…

The task of developing a machine learning (ML) model for a particular problem is inherently open-ended, and there is an unbounded set of possible solutions. Steps of the ML development pipeline, such as feature engineering, loss function…

Human-Computer Interaction · Computer Science 2022-04-05 Peter Washington , Aayush Nandkeolyar , Sam Yang

The objective of this work was to utilize BigBench [1] as a Big Data benchmark and evaluate and compare two processing engines: MapReduce [2] and Spark [3]. MapReduce is the established engine for processing data on Hadoop. Spark is a…

Databases · Computer Science 2016-01-14 Todor Ivanov , Max-Georg Beer

As machine learning is applied more widely, it is necessary to have a machine learning platform for both infrastructure administrators and users including expert data scientists and citizen data scientists to improve their productivity.…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-08-24 Kai-Hsun Chen , Huan-Ping Su , Wei-Chiu Chuang , Hung-Chang Hsiao , Wangda Tan , Zhankun Tang , Xun Liu , Yanbo Liang , Wen-Chih Lo , Wanqiang Ji , Byron Hsu , Keqiu Hu , HuiYang Jian , Quan Zhou , Chien-Min Wang

MLI is an Application Programming Interface designed to address the challenges of building Machine Learn- ing algorithms in a distributed setting based on data-centric computing. Its primary goal is to simplify the development of…

NLP Workbench is a web-based platform for text mining that allows non-expert users to obtain semantic understanding of large-scale corpora using state-of-the-art text mining models. The platform is built upon latest pre-trained models and…

Computation and Language · Computer Science 2024-03-06 Peiran Yao , Matej Kosmajac , Abeer Waheed , Kostyantyn Guzhva , Natalie Hervieux , Denilson Barbosa

We present an open source software package SpectroLab a Matlab-based tool developed in 2018 for the analysis of spectroscopic data. In this package, there are tools for derivative analysis, stacked energy contours, stacked plots for theory,…

Materials Science · Physics 2022-03-15 Christopher Sims

Language models are now capable of solving tasks that require dealing with long sequences consisting of hundreds of thousands of tokens. However, they often fail on tasks that require repetitive use of simple rules, even on sequences that…

Computation and Language · Computer Science 2024-10-10 Mirelle Bueno , Roberto Lotufo , Rodrigo Nogueira

SOL is an open-source library for scalable online learning algorithms, and is particularly suitable for learning with high-dimensional data. The library provides a family of regular and sparse online learning algorithms for large-scale…

Machine Learning · Computer Science 2016-10-31 Yue Wu , Steven C. H. Hoi , Chenghao Liu , Jing Lu , Doyen Sahoo , Nenghai Yu

Recent advances in large language models (LLMs) have opened new opportunities for academic literature retrieval. However, existing systems often rely on rigid pipelines and exhibit limited reasoning capabilities. We introduce SPAR, a…

Information Retrieval · Computer Science 2025-07-22 Xiaofeng Shi , Yuduo Li , Qian Kou , Longbin Yu , Jinxin Xie , Hua Zhou

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

With the growing complexity of computational and experimental facilities, many scientific researchers are turning to machine learning (ML) techniques to analyze large scale ensemble data. With complexities such as multi-component workflows,…

MLPerf, an emerging machine learning benchmark suite strives to cover a broad range of applications of machine learning. We present a study on its characteristics and how the MLPerf benchmarks differ from some of the previous deep learning…

Machine Learning · Computer Science 2019-08-27 Snehil Verma , Qinzhe Wu , Bagus Hanindhito , Gunjan Jha , Eugene B. John , Ramesh Radhakrishnan , Lizy K. John

YAMLE: Yet Another Machine Learning Environment is an open-source framework that facilitates rapid prototyping and experimentation with machine learning (ML) models and methods. The key motivation is to reduce repetitive work when…

Machine Learning · Computer Science 2024-02-12 Martin Ferianc , Miguel Rodrigues

Machine Learning (ML) is increasingly used to automate impactful decisions, which leads to concerns regarding their correctness, reliability, and fairness. We envision highly-automated software platforms to assist data scientists with…

Databases · Computer Science 2024-09-04 Stefan Grafberger

The lattice Boltzmann method (LBM) has emerged as a prominent technique for solving fluid dynamics problems due to its algorithmic potential for computational scalability. We introduce XLB library, a Python-based differentiable LBM library…

Computational Physics · Physics 2024-04-03 Mohammadmehdi Ataei , Hesam Salehipour

Mixed Integer Linear Programming (MILP) is essential for modeling complex decision-making problems but faces challenges in computational tractability and requires expert formulation. Current deep learning approaches for MILP focus on…

Machine Learning · Computer Science 2025-02-24 Sirui Li , Janardhan Kulkarni , Ishai Menache , Cathy Wu , Beibin Li

This paper presents aplib, a Java library for programming intelligent agents, featuring BDI and multi agency, but adding on top of it a novel layer of tactical programming inspired by the domain of theorem proving. Aplib is also implemented…

Artificial Intelligence · Computer Science 2019-11-13 I. S. W. B. Prasetya

The paper presents AMGCL -- an opensource C++ library implementing the algebraic multigrid method (AMG) for solution of large sparse linear systems of equations, usually arising from discretization of partial differential equations on an…

Mathematical Software · Computer Science 2019-06-26 Denis Demidov