English
Related papers

Related papers: Flexible and Scalable Deep Learning with MMLSpark

200 papers

Machine learning (ML) applications become increasingly common in many domains. ML systems to execute these workloads include numerical computing frameworks and libraries, ML algorithm libraries, and specialized systems for deep neural…

Stochastic algorithms are efficient approaches to solving machine learning and optimization problems. In this paper, we propose a general framework called Splash for parallelizing stochastic algorithms on multi-node distributed systems.…

Machine Learning · Computer Science 2015-09-24 Yuchen Zhang , Michael I. Jordan

Without prior knowledge, distinguishing different languages may be a hard task, especially when their borders are permeable. We develop an extension of spectral clustering -- a powerful unsupervised classification toolbox -- that is shown…

Computation and Language · Computer Science 2008-10-08 Richard Nock , Pascal Vaillant , Frank Nielsen , Claudia Henry

This paper presents the design, implementation, and evaluation of the PyTorch distributed data parallel module. PyTorch is a widely-adopted scientific computing package used in deep learning research and applications. Recent advances in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-30 Shen Li , Yanli Zhao , Rohan Varma , Omkar Salpekar , Pieter Noordhuis , Teng Li , Adam Paszke , Jeff Smith , Brian Vaughan , Pritam Damania , Soumith Chintala

The Java and Scala community has built a very successful big data ecosystem. However, most of neural networks running on it are modeled in dynamically typed programming languages. These dynamically typed deep learning frameworks treat…

Programming Languages · Computer Science 2023-07-25 Bo Yang , Zhihao Zhang Kirisame Marisa , Kai Shi

Software repository mining is the foundation for many empirical software engineering studies. The collection and analysis of detailed data can be challenging, especially if data shall be shared to enable replicable research and open science…

Software Engineering · Computer Science 2020-01-07 Alexander Trautsch , Fabian Trautsch , Steffen Herbold , Benjamin Ledel , Jens Grabowski

Effectively using Natural Language Processing (NLP) tools in under-resourced languages requires a thorough understanding of the language itself, familiarity with the latest models and training methodologies, and technical expertise to…

Computation and Language · Computer Science 2024-04-04 Zaid Sheikh , Antonios Anastasopoulos , Shruti Rijhwani , Lindia Tjuatja , Robbie Jimerson , Graham Neubig

We present the open-source image processing software package PySAP (Python Sparse data Analysis Package) developed for the COmpressed Sensing for Magnetic resonance Imaging and Cosmology (COSMIC) project. This package provides a set of…

Instrumentation and Methods for Astrophysics · Physics 2020-07-03 S. Farrens , A. Grigis , L. El Gueddari , Z. Ramzi , Chaithya G. R. , S. Starck , B. Sarthou , H. Cherkaoui , P. Ciuciu , J. -L. Starck

We present Espresso, an open-source, modular, extensible end-to-end neural automatic speech recognition (ASR) toolkit based on the deep learning library PyTorch and the popular neural machine translation toolkit fairseq. Espresso supports…

Computation and Language · Computer Science 2019-10-16 Yiming Wang , Tongfei Chen , Hainan Xu , Shuoyang Ding , Hang Lv , Yiwen Shao , Nanyun Peng , Lei Xie , Shinji Watanabe , Sanjeev Khudanpur

This study introduces a novel methodology for mapping scientific communities at scale, addressing challenges associated with network analysis in large bibliometric datasets. By leveraging enriched publication metadata from the French…

Digital Libraries · Computer Science 2025-01-20 Victor Barbier , Eric Jeangirard

We present PyTorch Frame, a PyTorch-based framework for deep learning over multi-modal tabular data. PyTorch Frame makes tabular deep learning easy by providing a PyTorch-based data structure to handle complex tabular data, introducing a…

Machine Learning · Computer Science 2024-12-17 Weihua Hu , Yiwen Yuan , Zecheng Zhang , Akihiro Nitta , Kaidi Cao , Vid Kocijan , Jinu Sunil , Jure Leskovec , Matthias Fey

A recently introduced text classifier, called SS3, has obtained state-of-the-art performance on the CLEF's eRisk tasks. SS3 was created to deal with risk detection over text streams and, therefore, not only supports incremental training and…

Machine Learning · Computer Science 2020-07-21 Sergio G. Burdisso , Marcelo Errecalde , Manuel Montes-y-Gómez

This paper introduces a centralized, open-source dataset repository designed to advance NLP and NMT for Assamese, a low-resource language. The repository, available at GitHub, supports various tasks like sentiment analysis, named entity…

Computation and Language · Computer Science 2024-10-17 S. Tamang , D. J. Bora

Decentralised Machine Learning (DML) enables collaborative machine learning without centralised input data. Federated Learning (FL) and Edge Inference are examples of DML. While tools for DML (especially FL) are starting to flourish, many…

Applying DevOps practices to machine learning system is termed as MLOps and machine learning systems evolve on new data unlike traditional systems on requirements. The objective of MLOps is to establish a connection between different…

Software Engineering · Computer Science 2024-02-21 Pir Sami Ullah Shah , Naveed Ahmad , Mirza Omer Beg

The alarming decline in global biodiversity, driven by various factors, underscores the urgent need for large-scale wildlife monitoring. In response, scientists have turned to automated deep learning methods for data processing in wildlife…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Andres Hernandez , Zhongqi Miao , Luisa Vargas , Sara Beery , Rahul Dodhia , Pablo Arbelaez , Juan M. Lavista Ferres

Continual learning is the problem of learning from a nonstationary stream of data, a fundamental issue for sustainable and efficient training of deep neural networks over time. Unfortunately, deep learning libraries only provide primitives…

Machine Learning · Computer Science 2023-02-06 Antonio Carta , Lorenzo Pellegrini , Andrea Cossu , Hamed Hemati , Vincenzo Lomonaco

We present \texttt{secml}, an open-source Python library for secure and explainable machine learning. It implements the most popular attacks against machine learning, including test-time evasion attacks to generate adversarial examples…

Machine Learning · Computer Science 2022-05-16 Maura Pintor , Luca Demetrio , Angelo Sotgiu , Marco Melis , Ambra Demontis , Battista Biggio

In recent years, multi-agent frameworks powered by large language models (LLMs) have advanced rapidly. Despite this progress, there is still a notable absence of benchmark datasets specifically tailored to evaluate their performance. To…

Computation and Language · Computer Science 2025-04-28 Lei Shen , Xiaoyu Shen

Neurosymbolic learning enables the integration of symbolic reasoning with deep learning but faces significant challenges in scaling to complex symbolic programs, large datasets, or both. We introduce DOLPHIN, a framework that tackles these…

Machine Learning · Computer Science 2026-01-01 Aaditya Naik , Jason Liu , Claire Wang , Amish Sethi , Saikat Dutta , Mayur Naik , Eric Wong