English

D4M 3.0

Distributed, Parallel, and Cluster Computing 2017-02-13 v1 Databases
Authors: Lauren Milechin , Alexander Chen , Vijay Gadepally , Dylan Hutchison , Siddharth Samsi , Jeremy Kepner
View on arXiv ↗ PDF ↗

Abstract

The D4M tool is used by hundreds of researchers to perform complex analytics on unstructured data. Over the past few years, the D4M toolbox has evolved to support connectivity with a variety of database engines, graph analytics in the Apache Accumulo database, and an implementation using the Julia programming language. In this article, we describe some of our latest additions to the D4M toolbox and our upcoming D4M 3.0 release.

Keywords

compiler optimization

Cite

@article{arxiv.1702.03253,
  title  = {D4M 3.0},
  author = {Lauren Milechin and Alexander Chen and Vijay Gadepally and Dylan Hutchison and Siddharth Samsi and Jeremy Kepner},
  journal= {arXiv preprint arXiv:1702.03253},
  year   = {2017}
}

Related papers

View all related →
Databases · Computer Science
D4M 3.0: Extended Database and Language Capabilities
Lauren Milechin, Vijay Gadepally, Siddharth Samsi, Jeremy Kepner +2
2017-11-09
Databases · Computer Science
Database Operations in D4M.jl
Lauren Milechin, Vijay Gadepally, Jeremy Kepner
2018-12-18
Mathematical Software · Computer Science
Julia Implementation of the Dynamic Distributed Dimensional Data Model
Alexander Chen, Alan Edelman, Jeremy Kepner, Vijay Gadepally +1
2016-12-13
Databases · Computer Science
D4M: Bringing Associative Arrays to Database Engines
Vijay Gadepally, Jeremy Kepner, William Arcand, David Bestor +10
2017-01-25
Databases · Computer Science
D4M 2.0 Schema: A General Purpose High Performance Schema for the Accumulo Database
Jeremy Kepner, Christian Anderson, William Arcand, David Bestor +10
2015-05-26
Distributed, Parallel, and Cluster Computing · Computer Science
Python Implementation of the Dynamic Distributed Dimensional Data Model
Hayden Jananthan, Lauren Milechin, Michael Jones, William Arcand +16
2022-11-24
Databases · Computer Science
A Billion Updates per Second Using 30,000 Hierarchical In-Memory D4M Databases
Jeremy Kepner, Vijay Gadepally, Lauren Milechin, Siddharth Samsi +14
2019-02-05
Databases · Computer Science
Achieving 100,000,000 database inserts per second using Accumulo and D4M
Jeremy Kepner, William Arcand, David Bestor, Bill Bergeron +9
2015-05-26
Distributed, Parallel, and Cluster Computing · Computer Science
Streaming 1.9 Billion Hypersparse Network Updates per Second with D4M
Jeremy Kepner, Vijay Gadepally, Lauren Milechin, Siddharth Samsi +14
2019-12-03
Databases · Computer Science
Unstructured Data Analysis using LLMs: A Comprehensive Benchmark
Qiyan Deng, Jianhui Li, Chengliang Chai, Jinqi Liu +8
2025-11-03
Distributed, Parallel, and Cluster Computing · Computer Science
Hyperscaling Internet Graph Analysis with D4M on the MIT SuperCloud
Vijay Gadepally, Jeremy Kepner, Lauren Milechin, William Arcand +13
2018-08-28
Information Retrieval · Computer Science
D4R -- Exploring and Querying Relational Graphs Using Natural Language and Large Language Models -- the Case of Historical Documents
Michel Boeglin, David Kahn, Josiane Mothe, Diego Ortiz +1
2025-03-28
Computation and Language · Computer Science
From LIMA to DeepLIMA: following a new path of interoperability
Victor Bocharov, Romaric Besançon, Gaël de Chalendar, Olivier Ferret +1
2024-09-11
Quantitative Methods · Quantitative Biology
Genetic Sequence Matching Using D4M Big Data Approaches
Stephanie Dodson, Darrell O. Ricke, Jeremy Kepner
2016-11-18
Distributed, Parallel, and Cluster Computing · Computer Science
Admire framework: Distributed data mining on data grid platforms
Nhien-An Le-Khac, M-Tahar Kechadi, Joe Carthy
2017-03-30
Mathematical Software · Computer Science
The JuliaConnectoR: a functionally oriented interface for integrating Julia in R
Stefan Lenz, Maren Hackenberg, Harald Binder
2021-03-31
Quantum Physics · Physics
QuantumInformation.jl---a Julia package for numerical computation in quantum information theory
Piotr Gawron, Dariusz Kurzyk, Łukasz Pawela
2019-01-01
Programming Languages · Computer Science
Julia: A Fast Dynamic Language for Technical Computing
Jeff Bezanson, Stefan Karpinski, Viral B. Shah, Alan Edelman
2012-09-25
Databases · Computer Science
AFrame: Extending DataFrames for Large-Scale Modern Data Analysis (Extended Version)
Phanwadee Sinthong, Michael J. Carey
2019-08-20
Chemical Physics · Physics
ML4Chem: A Machine Learning Package for Chemistry and Materials Science
Muammar El Khatib, Wibe A de Jong
2020-03-31
Mathematical Software · Computer Science
PlasmoData.jl -- A Julia Framework for Modeling and Analyzing Complex Data as Graphs
David L Cole, Victor M Zavala
2025-01-09
Computation and Language · Computer Science
dLLM: Simple Diffusion Language Modeling
Zhanhui Zhou, Lingjie Chen, Hanghang Tong, Dawn Song
2026-02-27
Instrumentation and Methods for Astrophysics · Physics
Towards new solutions for scientific computing: the case of Julia
Maurizio Tomasi, Mosè Giordano
2018-12-05
Computation and Language · Computer Science
TAP4LLM: Table Provider on Sampling, Augmenting, and Packing Semi-structured Data for Large Language Model Reasoning
Yuan Sui, Jiaru Zou, Mengyu Zhou, Xinyi He +3
2024-10-11
Instrumentation and Methods for Astrophysics · Physics
DAME: A Distributed Data Mining & Exploration Framework within the Virtual Observatory
M. Brescia, S. Cavuoti, R. D'Abrusco, O. Laurino +1
2011-12-06
R2 v1 2026-06-22T18:15:06.774Z