English
Related papers

Related papers: DaiSy: A Library for Scalable Data Series Similari…

200 papers

A flexible and highly-extensible data assimilation testing suite, named DATeS, is described in this paper. DATeS aims to offer a unified testing environment that allows researchers to compare different data assimilation methodologies and…

Mathematical Software · Computer Science 2018-07-03 Ahmed Attia , Adrian Sandu

AsaPy is a custom-made Python library designed to simplify and optimize the analysis of aerospace simulation data. Instead of introducing new methodologies, it excels in combining various established techniques, creating a unified,…

We present the use of self-supervised learning to explore and exploit large unlabeled datasets. Focusing on 42 million galaxy images from the latest data release of the Dark Energy Spectroscopic Instrument (DESI) Legacy Imaging Surveys, we…

Instrumentation and Methods for Astrophysics · Physics 2021-12-02 George Stein , Peter Harrington , Jacqueline Blaum , Tomislav Medan , Zarija Lukic

Data series similarity search is a core operation for several data series analysis applications across many different domains. Nevertheless, even state-of-the-art techniques cannot provide the time performance required for large data series…

Databases · Computer Science 2020-09-02 Botao Peng , Panagiota Fatourou , Themis Palpanas

Recently, parallel search engines have been implemented based on scalable distributed file systems such as Google File System. However, we claim that building a massively-parallel search engine using a parallel DBMS can be an attractive…

Databases · Computer Science 2012-08-22 Kyu-Young Whang , Tae-Seob Yun , Yeon-Mi Yeo , Il-Yeol Song , Hyuk-Yoon Kwon , In-Joong Kim

We present DASH, a C++ template library that offers distributed data structures and parallel algorithms and implements a compiler-free PGAS (partitioned global address space) approach. DASH offers many productivity and performance features…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-10-06 Karl Fürlinger , Tobias Fuchs , Roger Kowalewski

Almost all applications stop scaling at some point; those that don't are seldom performant when considering time to solution on anything but aspirational/unicorn resources. Recognizing these tradeoffs as well as greater user functionality…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-28 Stephen Hudson , Jeffrey Larson , John-Luke Navarro , Stefan M. Wild

fastai is a deep learning library which provides practitioners with high-level components that can quickly and easily provide state-of-the-art results in standard deep learning domains, and provides researchers with low-level components…

Machine Learning · Computer Science 2020-02-21 Jeremy Howard , Sylvain Gugger

Geo-replicated systems provide a number of desirable properties such as globally low latency, high availability, scalability, and built-in fault tolerance. Unfortunately, programming correct applications on top of such systems has proven to…

Programming Languages · Computer Science 2025-02-27 Kartik Nagar , Prasita Mukherjee , Suresh Jagannathan

Applications are increasingly written as dynamic workflows underpinned by an execution framework that manages asynchronous computations across distributed hardware. However, execution frameworks typically offer one-size-fits-all solutions…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-18 J. Gregory Pauloski , Klaudiusz Rydzy , Valerie Hayot-Sasson , Ian Foster , Kyle Chard

Sequence alignments are fundamental to bioinformatics which has resulted in a variety of optimized implementations. Unfortunately, the vast majority of them are hand-tuned and specific to certain architectures and execution models. This not…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-17 André Müller , Bertil Schmidt , Andreas Hildebrandt , Richard Membarth , Roland Leißa , Matthis Kruse , Sebastian Hack

In modern information retrieval (IR). achieving more than just accuracy is essential to sustaining a healthy ecosystem, especially when addressing fairness and diversity considerations. To meet these needs, various datasets, algorithms, and…

Information Retrieval · Computer Science 2025-02-18 Chen Xu , Zhirui Deng , Clara Rus , Xiaopeng Ye , Yuanna Liu , Jun Xu , Zhicheng Dou , Ji-Rong Wen , Maarten de Rijke

Indexing is an effective way to support efficient query processing in large databases. Recently the concept of learned index, which replaces or complements traditional index structures with machine learning models, has been actively…

Databases · Computer Science 2022-08-01 Yao Tian , Tingyun Yan , Xi Zhao , Kai Huang , Xiaofang Zhou

Big data problems frequently require processing datasets in a streaming fashion, either because all data are available at once but collectively are larger than available memory or because the data intrinsically arrive one data point at a…

Computation · Statistics 2018-08-08 Andrea Giovannucci , Victor Minden , Cengiz Pehlevan , Dmitri B. Chklovskii

We propose Hercules, a parallel tree-based technique for exact similarity search on massive disk-based data series collections. We present novel index construction and query answering algorithms that leverage different summarization…

Databases · Computer Science 2022-12-29 Karima Echihabi , Panagiota Fatourou , Kostas Zoumpatianos , Themis Palpanas , Houda Benbrahim

SOL is an open-source library for scalable online learning algorithms, and is particularly suitable for learning with high-dimensional data. The library provides a family of regular and sparse online learning algorithms for large-scale…

Machine Learning · Computer Science 2016-10-31 Yue Wu , Steven C. H. Hoi , Chenghao Liu , Jing Lu , Doyen Sahoo , Nenghai Yu

The wide deployment of IoT sensors has enabled the collection of very big time series across different domains, from which advanced analytics can be performed to find unknown relationships, most importantly the correlations between them.…

Databases · Computer Science 2022-04-21 Nguyen Ho , Van Long Ho , Torben Bach Pedersen , Mai Vu , Christophe A. N. Biscio

Similarity search is the task of retrieving data items that are similar to a given query. In this paper, we introduce the time-sensitive notion of similarity search over endless data-streams (SSDS), which takes into account data quality and…

Information Retrieval · Computer Science 2017-08-08 Naama Kraus , David Carmel , Idit Keidar

Similarity search, the task of identifying objects most similar to a given query object under a specific metric, has gathered significant attention due to its practical applications. However, the absence of coordinate information to…

Databases · Computer Science 2024-05-14 Yifan Zhu , Ruiyao Ma , Baihua Zheng , Xiangyu Ke , Lu Chen , Yunjun Gao

The Jaccard index is an important similarity measure for item sets and Boolean data. On large datasets, an exact similarity computation is often infeasible for all item pairs both due to time and space constraints, giving rise to faster…

Data Structures and Algorithms · Computer Science 2021-03-09 Marc Bury , Chris Schwiegelshohn , Mara Sorella