English
Related papers

Related papers: SparkGOR: A unified framework for genomic data ana…

200 papers

Today's sequencing technology allows sequencing an individual genome within a few weeks for a fraction of the costs of the original Human Genome project. Genomics labs are faced with dozens of TB of data per week that have to be…

Databases · Computer Science 2009-09-15 Uwe Roehm , Jose Blakeley

The growing reliance on data-driven decision-making highlights the need for more intuitive ways to access and analyze information stored in relational databases. However, the requirement of SQL knowledge has long been a significant barrier…

Databases · Computer Science 2024-10-10 Steve Tueno Fotso

The need for modern data analytics to combine relational, procedural, and map-reduce-style functional processing is widely recognized. State-of-the-art systems like Spark have added SQL front-ends and relational query optimization, which…

Popular online enrichment analysis tools from the field of molecular systems biology provide users with the ability to submit their experimental results as gene sets for individual analysis. Such queries are kept private, and have never…

Molecular Networks · Quantitative Biology 2016-01-08 Avi Ma'ayan , Neil R. Clark

Background. In the last decades, several life science resources have structured data using the same framework and made these accessible using the same query language to facilitate interoperability. Knowledge graphs have seen increased…

Any cutting-edge scientific research project requires a myriad of computational tools for data generation, management, analysis and visualization. Python is a flexible and extensible scientific programming platform that offered the perfect…

Quantitative Methods · Quantitative Biology 2008-03-14 Julius B. Lucks

This paper presents a Spark-based modular LangGraph framework, designed to enhance machine learning workflows through scalability, visualization, and intelligent process optimization. At its core, the framework introduces Agent AI, a…

Artificial Intelligence · Computer Science 2024-12-09 Jialin Wang , Zhihua Duan

We here present SIMLR (Single-cell Interpretation via Multi-kernel LeaRning), an open-source tool that implements a novel framework to learn a sample-to-sample similarity measure from expression data observed for heterogenous samples. SIMLR…

Genomics · Quantitative Biology 2018-01-22 Bo Wang , Daniele Ramazzotti , Luca De Sano , Junjie Zhu , Emma Pierson , Serafim Batzoglou

Although SPARQL has been the predominant query language over RDF graphs, some query intentions cannot be well captured by only using SPARQL syntax. On the other hand, the keyword search enjoys widespread usage because of its intuitive way…

Databases · Computer Science 2014-12-02 Peng Peng , Lei Zou , Dongyan Zhao

The number of databases as well as their size and complexity is increasing. This creates a barrier to use especially for non-experts, who have to come to grips with the nature of the data, the way it has been represented in the database,…

Computation and Language · Computer Science 2021-04-15 Adrián Bazaga , Nupur Gunwant , Gos Micklem

Genomic regions represent features such as gene annotations, transcription factor binding sites and epigenetic modifications. Performing various genomic operations such as identifying overlapping/non-overlapping regions or nearest gene…

Databases · Computer Science 2020-08-18 Matloob Khushi

Generative retrieval (GR) reformulates information retrieval (IR) by framing it as the generation of document identifiers (docids), thereby enabling end-to-end optimization and seamless integration with generative language models (LMs).…

Information Retrieval · Computer Science 2026-04-28 Weiwei Sun , Keyi Kong , Xinyu Ma , Shuaiqiang Wang , Dawei Yin , Maarten de Rijke , Zhaochun Ren , Yiming Yang

This paper presents a generic web-based database interface implemented in Prolog. We discuss the advantages of the implementation platform and demonstrate the system's applicability in providing access to integrated biochemical data. Our…

Programming Languages · Computer Science 2010-09-21 Nicos Angelopoulos , Paul Taylor

We introduce Genome-Factory, the first integrated Python library for tuning, deploying, and interpreting genomic foundation models. Our core contribution is to simplify and unify the workflow for genomic model development: data collection,…

Genomics · Quantitative Biology 2026-05-18 Weimin Wu , Xuefeng Song , Yibo Wen , Qinjie Lin , Zhihan Zhou , Jerry Yao-Chieh Hu , Zhong Wang , Han Liu

The search for similar genetic sequences is one of the main bioinformatics tasks. The genetic sequences data banks are growing exponentially and the searching techniques that use linear time are not capable to do the search in the required…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-13 Felipe Albrecht

To meet the needs of a large pharmaceutical organization, we set out to create S3Mirror - an application for transferring large genomic sequencing datasets between S3 buckets quickly, reliably, and observably. We used the DBOS Transact…

Databases · Computer Science 2025-06-16 Steven Vasquez-Grinnell , Alex Poliakov

Relational databases (RDBs) have become the industry standard for storing massive and heterogeneous data. However, despite the widespread use of RDBs across various fields, the inherent structure of relational databases hinders their…

Databases · Computer Science 2025-08-13 Ning Li , Kounianhua Du , Han Zhang , Quan Gan , Minjie Wang , David Wipf , Weinan Zhang

We introduce AXS (Astronomy eXtensions for Spark), a scalable open-source astronomical data analysis framework built on Apache Spark, a widely used industry-standard engine for big data processing. Building on capabilities present in Spark,…

Instrumentation and Methods for Astrophysics · Physics 2019-07-10 Petar Zečević , Colin T. Slater , Mario Jurić , Andrew J. Connolly , Sven Lončarić , Eric C. Bellm , V. Zach Golkhou , Krzysztof Suberlak

Data commons collate data with cloud computing infrastructure and commonly used software services, tools and applications to create biomedical resources for the large-scale management, analysis, harmonization, and sharing of biomedical…

Genomics · Quantitative Biology 2018-12-27 Robert L. Grossman

We introduce SparkCL, an open source unified programming framework based on Java, OpenCL and the Apache Spark framework. The motivation behind this work is to bring unconventional compute cores such as FPGAs/GPUs/APUs/DSPs and future core…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-06 Oren Segal , Philip Colangelo , Nasibeh Nasiri , Zhuo Qian , Martin Margala