English
Related papers

Related papers: SDRBench: Scientific Data Reduction Benchmark for …

200 papers

Dataset search is a well-established task in the Semantic Web and information retrieval research. Current approaches retrieve datasets either based on keyword queries or by identifying datasets similar to a given target dataset. These…

Information Retrieval · Computer Science 2025-12-11 Qing Shi , Jing He , Qiaosheng Chen , Gong Cheng

Learned database components, which deeply integrate machine learning into their design, have been extensively studied in recent years. Given the dynamism of databases, where data and workloads continuously drift, it is crucial for learned…

Databases · Computer Science 2026-04-16 Zhanhao Zhao , Haotian Gao , Naili Xing , Lingze Zeng , Meihui Zhang , Gang Chen , Manuel Rigger , Beng Chin Ooi

Learnable embedding vector is one of the most important applications in machine learning, and is widely used in various database-related domains. However, the high dimensionality of sparse data in recommendation tasks and the huge volume of…

Machine Learning · Computer Science 2024-02-14 Hailin Zhang , Penghao Zhao , Xupeng Miao , Yingxia Shao , Zirui Liu , Tong Yang , Bin Cui

The growing demand for data-driven decision-making has created an urgent need for data agents that can integrate structured and unstructured data for analysis. While data agents show promise for enabling users to perform complex analytics…

Databases · Computer Science 2025-09-03 Ziting Wang , Shize Zhang , Haitao Yuan , Jinwei Zhu , Shifu Li , Wei Dong , Gao Cong

Cell clustering is crucial for uncovering cellular heterogeneity in single-cell RNA sequencing (scRNA-seq) data by identifying cell types and marker genes. Despite its importance, benchmarks for scRNA-seq clustering methods remain…

Genomics · Quantitative Biology 2025-12-03 Ping Xu , Zaitian Wang , Zhirui Wang , Pengjiang Li , Jiajia Wang , Ran Zhang , Pengfei Wang , Yuanchun Zhou

Data-driven approaches, most prominently deep learning, have become powerful tools for prediction in many domains. A natural question to ask is whether data-driven methods could also be used to predict global weather patterns days in…

Atmospheric and Oceanic Physics · Physics 2020-12-30 Stephan Rasp , Peter D. Dueben , Sebastian Scher , Jonathan A. Weyn , Soukayna Mouatadid , Nils Thuerey

Error-bounded lossy compression is a critical technique for significantly reducing scientific data volumes. Compared to CPU-based compressors, GPU-based compressors exhibit substantially higher throughputs, fitting better for today's HPC…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-02 Jinyang Liu , Jiannan Tian , Shixun Wu , Sheng Di , Boyuan Zhang , Robert Underwood , Yafan Huang , Jiajun Huang , Kai Zhao , Guanpeng Li , Dingwen Tao , Zizhong Chen , Franck Cappello

The rapid development of automated scientific survey generation technology has made it increasingly important to establish a comprehensive benchmark to evaluate the quality of generated surveys.Nearly all existing evaluation benchmarks rely…

Artificial Intelligence · Computer Science 2026-01-23 Guo-Biao Zhang , Ding-Yuan Liu , Da-Yi Wu , Tian Lan , Heyan Huang , Zhijing Wu , Xian-Ling Mao

Many applications from camera arrays to sensor networks require efficient compression and processing of correlated data, which in general is collected in a distributed fashion. While information-theoretic foundations of distributed…

Information Theory · Computer Science 2024-02-14 Ezgi Ozyilkan , Elza Erkip

We describe the current state and future plans for a set of tools for scientific data management (SDM) designed to support scientific transparency and reproducible research. SDM has been in active use at our MRI Center for more than two…

Quantitative Methods · Quantitative Biology 2015-02-25 B. A. Wandell , A. Rokem , L. M. Perry , G. Schaefer , R. F. Dougherty

As single-cell RNA sequencing datasets grow in adoption, scale, and complexity, data analysis remains a bottleneck for many research groups. Although frontier AI agents have improved dramatically at software engineering and general data…

Genomics · Quantitative Biology 2026-02-11 Kenny Workman , Zhen Yang , Harihara Muralidharan , Aidan Abdulali , Hannah Le

This paper examines information-theoretic questions regarding the difficulty of compressing data versus the difficulty of decompressing data and the role that information loss plays in this interaction. Finite-state compression and…

Computational Complexity · Computer Science 2009-09-29 David Doty , Philippe Moser

We introduce QMBench, a comprehensive benchmark designed to evaluate the capability of large language model agents in quantum materials research. This specialized benchmark assesses the model's ability to apply condensed matter physics…

Computational antibody design has seen rapid methodological progress, with dozens of deep generative methods proposed in the past three years, yet the field lacks a standardized benchmark for fair comparison and model development. These…

Machine Learning · Computer Science 2026-04-02 Mansoor Ahmed , Nadeem Taj , Imdad Ullah Khan , Hemanth Venkateswara , Murray Patterson

Many applications such as scientific simulation, sensing, and power grid monitoring tend to generate massive amounts of data, which should be compressed first prior to storage and transmission. These data, mostly comprised of floating-point…

Databases · Computer Science 2019-11-19 Dongeun Lee , Alex Sim , Jaesik Choi , Kesheng Wu

Obtaining standardized crowdsourced benchmark of computational methods is a major issue in data science communities. Dedicated frameworks enabling fair benchmarking in a unified environment are yet to be developed. Here we introduce…

Machine Learning · Computer Science 2022-06-28 Zhen Xu , Sergio Escalera , Isabelle Guyon , Adrien Pavão , Magali Richard , Wei-Wei Tu , Quanming Yao , Huan Zhao

Exploiting the recent advancements in artificial intelligence, showcased by ChatGPT and DALL-E, in real-world applications necessitates vast, domain-specific, and publicly accessible datasets. Unfortunately, the scarcity of such datasets…

Machine Learning · Computer Science 2023-05-17 Cyril Picard , Jürg Schiffmann , Faez Ahmed

Learning and Artificial Intelligence (ML/AI) techniques have become increasingly prevalent in high performance computing (HPC). However, these methods depend on vast volumes of floating point data for training and validation which need…

Machine Learning · Computer Science 2024-03-26 Robert Underwood , Jon C. Calhoun , Sheng Di , Franck Cappello

Scientific Machine Learning (SciML) faces unique challenges for extreme-resolution data, with mitigations that often fail to scale or degrade the accuracy of trained models. While some specialized methods have achieved remarkable results in…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-13 Corey Adams , Peter Harrington , Akshay Subramaniam , Mohammad Shoaib Abbas , Jaideep Pathak , Mike Pritchard , Sanjay Choudhry

Plant breeders and agricultural researchers can increase crop productivity by identifying desirable features, disease resistance, and nutritional content by analysing the Dry Bean dataset. This study analyses and compares different Support…

Machine Learning · Computer Science 2023-07-18 Anant Mehta , Prajit Sengupta , Divisha Garg , Harpreet Singh , Yosi Shacham Diamand