English
Related papers

Related papers: Comparative Evaluation of Big-Data Systems on Scie…

200 papers

Automated searches for strong gravitational lensing in optical imaging survey datasets often employ machine learning and deep learning approaches. These techniques require more example systems to train the algorithms than have presently…

Instrumentation and Methods for Astrophysics · Physics 2021-02-08 Robert Morgan , Brian Nord , Simon Birrer , Joshua Yao-Yu Lin , Jason Poh

Visual parsing of images and videos is critical for a wide range of real-world applications. However, progress in this field is constrained by limitations of existing datasets: (1) insufficient annotation granularity, which impedes…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Minghao Zou , Qingtian Zeng , Yongping Miao , Shangkun Liu , Zilong Wang , Hantao Liu , Wei Zhou

We present a two-component Machine Learning (ML) based approach for classifying astronomical images by data-quality via an examination of sources detected in the images and image pixel values from representative sources within those images.…

Instrumentation and Methods for Astrophysics · Physics 2020-04-01 Hossen Teimoorinia , J. J. Kavelaars , Stephen Gwyn , Daniel Durand , Kennedy Rolston , Alexander Ouellette

Multimodal data modeling has emerged as a powerful approach in clinical research, enabling the integration of diverse data types such as imaging, genomics, wearable sensors, and electronic health records. Despite its potential to improve…

How can we find interpretable, domain-appropriate models of natural phenomena given some complex, raw data such as images? Can we use such models to derive scientific insight from the data? In this paper, we propose some methods for…

Machine Learning · Computer Science 2024-02-06 Christopher J. Soelistyo , Alan R. Lowe

In the world of Big Data analytics, there is a series of tools aiming at simplifying programming applications to be executed on clusters. Although each tool claims to provide better programming, data and execution models, for which only…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-17 Claudia Misale , Maurizio Drocco , Marco Aldinucci , Guy Tremblay

Dataset distillation and dataset pruning are two prominent techniques for compressing datasets to improve computational and storage efficiency. Despite their overlapping objectives, these approaches are rarely compared directly. Even within…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Lingao Xiao , Songhua Liu , Yang He , Xinchao Wang

The scarcity of high-quality data remains a primary bottleneck in adapting multimodal generative models for medical image editing. Existing medical image editing datasets often suffer from limited diversity, neglect of medical image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yongfan Lai , Wen Qian , Bo Liu , Hongyan Li , Hao Luo , Fan Wang , Bohan Zhuang , Shenda Hong

Macro photography (MP) is a specialized field of photography that captures objects at an extremely close range, revealing tiny details. Although an accurate macro photography image quality assessment (MPIQA) metric can benefit macro…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Jiashuo Chang , Zhengyi Li , Jianxun Lou , Zhen Qiu , Hanhe Lin

In recent years, ideas from statistics and scientific computing have begun to interact in increasingly sophisticated and fruitful ways with ideas from computer science and the theory of algorithms to aid in the development of improved…

Data Structures and Algorithms · Computer Science 2010-10-11 Michael W. Mahoney

This paper introduces a new benchmark for large-scale image similarity detection. This benchmark is used for the Image Similarity Challenge at NeurIPS'21 (ISC2021). The goal is to determine whether a query image is a modified copy of any…

Data lakes have emerged as a flexible and scalable solution for storing and analyzing large volumes of heterogeneous data, including structured, semi-structured, and unstructured formats. Despite their growing adoption in both industry and…

Databases · Computer Science 2026-01-28 Yi Lyu , Pei-Chieh Lo , Natan Lidukhover

With the spreading prevalence of Big Data, many advances have recently been made in this field. Frameworks such as Apache Hadoop and Apache Spark have gained a lot of traction over the past decades and have become massively popular,…

Databases · Computer Science 2017-11-28 Anand Gupta , Hardeo Thakur , Ritvik Shrivastava , Pulkit Kumar , Sreyashi Nag

The combination of deep learning image analysis methods and large-scale imaging datasets offers many opportunities to imaging neuroscience and epidemiology. However, despite the success of deep learning when applied to many neuroimaging…

Image and Video Processing · Electrical Eng. & Systems 2021-07-14 Nicola K Dinsdale , Emma Bluemke , Vaanathi Sundaresan , Mark Jenkinson , Stephen Smith , Ana IL Namburete

Optical imaging of the brain has expanded dramatically in the past two decades. New optics, indicators, and experimental paradigms are now enabling in-vivo imaging from the synaptic to the cortex-wide scales. To match the resulting flood of…

Image and Video Processing · Electrical Eng. & Systems 2024-02-15 Gal Mishne , Adam Charles

Most of the popular Big Data analytics tools evolved to adapt their working environment to extract valuable information from a vast amount of unstructured data. The ability of data mining techniques to filter this helpful information from…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-23 Taha Tekdogan , Ali Cakmak

The complexity of human biology and its intricate systems holds immense potential for advancing human health, disease treatment, and scientific discovery. However, traditional manual methods for studying biological interactions are often…

Other Quantitative Biology · Quantitative Biology 2025-01-24 Himanshu Buckchash , Gyanendra Kumar Verma , Dilip K. Prasad

The performance of database management systems (DBMS) is traditionally evaluated using benchmarks that focus on workloads with (almost) fixed record lengths. However, some real-world workloads in key/value stores, document databases, and…

Databases · Computer Science 2025-08-12 Danushka Liyanage , Shubham Pandey , Joshua Goldstein , Michael Cahill , Akon Dey , Alan Fekete , Uwe Röhm

The prevalence of AI-generated imagery has raised concerns about the authenticity of astronomical images, especially with advanced text-to-image models like Stable Diffusion producing highly realistic synthetic samples. Existing detection…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Mohammed Talha Alam , Raza Imam , Mohsen Guizani , Fakhri Karray

The amount of image datasets collected for environmental monitoring purposes has increased in the past years as computer vision assisted methods have gained interest. Computer vision applications rely on high-quality datasets, making data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Mikko Impiö , Philipp M. Rehsen , Jenni Raitoharju