English
Related papers

Related papers: Dataset Lifecycle Framework and its applications i…

200 papers

Data processing frameworks such as Apache Beam and Apache Spark are used for a wide range of applications, from logs analysis to data preparation for DNN training. It is thus unsurprising that there has been a large amount of work on…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-07 Ubaid Ullah Hafeez , Martin Maas , Mustafa Uysal , Richard McDougall

Modern biomedical applications often involve time-series data, from high-throughput phenotyping of model organisms, through to individual disease diagnosis and treatment using biomedical data streams. Data and tools for time-series analysis…

Databases · Computer Science 2019-05-06 Ben D. Fulcher , Carl H. Lubba , Sarab S. Sethi , Nick S. Jones

Computing-In-Memory (CIM) offers a potential solution to the memory wall issue and can achieve high energy efficiency by minimizing data movement, making it a promising architecture for edge AI devices. Lightweight models like MobileNet and…

Hardware Architecture · Computer Science 2025-08-21 Choongseok Song , Doo Seok Jeong

Scientific datasets and analysis pipelines are increasingly being shared publicly in the interest of open science. However, mechanisms are lacking to reliably identify which pipelines and datasets can appropriately be used together. Given…

Information Retrieval · Computer Science 2021-08-23 Mandana Mazaheri , Gregory Kiar , Tristan Glatard

The availability of large-scale datasets on which to train, benchmark and test algorithms has been central to the rapid development of machine learning as a discipline and its maturity as a research discipline. Despite considerable…

Quantum Physics · Physics 2021-08-17 Elija Perrier , Akram Youssry , Chris Ferrie

Deep learning inference on embedded devices is a burgeoning field with myriad applications because tiny embedded devices are omnipresent. But we must overcome major challenges before we can benefit from this opportunity. Embedded processors…

This paper presents the Container Profiler, a software tool that measures and records the resource usage of any containerized task. Our tool profiles the CPU, memory, disk, and network utilization of containerized tasks collecting over…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-08 Varik Hoang , Ling-Hong Hung , David Perez , Huazeng Deng , Raymond Schooley , Niharika Arumilli , Ka Yee Yeung , Wes Lloyd

Businesses have made increasing adoption and incorporation of cloud technology into internal processes in the last decade. The cloud-based deployment provides on-demand availability without active management. More recently, the concept of…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-01 Ying Mao , Yuqi Fu , Suwen Gu , Wenrui Mu , Long Cheng , Qingzhi Liu

Deep learning technology has developed unprecedentedly in the last decade and has become the primary choice in many application domains. This progress is mainly attributed to a systematic collaboration in which rapidly growing computing…

Machine Learning · Computer Science 2023-12-27 Shiye Lei , Dacheng Tao

Kubernetes has emerged as an essential platform for deploying containerised applications across cloud and edge infrastructures. As Kubernetes gains increasing adoption for mission-critical microservices, evaluating system resilience under…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-23 Zihao Chen , Mohammad Goudarzi , Adel Nadjaran Toosi

Neuromorphic computing exhibits great potential to provide high-performance benefits in various applications beyond neural networks. However, a general-purpose program execution model that aligns with the features of neuromorphic computing…

Computation and Language · Computer Science 2024-08-05 Weihao Zhang , Yu Du , Hongyi Li , Songchen Ma , Rong Zhao

Researchers in biomedical research, public health, and the life sciences often spend weeks or months discovering, accessing, curating, and integrating data from disparate sources, significantly delaying the onset of actual analysis and…

Clinicians are interested in better understanding complex diseases, such as cancer or rare diseases, so they need to produce and exchange data to mutualize sources and join forces. To do so and ensure privacy, a natural way consists in…

Databases · Computer Science 2025-09-29 Nelly Barret , Anna Bernasconi , Boris Bikbov , Pietro Pinoli

Data exploration and quality analysis is an important yet tedious process in the AI pipeline. Current practices of data cleaning and data readiness assessment for machine learning tasks are mostly conducted in an arbitrary manner which…

Databases · Computer Science 2020-10-16 Shazia Afzal , Rajmohan C , Manish Kesarwani , Sameep Mehta , Hima Patel

Client-side metadata caching has long been considered an effective method for accelerating metadata operations in distributed file systems (DFSs). However, we have found that client-side state (e.g., caching) is not only ineffective but…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-09 Jingwei Xu , Junbin Kang , Mingkai Dong , Mingyu Liu , Lu Zhang , Shaohong Guo , Ziyan Qiu , Mingzhen You , Ziyi Tian , Anqi Yu , Tianhong Ding , Xinwei Hu , Haibo Chen

Large Language Model (LLM) adapters enable low-cost model specialization, but introduce complex caching and scheduling challenges in distributed serving systems where hundreds of adapters must be hosted concurrently. While prior work has…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-02 Ferran Agullo , Joan Oliveras , Chen Wang , Alberto Gutierrez-Torre , Olivier Tardieu , Alaa Youssef , Jordi Torres , Josep Ll. Berral

Machine learning (ML) approaches have demonstrated promising results in a wide range of healthcare applications. Data plays a crucial role in developing ML-based healthcare systems that directly affect people's lives. Many of the ethical…

Recent neural networks (NNs) with self-attention exhibit competitiveness across different AI domains, but the essential attention mechanism brings massive computation and memory demands. To this end, various sparsity patterns are introduced…

Hardware Architecture · Computer Science 2024-11-26 Haibin Wu , Wenming Li , Kai Yan , Zhihua Fan , Peiyang Wu , Yuqun Liu , Yanhuan Liu , Ziqing Qiang , Meng Wu , Kunming Liu , Xiaochun Ye , Dongrui Fan

Training deep learning models is a repetitive and resource-intensive process. Data scientists often train several models before landing on a set of parameters (e.g., hyper-parameter tuning) and model architecture (e.g., neural architecture…

Machine Learning · Computer Science 2025-08-04 Ties Robroek , Neil Kim Nielsen , Pınar Tözün

As input distributions evolve over a mission lifetime, maintaining performance of learning-based models becomes challenging. This paper presents a framework to incrementally retrain a model by selecting a subset of test inputs to label,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Somrita Banerjee , Apoorva Sharma , Edward Schmerling , Max Spolaor , Michael Nemerouf , Marco Pavone