English
Related papers

Related papers: Enterprise Disk Drive Scrubbing Based on Mondrian …

200 papers

Deep neural networks often rely on spurious correlations to make predictions, which hinders generalization beyond training environments. For instance, models that associate cats with bed backgrounds can fail to predict the existence of cats…

Machine Learning · Computer Science 2023-06-06 Shirley Wu , Mert Yuksekgonul , Linjun Zhang , James Zou

Dataset pruning is the process of removing sub-optimal tuples from a dataset to improve the learning of a machine learning model. In this paper, we compared the performance of different algorithms, first on an unpruned dataset and then on…

Machine Learning · Computer Science 2019-01-31 Arun Thundyill Saseendran , Lovish Setia , Viren Chhabria , Debrup Chakraborty , Aneek Barman Roy

This paper presents an algorithm providing recommendations for optimizing the LHCb data storage. The LHCb data storage system is a hybrid system. All datasets are kept as archives on magnetic tapes. The most popular datasets are kept on…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-01-20 Mikhail Hushchyn , Philippe Charpentier , Andrey Ustyuzhanin

Data pruning is the problem of identifying a core subset that is most beneficial to training and discarding the remainder. While pruning strategies are well studied for discriminative models like those used in classification, little…

Machine Learning · Computer Science 2025-03-17 Rania Briq , Jiangtao Wang , Stefan Kesselheim

Conformal prediction is a distribution-free uncertainty quantification method that has gained popularity in the machine learning community due to its finite-sample guarantees and ease of use. Its most common variant, dubbed split conformal…

Machine Learning · Computer Science 2025-10-27 Alvaro H. C. Correia , Christos Louizos

Massive data is often considered essential for deep learning applications, but it also incurs significant computational and infrastructural costs. Therefore, dataset pruning (DP) has emerged as an effective way to improve data efficiency by…

Machine Learning · Computer Science 2023-11-21 Yihua Zhang , Yimeng Zhang , Aochuan Chen , Jinghan Jia , Jiancheng Liu , Gaowen Liu , Mingyi Hong , Shiyu Chang , Sijia Liu

Modern cloud-based data analytics systems must efficiently process petabytes of data residing on cloud storage. A key optimization technique in state-of-the-art systems like Snowflake is partition pruning - skipping chunks of data that do…

Databases · Computer Science 2025-06-23 Andreas Zimmerer , Damien Dam , Jan Kossmann , Juliane Waack , Ismail Oukid , Andreas Kipf

This paper presents a novel data-driven approach to mitigating employee attrition using machine learning and data engineering techniques. The proposed framework integrates data from various human resources systems and leverages advanced…

Machine Learning · Computer Science 2025-02-26 Naveen Edapurath Vijayan

Management of disk scheduling is a very important aspect of operating system. Performance of the disk scheduling completely depends on how efficient is the scheduling algorithm to allocate services to the request in a better manner. Many…

Operating Systems · Computer Science 2014-03-04 Sourav Kumar Bhoi , Sanjaya Kumar Panda , Imran Hossain Faruk

Solid state disks (SSDs) have advanced to outperform traditional hard drives significantly in both random reads and writes. However, heavy random writes trigger fre- quent garbage collection and decrease the performance of SSDs. In an SSD…

Operating Systems · Computer Science 2015-06-26 Da Zheng , Randal Burns , Alexander S. Szalay

Multi-server jobs are imperative in modern cloud computing systems. A noteworthy feature of multi-server jobs is that, they usually request multiple computing devices simultaneously for their execution. How to schedule multi-server jobs…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-18 Hailiang Zhao , Shuiguang Deng , Feiyi Chen , Jianwei Yin , Schahram Dustdar , Albert Y. Zomaya

In cloud data center (CDC), reducing energy consumption while maintaining performance has always been a hot issue. In server consolidation, the traditional solution is to divide the problem into multiple small problems such as host…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-29 Li Huixi , Xiao Yinhao , Shen Yongluo

Collecting large-scale naturalistic driving data is essential for training robust autonomous driving planners. However, real-world datasets often contain a substantial amount of repetitive and low-value samples, which lead to excessive…

Robotics · Computer Science 2025-12-23 Zhaoyang Liu , Weitao Zhou , Junze Wen , Cheng Jing , Qian Cheng , Kun Jiang , Diange Yang

Machine learning approaches for image classification have led to impressive advances in that field. For example, convolutional neural networks are able to achieve remarkable image classification accuracy across a wide range of applications…

Machine Learning · Statistics 2025-10-30 Christopher T. Franck , Anne R. Driscoll , Zoe Szajnfarber , William H. Woodall

We study the data selection problem, whose aim is to select a small representative subset of data that can be used to efficiently train a machine learning model. We present a new data selection approach based on $k$-means clustering and…

Machine maintenance is a challenging operational problem, where the goal is to plan sufficient preventive maintenance to avoid machine failures and overhauls. Maintenance is often imperfect in reality and does not make the asset as good as…

General Economics · Economics 2022-06-06 Toon Vanderschueren , Robert Boute , Tim Verdonck , Bart Baesens , Wouter Verbeke

Writing correct distributed programs is hard. In spite of extensive testing and debugging, software faults persist even in commercial grade software. Many distributed systems, especially those employed in safety-critical environments,…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Neeraj Mittal , Vijay K. Garg

Deep learning has revolutionized many industries by enabling models to automatically learn complex patterns from raw data, reducing dependence on manual feature engineering. However, deep learning algorithms are sensitive to input data, and…

Machine Learning · Computer Science 2025-07-21 Mert Sehri , Zehui Hua , Francisco de Assis Boldt , Patrick Dumond

Volumetry is one of the principal downstream applications of 3D medical image segmentation, for example, to detect abnormal tissue growth or for surgery planning. Conformal Prediction is a promising framework for uncertainty quantification,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Benjamin Lambert , Florence Forbes , Senan Doyle , Michel Dojat

Structured pruning is an effective approach for compressing large pre-trained neural networks without significantly affecting their performance. However, most current structured pruning methods do not provide any performance guarantees, and…

Machine Learning · Computer Science 2023-02-14 Marwa El Halabi , Suraj Srinivas , Simon Lacoste-Julien