English
Related papers

Related papers: Step-by-Step Data Cleaning Recommendations to Impr…

200 papers

As key elements within the central dogma, DNA, RNA, and proteins play crucial roles in maintaining life by guaranteeing accurate genetic expression and implementation. Although research on these molecules has profoundly impacted fields like…

Machine Learning (ML) models are widely used in high-stakes domains such as healthcare, where the reliability of predictions is critical. However, these models often fail to account for uncertainty, providing predictions even with low…

The quality of the dataset is crucial for ensuring optimal performance and reliability of downstream task models. However, datasets often contain noisy data inadvertently included during the construction process. Numerous attempts have been…

Computation and Language · Computer Science 2024-09-25 Juhwan Choi , Jungmin Yun , Kyohoon Jin , YoungBin Kim

Machine-learning from a disparate set of tables, a data lake, requires assembling features by merging and aggregating tables. Data discovery can extend autoML to data tables by automating these steps. We present an in-depth analysis of such…

Databases · Computer Science 2025-05-20 Riccardo Cappuzzo , Aimee Coelho , Felix Lefebvre , Paolo Papotti , Gael Varoquaux

Continuous machine learning pipelines are common in industrial settings where models are periodically trained on data streams. Unfortunately, concept drifts may occur in data streams where the joint distribution of the data X and label y,…

Machine Learning · Computer Science 2023-12-18 Minsu Kim , Seong-Hyeon Hwang , Steven Euijong Whang

In this paper, we present our vision of differentiable ML pipelines called DiffML to automate the construction of ML pipelines in an end-to-end fashion. The idea is that DiffML allows to jointly train not just the ML model itself but also…

Databases · Computer Science 2022-07-06 Benjamin Hilprecht , Christian Hammacher , Eduardo Reis , Mohamed Abdelaal , Carsten Binnig

The reasoning capabilities of Large Language Models (LLMs) play a critical role in many downstream tasks, yet depend strongly on the quality of training data. Despite various proposed data construction methods, their practical utility in…

Computation and Language · Computer Science 2025-10-09 Yike Zhao , Simin Guo , Ziqing Yang , Shifan Han , Dahua Lin , Fei Tan

The use of Machine Learning (ML) models in cybersecurity solutions requires high-quality data that is stripped of redundant, missing, and noisy information. By selecting the most relevant features, data integrity and model efficiency can be…

Cryptography and Security · Computer Science 2024-06-13 Miguel Silva , João Vitorino , Eva Maia , Isabel Praça

Forecasting methods are affected by data quality issues in two ways: 1. they are hard to predict, and 2. they may affect the model negatively when it is updated with new data. The latter issue is usually addressed by pre-processing the data…

Machine Learning · Computer Science 2024-04-30 Rodrigo Tuna , Yassine Baghoussi , Carlos Soares , João Mendes-Moreira

The reliability of machine learning (ML) software systems is heavily influenced by changes in data over time. For that reason, ML systems require regular maintenance, typically based on model retraining. However, retraining requires…

Machine Learning · Computer Science 2025-06-18 Lorena Poenaru-Olaru , June Sallou , Luis Cruz , Jan Rellermeyer , Arie van Deursen

Data contamination presents a critical barrier preventing widespread industrial adoption of advanced software engineering techniques that leverage code language models (CLMs). This phenomenon occurs when evaluation data inadvertently…

Software Engineering · Computer Science 2024-11-19 Jialun Cao , Songqiang Chen , Wuqi Zhang , Hau Ching Lo , Shing-Chi Cheung

Leveraging Large Language Models (LLMs) for recommendation has recently garnered considerable attention, where fine-tuning plays a key role in LLMs' adaptation. However, the cost of fine-tuning LLMs on rapidly expanding recommendation data…

Information Retrieval · Computer Science 2024-06-05 Xinyu Lin , Wenjie Wang , Yongqi Li , Shuo Yang , Fuli Feng , Yinwei Wei , Tat-Seng Chua

Data heterogeneity plays a pivotal role in determining the performance of machine learning (ML) systems. Traditional algorithms, which are typically designed to optimize average performance, often overlook the intrinsic diversity within…

Machine Learning · Computer Science 2025-06-03 Jiashuo Liu , Peng Cui

The sparse Mixture-of-Experts (Sparse-MoE) framework efficiently scales up model capacity in various domains, such as natural language processing and vision. Sparse-MoEs select a subset of the "experts" (thus, only a portion of the overall…

Machine Learning · Computer Science 2023-06-06 Shibal Ibrahim , Wenyu Chen , Hussein Hazimeh , Natalia Ponomareva , Zhe Zhao , Rahul Mazumder

Object detection on Lidar point cloud data is a promising technology for autonomous driving and robotics which has seen a significant rise in performance and accuracy during recent years. Particularly uncertainty estimation is a crucial…

Time series anomaly detection is a critical task across various industrial domains. However, capturing temporal dependencies and multivariate correlations within patch-level representation learning remains underexplored, and reliance on…

Machine Learning · Computer Science 2026-02-04 Jinwoo Park , Hyeongwon Kang , Seung Hun Han , Pilsung Kang

Maintaining high data quality is crucial for reliable data analysis and machine learning (ML). However, existing data quality management tools often lack automation, interactivity, and integration with ML workflows. This demonstration paper…

Databases · Computer Science 2025-01-29 Mohamed Abdelaal , Samuel Lokadjaja , Arne Kreuz , Harald Schöning

Machine learning (ML) systems are vulnerable to performance decline over time due to dataset shift. To address this problem, experts often suggest that ML systems should be regularly updated to ensure ongoing performance stability. Some…

Computers and Society · Computer Science 2025-04-08 Joshua Hatherley

Classification tasks are typically handled using Machine Learning (ML) models, which lack a balance between accuracy and interpretability. This paper introduces a new approach for classification tasks using Large Language Models (LLMs) in…

Computation and Language · Computer Science 2025-01-03 Praneeth Vadlapati

Automated machine learning (AutoML) frameworks have become important tools in the data scientists' arsenal, as they dramatically reduce the manual work devoted to the construction of ML pipelines. Such frameworks intelligently search among…

Machine Learning · Computer Science 2024-12-31 Teddy Lazebnik , Amit Somech , Abraham Itzhak Weinberg