English
Related papers

Related papers: DataAssist: A Machine Learning Approach to Data Cl…

200 papers

The vast advances in Machine Learning over the last ten years have been powered by the availability of suitably prepared data for training purposes. The future of ML-enabled enterprise hinges on data. As such, there is already a vibrant…

Databases · Computer Science 2021-06-02 Yifan Li , Xiaohui Yu , Nick Koudas

Artificial Intelligence (AI) is making a profound impact in almost every domain. A vital enabler of its great success is the availability of abundant and high-quality data for building machine learning models. Recently, the role of data in…

Machine Learning · Computer Science 2023-06-13 Daochen Zha , Zaid Pervaiz Bhat , Kwei-Herng Lai , Fan Yang , Zhimeng Jiang , Shaochen Zhong , Xia Hu

Machine Learning (ML) has gained popularity in actuarial research and insurance industrial applications. However, the performance of most ML tasks heavily depends on data preprocessing, model selection, and hyperparameter optimization,…

Machine Learning · Computer Science 2024-08-27 Panyi Dong , Zhiyu Quan

The rapidly growing demand for high-quality data in Large Language Models (LLMs) has intensified the need for scalable, reliable, and semantically rich data preparation pipelines. However, current practices remain dominated by ad-hoc…

This doctoral dissertation proposes a novel approach to enhance the development of smart services for the Internet of Things (IoT) and smart Cyber-Physical Systems (CPS). The proposed approach offers abstraction and automation to the…

Software Engineering · Computer Science 2021-06-29 Armin Moin

With the wide spread of sensors and smart devices in recent years, the data generation speed of the Internet of Things (IoT) systems has increased dramatically. In IoT systems, massive volumes of data must be processed, transformed, and…

Machine Learning · Computer Science 2022-09-19 Li Yang , Abdallah Shami

Large language models (LLMs) have demonstrated remarkable performance across a wide range of tasks and domains, with data playing a central role in enabling these advances. Despite this success, the preparation and effective utilization of…

Computation and Language · Computer Science 2026-03-17 Hao Liang , Zhengyang Zhao , Zhaoyang Han , Meiyi Qiang , Xiaochen Ma , Bohan Zeng , Qifeng Cai , Zhiyu Li , Linpeng Tang , Weinan E , Wentao Zhang

This paper introduces LLAssist, an open-source tool designed to streamline literature reviews in academic research. In an era of exponential growth in scientific publications, researchers face mounting challenges in efficiently processing…

Digital Libraries · Computer Science 2024-12-23 Christoforus Yoga Haryanto

Data standardization is a crucial part of the data science life cycle. While tools like Pandas offer robust functionalities, their complexity and the manual effort required for customizing code to diverse column types pose significant…

Machine Learning · Computer Science 2025-06-03 Danrui Qi , Zhengjie Miao , Jiannan Wang

Classification tasks are typically handled using Machine Learning (ML) models, which lack a balance between accuracy and interpretability. This paper introduces a new approach for classification tasks using Large Language Models (LLMs) in…

Computation and Language · Computer Science 2025-01-03 Praneeth Vadlapati

Selecting relevant data subsets from large, unfamiliar datasets can be difficult. We address this challenge by modeling and visualizing two kinds of auxiliary information: (1) quality - the validity and appropriateness of data required to…

Human-Computer Interaction · Computer Science 2023-03-06 Arpit Narechania , Fan Du , Atanu R Sinha , Ryan A. Rossi , Jane Hoffswell , Shunan Guo , Eunyee Koh , Shamkant B. Navathe , Alex Endert

Research in machine learning (ML) has primarily argued that models trained on incomplete or biased datasets can lead to discriminatory outputs. In this commentary, we propose moving the research focus beyond bias-oriented framings by…

Human-Computer Interaction · Computer Science 2021-09-17 Milagros Miceli , Julian Posada , Tianling Yang

To solve a machine learning problem, one typically needs to perform data preprocessing, modeling, and hyperparameter tuning, which is known as model selection and hyperparameter optimization.The goal of automated machine learning (AutoML)…

Machine Learning · Computer Science 2019-04-19 Weilin Zhou , Frederic Precioso

Machine learning algorithms have become increasingly prevalent in multiple domains, such as autonomous driving, healthcare, and finance. In such domains, data preparation remains a significant challenge in developing accurate models,…

Databases · Computer Science 2023-04-27 Mohamed Abdelaal , Rashmi Koparde , Harald Schoening

Large Language Model (LLM) powered agents have emerged as effective planners for Automated Machine Learning (AutoML) systems. While most existing AutoML approaches focus on automating feature engineering and model architecture search,…

Machine Learning · Computer Science 2025-11-27 Chin-Chia Michael Yeh , Vivian Lai , Uday Singh Saini , Xiran Fan , Yujie Fan , Junpeng Wang , Xin Dai , Yan Zheng

As the volume of publicly available data continues to grow, researchers face the challenge of limited diversity in benchmarking machine learning tasks. Although thousands of datasets are available in public repositories, the sheer abundance…

Information Retrieval · Computer Science 2025-02-25 Mara Graziani , Malina Molnar , Irina Espejo Morales , Joris Cadow-Gossweiler , Teodoro Laino

Data Cleaning refers to the process of detecting and fixing errors in the data. Human involvement is instrumental at several stages of this process, e.g., to identify and repair errors, to validate computed repairs, etc. There is currently…

Databases · Computer Science 2018-01-03 El Kindi Rezig , Mourad Ouzzani , Ahmed K. Elmagarmid , Walid G. Aref

Data scarcity and noise are important issues in industrial applications of machine learning. However, it is often challenging to devise a scalable and generalized approach to address the fundamental distributional and semantic properties of…

Machine Learning · Computer Science 2021-12-08 Youngjune Lee , Oh Joon Kwon , Haeju Lee , Joonyoung Kim , Kangwook Lee , Kee-Eung Kim

To relieve the pain of manually selecting machine learning algorithms and tuning hyperparameters, automated machine learning (AutoML) methods have been developed to automatically search for good models. Due to the huge model search space,…

Machine Learning · Computer Science 2020-11-23 Qianwen Wang , Yao Ming , Zhihua Jin , Qiaomu Shen , Dongyu Liu , Micah J. Smith , Kalyan Veeramachaneni , Huamin Qu