English
Related papers

Related papers: SmartEDA: An R Package for Automated Exploratory D…

200 papers

OpenML is an online machine learning platform where researchers can easily share data, machine learning tasks and experiments as well as organize them online to work and collaborate more efficiently. In this paper, we present an R package…

Automated scientific discovery with large language models is transforming the research lifecycle from ideation to experimentation, yet existing agents struggle to autonomously process raw data collected from scientific experiments. We…

Artificial Intelligence · Computer Science 2026-04-29 Ke Lin , Yilin Lu , Shreyas Bhat , Xuehang Guo , Junier Oliva , Qingyun Wang

With the growing complexity of modern integrated circuits, hardware engineers are required to devote more effort to the full design-to-manufacturing workflow. This workflow involves numerous iterations, making it both labor-intensive and…

Checking data quality against domain knowledge is a common activity that pervades statistical analysis from raw data to output. The R package 'validate' facilitates this task by capturing and applying expert knowledge in the form of…

Computation · Statistics 2021-04-01 Mark P. J. van der Loo , Edwin de Jonge

Discovering causal relationships from data is the ultimate goal of many research areas. Constraint based causal exploration algorithms, such as PC, FCI, RFCI, PC-simple, IDA and Joint-IDA have achieved significant progress and have many…

Artificial Intelligence · Computer Science 2015-10-13 Thuc Duy Le , Tao Hoang , Jiuyong Li , Lin Liu , Shu Hu

A plethora of scientific software packages are published in repositories, e.g., Zenodo and figshare. These software packages are crucial for the reproducibility of published research. As an additional route to scholarly knowledge graph…

Digital Libraries · Computer Science 2022-12-16 Muhammad Haris , Markus Stocker , Sören Auer

The term Data Space, understood as the secure exchange of data in distributed systems, ensuring openness, transparency, decentralization, sovereignty, and interoperability of information, has gained importance during the last years.…

Databases · Computer Science 2024-02-13 Javier Conde , Alejandro Pozo , Andrés Munoz-Arcentales , Johnny Choque , Álvaro Alonso

This paper describes PyOED, a highly extensible scientific package that enables developing and testing model-constrained optimal experimental design (OED) for inverse problems. Specifically, PyOED aims to be a comprehensive Python toolkit…

Mathematical Software · Computer Science 2023-12-20 Abhijit Chowdhary , Shady E. Ahmed , Ahmed Attia

Questions of `how best to acquire data' are essential to modeling and prediction in the natural and social sciences, engineering applications, and beyond. Optimal experimental design (OED) formalizes these questions and creates…

Methodology · Statistics 2026-05-01 Xun Huan , Jayanth Jagalur , Youssef Marzouk

Traditional error detection approaches require user-defined parameters and rules. Thus, the user has to know both the error detection system and the data. However, we can also formulate error detection as a semi-supervised classification…

Machine Learning · Computer Science 2019-08-20 Felix Neutatz , Mohammad Mahdavi , Ziawasch Abedjan

The progress of humanity is driven by those successful discoveries accompanied by countless failed experiments. Researchers often seek the potential research directions by reading and then verifying them through experiments. The process…

Artificial Intelligence · Computer Science 2024-07-31 Haotian Chen , Xinjie Shen , Zeqi Ye , Wenjun Feng , Haoxue Wang , Xiao Yang , Xu Yang , Weiqing Liu , Jiang Bian

Efficient explorative data analysis systems must take into account both what a user knows and wants to know. This paper proposes a principled framework for interactive visual exploration of relations in data, through views most informative…

Machine Learning · Statistics 2021-07-02 Kai Puolamäki , Emilia Oikarinen , Andreas Henelius

Data analysis is at the core of scientific studies, a prominent task that researchers and practitioners typically undertake by programming their own set of automated scripts. While there is no shortage of tools and languages available for…

Software Engineering · Computer Science 2019-04-23 Artur Andrzejak , Oliver Wenz , Diego Costa

Active learning effectively collects data instances for training deep learning models when the labeled dataset is limited and the annotation cost is high. Besides active learning, data augmentation is also an effective technique to enlarge…

Machine Learning · Computer Science 2020-11-18 Yoon-Yeong Kim , Kyungwoo Song , JoonHo Jang , Il-Chul Moon

Topological Data Analysis (TDA) is a discipline that applies algebraic topology techniques to analyze complex, multi-dimensional data. Although it is a relatively new field, TDA has been widely and successfully applied across various…

Machine Learning · Computer Science 2024-07-29 Martin Uray , Barbara Giunti , Michael Kerber , Stefan Huber

Motivation: Model selection is a ubiquitous challenge in statistics. For penalized models, model selection typically entails tuning hyperparameters to maximize a measure of fit or minimize out-of-sample prediction error. However, these…

Methodology · Statistics 2025-05-29 Priyam Das , Sarah Robinson , Christine B. Peterson

Nested data structures arise when observations are grouped into distinct units, such as patients within hospitals or students within schools. Accounting for this hierarchical organization is essential for valid inference, as ignoring it can…

Computation · Statistics 2025-08-14 Francesco Denti , Laura D'Angelo

The performance model of an application can pro- vide understanding about its runtime behavior on particular hardware. Such information can be analyzed by developers for performance tuning. However, model building and analyzing is…

Performance · Computer Science 2017-05-23 Kewen Meng , Boyana Norris

Innovative Electronic Design Automation (EDA) solutions are important to meet the design requirements for increasingly complex electronic devices. Verilog, a hardware description language, is widely used for the design and verification of…

Machine Learning · Computer Science 2023-06-08 Enrique Dehaerne , Bappaditya Dey , Sandip Halder , Stefan De Gendt

Discovering patterns of the complex high-dimensional data is a long-standing problem. Dimension Reduction (DR) and Intrinsic Dimension Estimation (IDE) are two fundamental thematic programs that facilitate geometric understanding of the…

Machine Learning · Statistics 2022-09-13 Kisung You