English
Related papers

Related papers: AVATAR -- Machine Learning Pipeline Evaluation Usi…

200 papers

As decarbonization agendas mature, macro-energy systems modelling studies have increasingly focused on enhanced decision support methods that move beyond least-cost modelling to improve consideration of additional objectives and tradeoffs.…

Optimization and Control · Mathematics 2024-11-26 Michael Lau , Neha Patankar , Jesse D. Jenkins

Data science relies on pipelines that are organized in the form of interdependent computational steps. Each step consists of various candidate algorithms that maybe used for performing a particular function. Each algorithm consists of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Aritra Chowdhury , Malik Magdin-Ismail , Bulent Yener

Automated Machine Learning (AutoML) is used more than ever before to support users in determining efficient hyperparameters, neural architectures, or even full machine learning pipelines. However, users tend to mistrust the optimization…

Machine Learning · Computer Science 2022-07-12 René Sass , Eddie Bergman , André Biedenkapp , Frank Hutter , Marius Lindauer

Structured data-quality issues, such as missing values correlated with demographics, culturally biased labels, or systemic selection biases, routinely degrade the reliability of machine-learning pipelines. Regulators now increasingly demand…

Machine Learning · Computer Science 2025-06-03 Jiongli Zhu , Geyang Xu , Felipe Lorenzi , Boris Glavic , Babak Salimi

Integrated circuit verification has gathered considerable interest in recent times. Since these circuits keep growing in complexity year by year, pre-Silicon (pre-SI) verification becomes ever more important, in order to ensure proper…

Artificial Intelligence · Computer Science 2023-06-26 Cristian Manolache , Cristina Andronache , Alexandru Caranica , Horia Cucu , Andi Buzo , Cristian Diaconu , Georg Pelz

Missing value imputation is a crucial preprocessing step for many machine learning problems. However, it is often considered as a separate subtask from downstream applications such as classification, regression, or clustering, and thus is…

Machine Learning · Computer Science 2024-05-02 Adam Catto , Nan Jia , Ansaf Salleb-Aouissi , Anita Raja

Systematic exploration of Agent-Based Models (ABMs) is challenged by the curse of dimensionality and their inherent stochasticity. We present a multi-stage pipeline integrating the systematic design of experiments with machine learning…

Machine Learning · Computer Science 2026-04-07 Paul Saves , Matthieu Mastio , Nicolas Verstaevel , Benoit Gaudou

Alignment plays a fundamental role in many machine learning problems, such as multi-network analysis, multimodal learning, and point cloud registration. Recent works increasingly leverage optimal transport (OT) for distributional alignment,…

Machine Learning · Computer Science 2026-05-26 Qi Yu , Ruizhong Qiu , Zhichen Zeng , My T. Thai , Huan Liu , Hanghang Tong

Pipeline Parallelism (PP) enables large neural network training on small, interconnected devices by splitting the model into multiple stages. To maximize pipeline utilization, asynchronous optimization is appealing as it offers 100%…

Machine Learning · Computer Science 2025-05-05 Thalaiyasingam Ajanthan , Sameera Ramasinghe , Yan Zuo , Gil Avraham , Alexander Long

Simulation testing is a fundamental approach for evaluating automated vehicles (AVs). To ensure its reliability, it is crucial to accurately replicate interactions between AVs and background traffic, which necessitates effective…

Robotics · Computer Science 2025-12-19 Jia Hu , Junqi Li , Xuerun Yan , Jintao Lai , Lianhua An

Machine learning pipelines that include a combinatorial optimization layer can give surprisingly efficient heuristics for difficult combinatorial optimization problems. Three questions remain open: which architecture should be used, how…

Robotics · Computer Science 2023-02-07 Axel Parmentier

The Numerical Association Rule Mining paradigm that includes concurrent dealing with numerical and categorical attributes is beneficial for discovering associations from datasets consisting of both features. The process is not considered as…

Neural and Evolutionary Computing · Computer Science 2025-01-03 Uroš Mlakar , Iztok Fister , Iztok Fister

With the growing popularity of Large Reasoning Models and their results in solving mathematical problems, it becomes crucial to measure their capabilities. We introduce a pipeline for both automatic and interactive verification as a more…

Artificial Intelligence · Computer Science 2026-02-25 Varvara Sazonova , Dmitri Shmelkin , Stanislav Kikot , Vasily Motolygin

The coexistence of multiple defect categories as well as the substantial class imbalance problem significantly impair the detection of sewer pipeline defects. To solve this problem, a multi-label pipe defect recognition method is proposed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Xin Zuo , Yu Sheng , Jifeng Shen , Yongwei Shan

Compiler optimization relies on sequences of passes to improve program performance. Selecting and ordering these passes automatically, known as compiler auto-tuning, is challenging due to the large and complex search space. Existing…

Software Engineering · Computer Science 2025-10-16 Haolin Pan , Jinyuan Dong , Mingjie Xing , Yanjun Wu

Representation engineering methods have recently shown promise for enabling efficient steering of model behavior. However, evaluation pipelines for these methods have primarily relied on subjective demonstrations, instead of quantitative,…

Artificial Intelligence · Computer Science 2024-10-23 Itamar Pres , Laura Ruis , Ekdeep Singh Lubana , David Krueger

Retrieval-augmented generation (RAG) has emerged as a promising paradigm for improving factual accuracy in large language models (LLMs). We introduce a benchmark designed to evaluate RAG pipelines as a whole, evaluating a pipeline's ability…

Artificial Intelligence · Computer Science 2026-05-25 Samuel Hildebrand , Curtis Taylor , Sean Oesch , James M Ghawaly , Amir Sadovnik , Ryan Shivers , Brandon Schreiber , Kevin Kurian

Algorithm-selection (AS) methods are essential in order to obtain the best performance from a portfolio of solvers over large sets of instances. However, many AS methods rely on an analysis phase, e.g. where features are computed by…

Machine Learning · Computer Science 2024-06-26 Quentin Renau , Emma Hart

Machine learning (ML) models in production pipelines are frequently retrained on the latest partitions of large, continually-growing datasets. Due to engineering bugs, partitions in such datasets almost always have some corrupted features;…

Databases · Computer Science 2023-03-13 Shreya Shankar , Labib Fawaz , Karl Gyllstrom , Aditya G. Parameswaran

Understanding performance and prioritizing resources for the maintenance of the drinking-water pipe network throughout its life-cycle is a key part of water asset management. Renovation of this vital network is generally hindered by the…

Signal Processing · Electrical Eng. & Systems 2020-07-09 Maryam Rahbaralam , David Modesto , Jaume Cardús , Amir Abdollahi , Fernando M Cucchietti