English
Related papers

Related papers: From Black-Box Tuning to Guided Optimization via H…

200 papers

Hyperparameters play a critical role in machine learning. Hyperparameter tuning can make the difference between state-of-the-art and poor prediction performance for any algorithm, but it is particularly challenging for structure learning…

Machine Learning · Computer Science 2024-02-21 Damian Machlanski , Spyridon Samothrakis , Paul Clarke

In this paper we develop a Bayesian optimization based hyperparameter tuning framework inspired by statistical learning theory for classifiers. We utilize two key facts from PAC learning theory; the generalization bound will be higher for a…

Machine Learning · Computer Science 2019-02-08 Tinu Theckel Joy , Santu Rana , Sunil Gupta , Svetha Venkatesh

Lack of transparency in AI systems poses challenges in critical real-life applications. It is important to be able to explain the decisions of an AI system to ensure trust on the system. Explainable AI (XAI) algorithms play a vital role in…

Machine Learning · Computer Science 2026-05-15 Sayantani Ghosh , Amit Kumar Das , Amlan Chakrabarti

The importance of explainability in AI has become a pressing concern, for which several explainable AI (XAI) approaches have been recently proposed. However, most of the available XAI techniques are post-hoc methods, which however may be…

Machine Learning · Computer Science 2022-04-15 Leonardo Lucio Custode , Giovanni Iacca

This paper examines two different yet related questions related to explainable AI (XAI) practices. Machine learning (ML) is increasingly important in financial services, such as pre-approval, credit underwriting, investments, and various…

Machine Learning · Computer Science 2022-09-21 Swati Tyagi

Research in Explainable Artificial Intelligence (XAI) is increasing, aiming to make deep learning models more transparent. Most XAI methods focus on justifying the decisions made by Artificial Intelligence (AI) systems in security-relevant…

Shapley and Banzhaf interactions capture the complex dynamics inherent in modern machine learning applications. However, current estimators for these higher-order interactions trade off between speed and accuracy. To overcome this…

Hyperparameter optimization (HPO), as a central paradigm of AutoML, is crucial for leveraging the full potential of machine learning (ML) models; yet its complexity poses challenges in understanding and debugging the optimization process.…

Robot appearance crucially shapes Human-Robot Interaction (HRI) but is typically described via broad categories like anthropomorphic, zoomorphic, or technical. More precise approaches focus almost exclusively on anthropomorphic features,…

Robotics · Computer Science 2025-07-28 Rachel Ringe , Robin Nolte , Nima Zargham , Robert Porzel , Rainer Malaka

Artificial Intelligence (AI) has become essential for analyzing complex data and solving highly-challenging tasks. It is being applied across numerous disciplines beyond computer science, including Food Engineering, where there is a growing…

Feature selection is a crucial step in developing robust and powerful machine learning models. Feature selection techniques can be divided into two categories: filter and wrapper methods. While wrapper methods commonly result in strong…

Machine Learning · Computer Science 2022-07-07 Jarne Verhaeghe , Jeroen Van Der Donckt , Femke Ongenae , Sofie Van Hoecke

Machine learning (ML) and Deep Learning (DL) methods are being adopted rapidly, especially in computer network security, such as fraud detection, network anomaly detection, intrusion detection, and much more. However, the lack of…

Machine Learning · Computer Science 2021-12-17 Khushnaseeb Roshan , Aasim Zafar

Deep neural networks have seen great success in recent years; however, training a deep model is often challenging as its performance heavily depends on the hyper-parameters used. In addition, finding the optimal hyper-parameter…

Parameter tuning is recognized today as a crucial ingredient when tackling an optimization problem. Several meta-optimization methods have been proposed to find the best parameter set for a given optimization algorithm and (set of) problem…

Artificial Intelligence · Computer Science 2013-05-13 Mostepha Redouane Khouadjia , Marc Schoenauer , Vincent Vidal , Johann Dréo , Pierre Savéant

Common approaches to explainable AI (XAI) for deep learning focus on analyzing the importance of input features on the classification task in a given model: saliency methods like SHAP and GradCAM are used to measure the impact of spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Anne Sielemann , Valentin Barner , Stefan Wolf , Masoud Roschani , Jens Ziehn , Juergen Beyerer

The concept of parameter setting is a crucial and significant process in metaheuristics since it can majorly impact their performance. It is a highly complex and challenging procedure since it requires a deep understanding of the…

Optimization and Control · Mathematics 2025-04-08 Vasileios A. Tatsis , Dimos Ioannidis

Explainable artificial intelligence (XAI) has helped elucidate the internal mechanisms of machine learning algorithms, bolstering their reliability by demonstrating the basis of their predictions. Several XAI models consider causal…

Machine Learning · Computer Science 2024-04-30 Daisuke Takahashi , Shohei Shimizu , Takuma Tanaka

In the past years, many new explanation methods have been proposed to achieve interpretability of machine learning predictions. However, the utility of these methods in practical applications has not been researched extensively. In this…

Machine Learning · Computer Science 2019-07-09 Hilde J. P. Weerts , Werner van Ipenburg , Mykola Pechenizkiy

While shallow decision trees may be interpretable, larger ensemble models like gradient-boosted trees, which often set the state of the art in machine learning problems involving tabular data, still remain black box models. As a remedy, the…

Machine Learning · Computer Science 2024-06-21 Maximilian Muschalik , Fabian Fumagalli , Barbara Hammer , Eyke Hüllermeier

Machine learning is an essential tool for optimizing industrial quality control processes. However, the complexity of machine learning models often limits their practical applicability due to a lack of interpretability. Additionally, many…

Artificial Intelligence · Computer Science 2025-11-12 Georg Rottenwalter , Marcel Tilly , Victor Owolabi