English
Related papers

Related papers: Integrating Hyperparameter Search into Model-Free …

200 papers

Automated Machine Learning (AutoML) is an important industrial solution for automatic discovery and deployment of the machine learning models. However, designing an integrated AutoML system faces four great challenges of configurability,…

Although information access systems have long supported people in accomplishing a wide range of tasks, we propose broadening the scope of users of information access systems to include task-driven machines, such as machine learning models.…

Machine Learning · Computer Science 2022-05-04 Hamed Zamani , Fernando Diaz , Mostafa Dehghani , Donald Metzler , Michael Bendersky

Modern approach to artificial intelligence (AI) aims to design algorithms that learn directly from data. This approach has achieved impressive results and has contributed significantly to the progress of AI, particularly in the sphere of…

Machine Learning · Computer Science 2024-03-20 Alhassan Mumuni , Fuseini Mumuni

Automated machine learning techniques benefited from tremendous research progress in recently. These developments and the continuous-growing demand for machine learning experts led to the development of numerous AutoML tools. However, these…

Machine Learning · Computer Science 2021-06-15 Alexandru-Ionut Imbrea

As software-intensive systems face growing pressure to comply with laws and regulations, providing automated support for compliance analysis has become paramount. Despite advances in the Requirements Engineering (RE) community on legal…

Software Engineering · Computer Science 2024-04-23 Shabnam Hassani , Mehrdad Sabetzadeh , Daniel Amyot , Jain Liao

AutomationML (AML) enables standardized data exchange in engineering, yet existing recommendations for proper AML modeling are typically formulated as informal and textual constraints. These constraints cannot be validated automatically…

Artificial Intelligence · Computer Science 2025-06-13 Tom Westermann , Aljosha Köcher , Felix Gehlhoff

Recent progress in AutoML has lead to state-of-the-art methods (e.g., AutoSKLearn) that can be readily used by non-experts to approach any supervised learning problem. Whereas these methods are quite effective, they are still limited in the…

Machine Learning · Computer Science 2019-07-23 Jorge Madrid , Hugo Jair Escalante , Eduardo Morales

Several recently devised machine learning (ML) algorithms have shown improved accuracy for various predictive problems. Model searches, which explore to find an optimal ML algorithm and hyperparameter values for the target problem, play a…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-08-28 Yoshiki Takahashi , Masato Asahara , Kazuyuki Shudo

Large Language Models (LLMs) have demonstrated remarkable improvements in reasoning and planning through increased test-time compute, often by framing problem-solving as a search process. While methods like Monte Carlo Tree Search (MCTS)…

Artificial Intelligence · Computer Science 2025-06-06 Nathan Herr , Tim Rocktäschel , Roberta Raileanu

To relieve the pain of manually selecting machine learning algorithms and tuning hyperparameters, automated machine learning (AutoML) methods have been developed to automatically search for good models. Due to the huge model search space,…

Machine Learning · Computer Science 2020-11-23 Qianwen Wang , Yao Ming , Zhihua Jin , Qiaomu Shen , Dongyu Liu , Micah J. Smith , Kalyan Veeramachaneni , Huamin Qu

End-to-end AutoML has attracted intensive interests from both academia and industry which automatically searches for ML pipelines in a space induced by feature engineering, algorithm/model selection, and hyper-parameter tuning. Existing…

Machine Learning · Computer Science 2022-06-27 Yang Li , Yu Shen , Wentao Zhang , Ce Zhang , Bin Cui

Background. Due to the widespread adoption of Artificial Intelligence (AI) and Machine Learning (ML) for building software applications, companies are struggling to recruit employees with a deep understanding of such technologies. In this…

Software Engineering · Computer Science 2025-01-24 Fabio Calefato , Luigi Quaranta , Filippo Lanubile , Marcos Kalinowski

Metamodel-based DSL development in language workbenches like Xtext allows language engineers to focus more on metamodels and domain concepts rather than grammar details. However, the grammar generated from metamodels often requires manual…

Software Engineering · Computer Science 2023-09-11 Weixing Zhang , Jan-Philipp Steghöfer , Regina Hebig , Daniel Strüber

AutoML systems are currently rising in popularity, as they can build powerful models without human oversight. They often combine techniques from many different sub-fields of machine learning in order to find a model or set of models that…

Machine Learning · Statistics 2021-05-03 Florian Pfisterer , Stefan Coors , Janek Thomas , Bernd Bischl

This paper presents Grammar Reinforcement Learning (GRL), a reinforcement learning algorithm that uses Monte Carlo Tree Search (MCTS) and a transformer architecture that models a Pushdown Automaton (PDA) within a context-free grammar (CFG)…

Artificial Intelligence · Computer Science 2025-01-24 Jason Piquenot , Maxime Bérar , Pierre Héroux , Jean-Yves Ramel , Romain Raveaux , Sébastien Adam

This paper proposes a novel pipeline for automatic grammar augmentation that provides a significant improvement in the voice command recognition accuracy for systems with small footprint acoustic model (AM). The improvement is achieved by…

Computation and Language · Computer Science 2018-11-16 Yang Yang , Anusha Lalitha , Jinwon Lee , Chris Lott

In the continuously advancing AI landscape, crafting context-rich and meaningful responses via Large Language Models (LLMs) is essential. Researchers are becoming more aware of the challenges that LLMs with fewer parameters encounter when…

Computation and Language · Computer Science 2024-10-17 Somnath Banerjee , Amruit Sahoo , Sayan Layek , Avik Dutta , Rima Hazra , Animesh Mukherjee

Many problems in RL, such as meta-RL, robust RL, generalization in RL, and temporal credit assignment, can be cast as POMDPs. In theory, simply augmenting model-free RL with memory-based architectures, such as recurrent neural networks,…

Machine Learning · Computer Science 2022-06-07 Tianwei Ni , Benjamin Eysenbach , Ruslan Salakhutdinov

Comparing different AutoML frameworks is notoriously challenging and often done incorrectly. We introduce an open and extensible benchmark that follows best practices and avoids common mistakes when comparing AutoML frameworks. We conduct a…

When developing text classification models for real world applications, one major challenge is the difficulty to collect sufficient data for all text classes. In this work, we address this challenge by utilizing large language models (LLMs)…

Computation and Language · Computer Science 2025-08-15 Chenhao Xue , Yuanzhe Jin , Adrian Carrasco-Revilla , Joyraj Chakraborty , Min Chen