中文
相关论文

相关论文: A multi-objective perspective on jointly tuning ha…

200 篇论文

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

机器学习 · 计算机科学 2019-01-14 Ozan Sener , Vladlen Koltun

Multiobjective combinatorial optimization (MOCO) problems can be found in many real-world applications. However, exactly solving these problems would be very challenging, particularly when they are NP-hard. Many handcrafted heuristic…

机器学习 · 计算机科学 2022-05-10 Xi Lin , Zhiyuan Yang , Qingfu Zhang

Machine learning training methods depend plentifully and intricately on hyperparameters, motivating automated strategies for their optimisation. Many existing algorithms restart training for each new hyperparameter choice, at considerable…

机器学习 · 计算机科学 2022-04-22 Ross M. Clarke , Elre T. Oldewage , José Miguel Hernández-Lobato

Multi-objective optimization aims at finding trade-off solutions to conflicting objectives. These constitute the Pareto optimal set. In the context of expensive-to-evaluate functions, it is impossible and often non-informative to look for…

机器学习 · 统计学 2020-02-20 David Gaudrie , Rodolphe Le Riche , Victor Picheny , Benoit Enaux , Vincent Herbert

We study the problem of using low computational cost to automate the choices of learners and hyperparameters for an ad-hoc training dataset and error metric, by conducting trials of different configurations on the given training data. We…

机器学习 · 计算机科学 2021-05-20 Chi Wang , Qingyun Wu , Markus Weimer , Erkang Zhu

Hyperparameter optimization (HPO) plays a central role in the automated machine learning (AutoML). It is a challenging task as the response surfaces of hyperparameters are generally unknown, hence essentially a global optimization problem.…

机器学习 · 计算机科学 2021-06-18 Zebin Yang , Aijun Zhang

Due to the high computational demands executing a rigorous comparison between hyperparameter optimization (HPO) methods is often cumbersome. The goal of this paper is to facilitate a better empirical evaluation of HPO methods by providing…

机器学习 · 计算机科学 2019-05-14 Aaron Klein , Frank Hutter

Machine learning algorithms have made remarkable achievements in the field of artificial intelligence. However, most machine learning algorithms are sensitive to the hyper-parameters. Manually optimizing the hyper-parameters is a common…

机器学习 · 计算机科学 2020-03-05 Bozhou Chen , Kaixin Zhang , Longshen Ou , Chenmin Ba , Hongzhi Wang , Chunnan Wang

Beam parameter optimization in accelerators involves multiple, sometimes competing objectives. Condensing these individual objectives into a single figure of merit unavoidably results in a bias towards particular outcomes, in absence of…

加速器物理 · 物理学 2022-12-26 Faran Irshad , Stefan Karsch , Andreas Döpp

Automated machine learning aims to automate the whole process of machine learning, including model configuration. In this paper, we focus on automated hyperparameter optimization (HPO) based on sequential model-based optimization (SMBO).…

机器学习 · 计算机科学 2019-09-11 Ying Wei , Peilin Zhao , Huaxiu Yao , Junzhou Huang

Wireless ad hoc networks are seldom characterized by one single performance metric, yet the current literature lacks a flexible framework to assist in characterizing the design tradeoffs in such networks. In this work, we address this…

网络与互联网体系结构 · 计算机科学 2010-08-17 Katia Jaffrès-Runser , Cristina Comaniciu , Jean-Marie Gorce

On-device machine learning (ML) has become a fundamental component of emerging mobile applications. Adaptive model deployment delivers efficient inference for heterogeneous device capabilities and performance requirements through…

机器学习 · 计算机科学 2025-12-01 Mengyang Liu , Chenyu Lu , Haodong Tian , Fang Dong , Ruiting Zhou , Wei Wang , Dian Shen , Guangtong Li , Ye Wan , Li Li

The identification of performance-optimizing parameter settings is an important part of the development and application of algorithms. We describe an automatic framework for this algorithm configuration problem. More formally, we provide…

人工智能 · 计算机科学 2014-01-16 Frank Hutter , Thomas Stuetzle , Kevin Leyton-Brown , Holger H. Hoos

This work proposes a methodology to find performance and energy trade-offs for parallel applications running on Heterogeneous Multi-Processing systems with a single instruction-set architecture. These offer flexibility in the form of…

Multiple object tracking is a critical task in autonomous driving. Existing works primarily focus on the heuristic design of neural networks to obtain high accuracy. As tracking accuracy improves, however, neural networks become…

计算机视觉与模式识别 · 计算机科学 2024-03-26 Chensheng Peng , Zhaoyu Zeng , Jinling Gao , Jundong Zhou , Masayoshi Tomizuka , Xinbing Wang , Chenghu Zhou , Nanyang Ye

Making models algorithmically fairer in tabular data has been long studied, with techniques typically oriented towards fixes which usually take a neural model with an undesirable outcome and make changes to how the data are ingested, what…

机器学习 · 计算机科学 2023-10-19 Richeek Das , Samuel Dooley

Hyperparameter optimization (HPO) is concerned with the automated search for the most appropriate hyperparameter configuration (HPC) of a parameterized machine learning algorithm. A state-of-the-art HPO method is Hyperband, which, however,…

机器学习 · 计算机科学 2023-02-07 Jasmin Brandt , Marcel Wever , Dimitrios Iliadis , Viktor Bengs , Eyke Hüllermeier

A fundamental step in the development of machine learning models commonly involves the tuning of hyperparameters, often leading to multiple model training runs to work out the best-performing configuration. As machine learning tasks and…

机器学习 · 计算机科学 2024-12-12 Daniel Geissler , Bo Zhou , Sungho Suh , Paul Lukowicz

Multi-objective reinforcement learning (MORL) approaches have emerged to tackle many real-world problems with multiple conflicting objectives by maximizing a joint objective function weighted by a preference vector. These approaches find…

机器学习 · 计算机科学 2023-05-31 Toygun Basaklar , Suat Gumussoy , Umit Y. Ogras

In recommender systems, it is well-established that both accuracy and diversity are crucial for generating high-quality recommendation lists. However, achieving a balance between these two typically conflicting objectives remains a…

信息检索 · 计算机科学 2026-04-10 Elaheh Lotfian , Alireza Kabgani