English
Related papers

Related papers: Optuna: A Next-generation Hyperparameter Optimizat…

200 papers

Machine learning techniques have been paramount throughout the last years, being applied in a wide range of tasks, such as classification, object recognition, person identification, and image segmentation. Nevertheless, conventional…

Machine Learning · Computer Science 2021-08-03 Gustavo Henrique de Rosa , João Paulo Papa , Alexandre Xavier Falcão

Modern learning models are characterized by large hyperparameter spaces and long training times. These properties, coupled with the rise of parallel computing and the growing demand to productionize machine learning workloads, motivate the…

Machine Learning · Computer Science 2020-03-17 Liam Li , Kevin Jamieson , Afshin Rostamizadeh , Ekaterina Gonina , Moritz Hardt , Benjamin Recht , Ameet Talwalkar

The article discusses the concept of hyperparametric optimization of recommendation algorithms using an integral assessment that combines various performance indicators into a single consolidated criterion. This approach is opposed to…

Machine Learning · Computer Science 2025-08-29 Roman S. Kulshin , Anatoly A. Sidorov

Application-specific optical processors have been considered disruptive technologies for modern computing that can fundamentally accelerate the development of artificial intelligence (AI) by offering substantially improved computing…

Image and Video Processing · Electrical Eng. & Systems 2021-05-26 Tiankuang Zhou , Xing Lin , Jiamin Wu , Yitong Chen , Hao Xie , Yipeng Li , Jintao Fan , Huaqiang Wu , Lu Fang , Qionghai Dai

The synthesis of optimization algorithms typically follows a design-first-analyze-later approach, which often obscures fundamental performance limitations and hinders the systematic design of algorithms operating at the achievable…

Optimization and Control · Mathematics 2025-11-14 Ibrahim K. Ozaslan , Tryphon T. Georgiou , Mihailo R. Jovanovic

The scenario approach is an established data-driven design framework that comes equipped with a powerful theory linking design complexity to generalization properties. In this approach, data are simultaneously used both for design and for…

Methodology · Statistics 2026-02-18 Algo Carè , Marco C. Campi , Simone Garatti

Our work revisits the design of mechanisms via the learning-augmented framework. In this model, the algorithm is enhanced with imperfect (machine-learned) information concerning the input, usually referred to as prediction. The goal is to…

Computer Science and Game Theory · Computer Science 2024-10-29 George Christodoulou , Alkmini Sgouritsa , Ioannis Vlachos

With the advent of software-defined networking, network configuration through programmable interfaces becomes practical, leading to various on-demand opportunities for network routing update in multi-tenant datacenters, where tenants have…

Cryptography and Security · Computer Science 2020-06-19 Zhuotao Liu , Yuan Cao , Xuewu Zhang , Changping Zhu , Fan Zhang

Many Hadoop configuration parameters have significant influence in the performance of running MapReduce jobs on Hadoop. It is time-consuming and tedious for general users to manually tune the parameters for optimal MapReduce performance.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-01 Donghua Chen

Hyperparameter optimization (HPO) is of paramount importance in the development of high-performance, specialized artificial intelligence (AI) models, ranging from well-established machine learning (ML) solutions to the deep learning (DL)…

Neural and Evolutionary Computing · Computer Science 2025-10-21 Vittorio Fra

We present AutoBencher, a declarative framework for automatic benchmark construction, and use it to scalably discover novel insights and vulnerabilities of existing language models. Concretely, given a few desiderata of benchmarks (e.g.,…

Computation and Language · Computer Science 2025-03-03 Xiang Lisa Li , Farzaan Kaiyom , Evan Zheran Liu , Yifan Mai , Percy Liang , Tatsunori Hashimoto

Online learning is the cornerstone of applications like recommendation and advertising systems, where models continuously adapt to shifting data distributions. Model training for such systems is remarkably expensive, a cost that multiplies…

Machine Learning · Computer Science 2025-12-02 Berivan Isik , Matthew Fahrbach , Dima Kuzmin , Nicolas Mayoraz , Emil Praun , Steffen Rendle , Raghavendra Vasudeva

Research software refers to software development tools that accelerate discovery and simplifies access to digital infrastructures. However, although research software platforms can be built increasingly more innovative and powerful than…

Software Engineering · Computer Science 2018-12-27 Doug Mulholland , Paulo Alencar , Donald Cowan

Metamaterials are artificial materials designed to exhibit effective material parameters that go beyond those found in nature. Composed of unit cells with rich designability that are assembled into multiscale systems, they hold great…

Computational Engineering, Finance, and Science · Computer Science 2023-12-07 Doksoo Lee , Wei Wayne Chen , Liwei Wang , Yu-Chin Chan , Wei Chen

A large-scale industrial recommendation platform typically consists of multiple associated scenarios, requiring a unified click-through rate (CTR) prediction model to serve them simultaneously. Existing approaches for multi-scenario CTR…

Information Retrieval · Computer Science 2023-06-26 Xing Tang , Yang Qiao , Yuwen Fu , Fuyuan Lyu , Dugang Liu , Xiuqiang He

Optimal designs are usually model-dependent and likely to be sub-optimal if the postulated model is not correctly specified. In practice, it is common that a researcher has a list of candidate models at hand and a design has to be found…

Statistics Theory · Mathematics 2023-03-29 Mingyao Ai , Holger Dette , Zhengfu Liu , Jun Yu

We investigate the capabilities and scalability of Large Language Models (LLMs) in optimization modeling, a domain requiring structured reasoning and precise formulation. To this end, we introduce OPT-ENGINE, an extensible benchmark…

Computation and Language · Computer Science 2026-05-15 Yitian Chen , Cheng Cheng , Yinan Sun , Zi Ling , Dongdong Ge

Optimization has been widely used to generate smooth trajectories for motion planning. However, existing trajectory optimization methods show weakness when dealing with large-scale long trajectories. Recent advances in parallel computing…

Robotics · Computer Science 2025-07-18 Jiajun Yu , Nanhe Chen , Guodong Liu , Chao Xu , Fei Gao , Yanjun Cao

One-Shot Neural Architecture Search (NAS) algorithms often rely on training a hardware agnostic super-network for a domain specific task. Optimal sub-networks are then extracted from the trained super-network for different hardware…

Machine Learning · Computer Science 2023-08-31 Sharath Nittur Sridhar , Souvik Kundu , Sairam Sundaresan , Maciej Szankin , Anthony Sarah

Prediction of material properties from first principles is often a computationally expensive task. Recently, artificial neural networks and other machine learning approaches have been successfully employed to obtain accurate models at a low…

Computational Physics · Physics 2020-07-15 Ruggero Lot , Franco Pellegrini , Yusuf Shaidu , Emine Kucukbenli