English
Related papers

Related papers: BMOBench: Black-Box Multi-Objective Optimization B…

200 papers

The deployment of Large Language Models (LLMs) and Large Multimodal Models (LMMs) on mobile devices has gained significant attention due to the benefits of enhanced privacy, stability, and personalization. However, the hardware constraints…

Over the last three decades, a large number of evolutionary algorithms have been developed for solving multiobjective optimization problems. However, there lacks an up-to-date and comprehensive software platform for researchers to properly…

Neural and Evolutionary Computing · Computer Science 2017-10-19 Ye Tian , Ran Cheng , Xingyi Zhang , Yaochu Jin

Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to…

Machine Learning · Computer Science 2023-05-04 Natalie Maus , Kaiwen Wu , David Eriksson , Jacob Gardner

Although multimodal fusion has made significant progress, its advancement is severely hindered by the lack of adequate evaluation benchmarks. Current fusion methods are typically evaluated on a small selection of public datasets, a limited…

Machine Learning · Computer Science 2026-05-07 Leyan Xue , Changqing Zhang , Kecheng Xue , Xiaohong Liu , Guangyu Wang , Zongbo Han

Various methods for robot design optimization have been developed so far. These methods are diverse, ranging from numerical optimization to black-box optimization. While numerical optimization is fast, it is not suitable for cases involving…

Robotics · Computer Science 2026-02-19 Kento Kawaharazuka , Yoshiki Obinata , Naoaki Kanazawa , Haoyu Jia , Kei Okada

As models become increasingly sophisticated, conventional algorithm benchmarks are increasingly saturated, underscoring the need for more challenging benchmarks to guide future improvements in algorithmic reasoning. This paper introduces…

Artificial Intelligence · Computer Science 2025-06-13 Yaoming Zhu , Junxin Wang , Yiyang Li , Lin Qiu , ZongYu Wang , Jun Xu , Xuezhi Cao , Yuhuai Wei , Mingshi Wang , Xunliang Cai , Rong Ma

We focus on collaborative and federated black-box optimization (BBOpt), where agents optimize their heterogeneous black-box functions through collaborative sequential experimentation. From a Bayesian optimization perspective, we address the…

Machine Learning · Computer Science 2025-08-25 Raed Al Kontar

In the recent past, the computer vision community has developed centralized benchmarks for the performance evaluation of a variety of tasks, including generic object and pedestrian detection, 3D reconstruction, optical flow, single-object…

Computer Vision and Pattern Recognition · Computer Science 2015-04-09 Laura Leal-Taixé , Anton Milan , Ian Reid , Stefan Roth , Konrad Schindler

Multi-objective search (MOS) has emerged as a unifying framework for planning and decision-making problems where multiple, often conflicting, criteria must be balanced. While the problem has been studied for decades, recent years have seen…

Artificial Intelligence · Computer Science 2025-10-30 Oren Salzman , Carlos Hernández Ulloa , Ariel Felner , Sven Koenig

Document classification forms the backbone of modern enterprise content management, yet existing benchmarks remain trapped in oversimplified paradigms -- single domain settings with flat label structures -- that bear little resemblance to…

Computation and Language · Computer Science 2026-05-15 Denghao Ma , Qing Liu , Zulong Chen , Chuanfei Xu , Jia Xu , Zhibo Yang , Wei Shao , Zhao Li

Multi-objective optimization aims to solve problems with competing objectives. Evaluating such problems is often slow or expensive, limiting the budget of evaluations. In many applications, historical data from related optimization tasks is…

Machine Learning · Computer Science 2026-05-12 Leonard Papenmeier , Petru Tighineanu

Existing benchmarks for multimodal memory reasoning largely evaluate systems within pre-assembled contexts, but under-evaluate whether agents can use evidence distributed across independently originated sources. We argue that…

Computation and Language · Computer Science 2026-05-18 Huacan Chai , Yukai Wang , Yingxuan Yang , Dan Peng , Yuanyi Song , Zhihui Fu , Weiwen Liu , Jianghao Lin , Jun Wang , Weinan Zhang

Compared to typical multi-sensor systems, monocular 3D object detection has attracted much attention due to its simple configuration. However, there is still a significant gap between LiDAR-based and monocular-based methods. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Chenxi Huang , Tong He , Haidong Ren , Wenxiao Wang , Binbin Lin , Deng Cai

Model merging provides a scalable alternative to multi-task training by combining specialized finetuned models through parameter arithmetic, enabling efficient deployment without the need for joint training or access to all task data. While…

Machine Learning · Computer Science 2025-10-21 Yifei He , Siqi Zeng , Yuzheng Hu , Rui Yang , Tong Zhang , Han Zhao

Entity summarization is the problem of computing an optimal compact summary for an entity by selecting a size-constrained subset of triples from RDF data. Entity summarization supports a multiplicity of applications and has led to fruitful…

Information Retrieval · Computer Science 2020-03-26 Qingxia Liu , Gong Cheng , Kalpa Gunaratna , Yuzhong Qu

For solving constrained multicriteria problems, we introduce the multiobjective barrier method (MBM), which extends the scalar-valued internal penalty method. This multiobjective version of the classical method also requires a penalty…

Optimization and Control · Mathematics 2018-04-02 Ellen H. Fukuda , L. M. Grana Drummond , Fernanda M. P. Raupp

There is a long history in machine learning of model ensembling, beginning with boosting and bagging and continuing to the present day. Much of this history has focused on combining models for classification and regression, but recently…

Machine Learning · Computer Science 2024-05-28 Ira Globus-Harris , Varun Gupta , Michael Kearns , Aaron Roth

The academic evolution of process mining is moving toward object centric process mining, marking a significant shift in how processes are modeled and analyzed. IBM has developed its own distinctive approach called Multilevel Process Mining.…

We introduce ISO-Bench, a benchmark for coding agents to test their capabilities on real-world inference optimization tasks. These tasks were taken from vLLM and SGLang, two of the most popular LLM serving frameworks. Each task provides an…

Machine Learning · Computer Science 2026-02-24 Ayush Nangia , Shikhar Mishra , Aman Gokrani , Paras Chopra

Molecular dynamics (MD) simulations provide considerable benefits for the investigation and experimentation of systems at atomic level. Their usage is widespread into several research fields, but their system size and timescale are also…