English
Related papers

Related papers: Bridging the Evaluation Gap: Standardized Benchmar…

200 papers

The lack of generalization in learning-based autonomous driving applications is shown by the narrow range of road scenarios that vehicles can currently cover. A generalizable approach should capture many distinct road structures and…

Machine Learning · Computer Science 2025-04-25 Juan Carlos Climent Pardo

Route planning also known as pathfinding is one of the key elements in logistics, mobile robotics and other applications, where engineers face many conflicting objectives. However, most of the current route planning algorithms consider only…

Neural and Evolutionary Computing · Computer Science 2021-08-18 Jens Weise , Sanaz Mostaghim

Robots have the potential to perform search for a variety of applications under different scenarios. Our work is motivated by humanitarian assistant and disaster relief (HADR) where often it is critical to find signs of life in the presence…

Despite the growing popularity of Multimodal Domain Generalization (MMDG) for enhancing model robustness, it remains unclear whether reported performance gains reflect genuine algorithmic progress or are artifacts of inconsistent evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Hao Dong , Hongzhao Li , Shupan Li , Muhammad Haris Khan , Eleni Chatzi , Olga Fink

Developing autonomous driving systems for complex traffic environments requires balancing multiple objectives, such as avoiding collisions, obeying traffic rules, and making efficient progress. In many situations, these objectives cannot be…

The majority of multi-agent system (MAS) implementations aim to optimise agents' policies with respect to a single objective, despite the fact that many real-world problem domains are inherently multi-objective in nature. Multi-objective…

Multiagent Systems · Computer Science 2020-11-17 Roxana Rădulescu , Patrick Mannion , Diederik M. Roijers , Ann Nowé

A fundamental problem in robotic perception is matching identical objects or data, with applications such as loop closure detection, place recognition, object tracking, and map fusion. While the problem becomes considerably more challenging…

Robotics · Computer Science 2021-12-01 Parker C. Lusk , Ronak Roy , Kaveh Fathian , Jonathan P. How

Standardized benchmarks have been crucial in pushing the performance of computer vision algorithms, especially since the advent of deep learning. Although leaderboards should not be over-claimed, they often provide the most objective…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Patrick Dendorfer , Aljoša Ošep , Anton Milan , Konrad Schindler , Daniel Cremers , Ian Reid , Stefan Roth , Laura Leal-Taixé

The ongoing advancements in network architecture design have led to remarkable achievements in deep learning across various challenging computer vision tasks. Meanwhile, the development of neural architecture search (NAS) has provided…

Neural and Evolutionary Computing · Computer Science 2023-04-19 Zhichao Lu , Ran Cheng , Yaochu Jin , Kay Chen Tan , Kalyanmoy Deb

This work addresses a Multi-Objective Shortest Path Problem (MO-SPP) on a graph where the goal is to find a set of Pareto-optimal solutions from a start node to a destination in the graph. A family of approaches based on MOA* have been…

Artificial Intelligence · Computer Science 2022-05-31 Zhongqiang Ren , Richard Zhan , Sivakumar Rathinam , Maxim Likhachev , Howie Choset

Dynamic multi-objective optimization with a changing number of objectives has recently attracted increasing attention due to its relevance to real-world problems whose evaluation criteria may evolve over time. However, existing benchmark…

Neural and Evolutionary Computing · Computer Science 2026-05-26 Ke Shang , Zhiyun Xiao , Yuxuan Liu , Jianguo Li , Shaojiang Wang , Wei Sun

Finding correspondences between 3D deformable shapes is an important and long-standing problem in geometry processing, computer vision, graphics, and beyond. While various shape matching datasets exist, they are mostly static or limited in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Viktoria Ehm , Nafie El Amrani , Yizheng Xie , Lennart Bastian , Maolin Gao , Weikang Wang , Lu Sang , Dongliang Cao , Tobias Weißberg , Zorah Lähner , Daniel Cremers , Florian Bernard

We present a review that unifies decision-support methods for exploring the solutions produced by multi-objective optimization (MOO) algorithms. As MOO is applied to solve diverse problems, approaches for analyzing the trade-offs offered by…

Artificial Intelligence · Computer Science 2023-11-21 Zuzanna Osika , Jazmin Zatarain Salazar , Diederik M. Roijers , Frans A. Oliehoek , Pradeep K. Murukannaiah

Direct Multisearch (DMS) is a Derivative-free Optimization class of algorithms suited for computing approximations to the complete Pareto front of a given Multiobjective Optimization problem. It has a well-supported convergence analysis and…

Optimization and Control · Mathematics 2021-05-10 S. Tavares , C. P. Brás , A. L. Custódio , V. Duarte , P. Medeiros

The rapidly developing field of large multimodal models (LMMs) has led to the emergence of diverse models with remarkable capabilities. However, existing benchmarks fail to comprehensively, objectively and accurately evaluate whether LMMs…

Advancing Multi-Agent Pathfinding (MAPF) and Multi-Robot Motion Planning (MRMP) requires platforms that enable transparent, reproducible comparisons across modeling choices. Existing tools either scale under simplifying assumptions (grids,…

To date, the multi-objective optimization literature has mainly focused on conflicting objectives, studying the Pareto front, or requiring users to balance tradeoffs. Yet, in machine learning practice, there are many scenarios where such…

Machine Learning · Computer Science 2025-03-05 Yonathan Efroni , Ben Kretzu , Daniel Jiang , Jalaj Bhandari , Zheqing , Zhu , Karen Ullrich

Multiple object tracking is a critical task in autonomous driving. Existing works primarily focus on the heuristic design of neural networks to obtain high accuracy. As tracking accuracy improves, however, neural networks become…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chensheng Peng , Zhaoyu Zeng , Jinling Gao , Jundong Zhou , Masayoshi Tomizuka , Xinbing Wang , Chenghu Zhou , Nanyang Ye

While Multi-Agent Systems (MAS) show potential for complex clinical decision support, the field remains hindered by architectural fragmentation and the lack of standardized multimodal integration. Current medical MAS research suffers from…

Artificial Intelligence · Computer Science 2026-03-20 Yunhang Qian , Xiaobin Hu , Jiaquan Yu , Siyang Xin , Xiaokun Chen , Jiangning Zhang , Peng-Tao Jiang , Jiawei Liu , Hongwei Bran Li

With modern requirements, there is an increasing tendency of considering multiple objectives/criteria simultaneously in many Software Engineering (SE) scenarios. Such a multi-objective optimization scenario comes with an important issue --…

Software Engineering · Computer Science 2020-12-01 Miqing Li , Tao Chen , Xin Yao