English
Related papers

Related papers: Multi-objective Differentiable Neural Architecture…

200 papers

This work addresses a Multi-Objective Shortest Path Problem (MO-SPP) on a graph where the goal is to find a set of Pareto-optimal solutions from a start node to a destination in the graph. A family of approaches based on MOA* have been…

Artificial Intelligence · Computer Science 2022-05-31 Zhongqiang Ren , Richard Zhan , Sivakumar Rathinam , Maxim Likhachev , Howie Choset

Many hardware-aware neural architecture search (NAS) methods have been developed to optimize the topology of neural networks (NN) with the joint objectives of higher accuracy and lower latency. Recently, both accuracy and latency predictors…

Machine Learning · Computer Science 2023-06-06 Yash Akhauri , Mohamed S. Abdelfattah

Multi-Objective Optimization (MOO) techniques have become increasingly popular in recent years due to their potential for solving real-world problems in various fields, such as logistics, finance, environmental management, and engineering.…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Noor A. Rashed , Yossra H. Ali , Tarik A. Rashid , A. Salih

Designing feasible and effective architectures under diverse computation budgets incurred by different applications/devices is essential for deploying deep models in practice. Existing methods often perform an independent architecture…

Machine Learning · Computer Science 2021-03-02 Yong Guo , Yaofo Chen , Yin Zheng , Qi Chen , Peilin Zhao , Jian Chen , Junzhou Huang , Mingkui Tan

Performance optimization of deep learning models is conducted either manually or through automatic architecture search, or a combination of both. On the other hand, their performance strongly depends on the target hardware and how…

Machine Learning · Computer Science 2022-09-23 Vahid Partovi Nia , Alireza Ghaffari , Mahdi Zolnouri , Yvon Savaria

Pareto Front Learning (PFL) was recently introduced as an effective approach to obtain a mapping function from a given trade-off vector to a solution on the Pareto front, which solves the multi-objective optimization (MOO) problem. Due to…

Machine Learning · Computer Science 2023-05-02 Long P. Hoang , Dung D. Le , Tran Anh Tuan , Tran Ngoc Thang

The design of machine learning systems often requires trading off different objectives, for example, prediction error and energy consumption for deep neural networks (DNNs). Typically, no single design performs well in all objectives;…

Machine Learning · Computer Science 2022-08-23 Md Shahriar Iqbal , Jianhai Su , Lars Kotthoff , Pooyan Jamshidi

Optimization of materials performance for specific applications often requires balancing multiple aspects of materials functionality. Even for the cases where generative physical model of material behavior is known and reliable, this often…

Materials Science · Physics 2021-12-15 Arpan Biswas , Anna N. Morozovska , Maxim Ziatdinov , Eugene A. Eliseev , Sergei V. Kalinin

Multi-objective optimization (MOO) exists extensively in machine learning, and aims to find a set of Pareto-optimal solutions, called the Pareto front, e.g., it is fundamental for multiple avenues of research in federated learning (FL).…

Machine Learning · Computer Science 2025-05-28 Mengmeng Chen , Xiaohu Wu , Qiqi Liu , Tiantian He , Yew-Soon Ong , Yaochu Jin , Qicheng Lao , Han Yu

Neural architecture search (NAS) is a hard computationally expensive optimization problem with a discrete, vast, and spiky search space. One of the key research efforts dedicated to this space focuses on accelerating NAS via certain proxy…

Machine Learning · Computer Science 2025-09-09 Bo Lyu , Yu Cui , Tuo Shi , Ke Li

any practical multiobjective optimization (MOO) problems include discrete decision variables and/or nonlinear model equations and exhibit disconnected or smooth but nonconvex Pareto surfaces. Scalarization methods, such as the weighted-sum…

Optimization and Control · Mathematics 2024-10-23 Ye Seol Lee , George Jackson , Amparo Galindo , Claire S. Adjiman

An important step in the task of neural network design, such as hyper-parameter optimization (HPO) or neural architecture search (NAS), is the evaluation of a candidate model's performance. Given fixed computational resources, one can…

Machine Learning · Computer Science 2021-03-09 Shengcao Cao , Xiaofang Wang , Kris Kitani

Automated experimentation has the potential to revolutionize scientific discovery, but its effectiveness depends on well-defined optimization targets, which are often uncertain or probabilistic in real-world settings. In this work, we…

Machine Learning · Computer Science 2025-04-10 Yu Liu , Sergei V. Kalinin

Multi-task learning (MTL), which aims to improve performance by learning multiple tasks simultaneously, inherently presents an optimization challenge due to multiple objectives. Hence, multi-objective optimization (MOO) approaches have been…

Artificial Intelligence · Computer Science 2021-10-08 Simyung Chang , KiYoon Yoo , Jiho Jang , Nojun Kwak

Path planning is one of the most vital elements of mobile robotics, providing the agent with a collision-free route through the workspace. The global path plan can be calculated with a variety of informed search algorithms, most notably the…

Artificial Intelligence · Computer Science 2015-11-04 Alexander Lavin

Multi-Objective Markov Decision Processes (MO-MDPs) are receiving increasing attention, as real-world decision-making problems often involve conflicting objectives that cannot be addressed by a single-objective MDP. The Pareto front…

Machine Learning · Computer Science 2025-02-11 Yining Li , Peizhong Ju , Ness B. Shroff

Recent studies on neural architecture search have shown that automatically designed neural networks perform as good as expert-crafted architectures. While most existing works aim at finding architectures that optimize the prediction…

An important challenge in multi-objective reinforcement learning is obtaining a Pareto front of policies to attain optimal performance under different preferences. We introduce Iterated Pareto Referent Optimisation (IPRO), which decomposes…

Machine Learning · Computer Science 2025-02-07 Willem Röpke , Mathieu Reymond , Patrick Mannion , Diederik M. Roijers , Ann Nowé , Roxana Rădulescu

We consider the problem of multi-objective (MO) blackbox optimization using expensive function evaluations, where the goal is to approximate the true Pareto set of solutions while minimizing the number of function evaluations. For example,…

Machine Learning · Computer Science 2022-04-13 Syrine Belakaria , Aryan Deshwal , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

As machine learning (ML) algorithms get deployed in an ever-increasing number of applications, these algorithms need to achieve better trade-offs between high accuracy, high throughput and low latency. This paper introduces NASH, a novel…

Machine Learning · Computer Science 2024-03-12 Mengfei Ji , Yuchun Chang , Baolin Zhang , Zaid Al-Ars