English
Related papers

Related papers: What Weights Work for You? Adapting Weights for An…

200 papers

Weight-sharing neural architecture search aims to optimize a configurable neural network model (supernet) for a variety of deployment scenarios across many devices with different resource constraints. Existing approaches use evolutionary…

Machine Learning · Computer Science 2023-07-04 Achintya Kundu , Laura Wynter , Rhui Dih Lee , Luis Angel Bathen

The goal of constrained multiobjective evolutionary optimization is to obtain a set of well-converged and welldistributed feasible solutions. To complete this goal, there should be a tradeoff among feasibility, diversity, and convergence.…

Neural and Evolutionary Computing · Computer Science 2023-01-10 Bing-Chuan Wang , Yunchuan Qin , Xian-Bing Meng , Zhi-Zhong Liu

Recent work such as AlphaEvolve has shown that combining LLM-driven optimization with evolutionary search can effectively improve programs, prompts, and algorithms across domains. In this paradigm, previously evaluated solutions are reused…

The goal of multi-objective optimisation is to identify the Pareto front surface which is the set obtained by connecting the best trade-off points. Typically this surface is computed by evaluating the objectives at different points and then…

Machine Learning · Statistics 2024-06-24 Ben Tu , Nikolas Kantas , Robert M. Lee , Behrang Shafei

Multi-objective optimization (MOO) problems are prevalent in machine learning. These problems have a set of optimal solutions, called the Pareto front, where each point on the front represents a different trade-off between possibly…

Machine Learning · Computer Science 2021-04-27 Aviv Navon , Aviv Shamsian , Gal Chechik , Ethan Fetaya

Residual-based adaptive strategies are widely used in scientific machine learning but remain largely heuristic. We introduce a unifying variational framework that formalizes these methods by integrating convex transformations of the…

Machine Learning · Computer Science 2025-09-29 Juan Diego Toscano , Daniel T. Chen , Vivek Oommen , Jérôme Darbon , George Em Karniadakis

To obtain good performance, convolutional neural networks are usually over-parameterized. This phenomenon has stimulated two interesting topics: pruning the unimportant weights for compression and reactivating the unimportant weights to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Zhenquan Lin , Kailing Guo , Xiaofen Xing , Xiangmin Xu

Neural text matching models have been used in a range of applications such as question answering and natural language inference, and have yielded a good performance. However, these neural models are of a limited adaptability, resulting in a…

Information Retrieval · Computer Science 2022-05-23 Bo Zhang , Chen Zhang , Fang Ma , Dawei Song

Many-objective evolutionary algorithms (MOEAs), especially the decomposition-based MOEAs, have attracted wide attention in recent years. Recent studies show that a well designed combination of the decomposition method and the domination…

Neural and Evolutionary Computing · Computer Science 2019-09-05 Yingyu Zhang , Yuanzhen Li , Quan-Ke Panb , P. N. Suganthan

Recently, evolutionary multitasking has been employed to generate a ``set of Pareto sets" (SOS) for machine learning models, addressing diverse task settings across heterogeneous environments. This involves creating a repository of compact,…

Neural and Evolutionary Computing · Computer Science 2026-04-07 Jiao Liu , Yew Soon Ong , Melvin Wong

Normalization of objectives plays a crucial role in evolutionary multi-objective optimization (EMO) to handle objective functions with different scales, which can be found in real-world problems. Although the effect of normalization methods…

Neural and Evolutionary Computing · Computer Science 2023-07-14 Ryoji Tanabe

Decentralised learning enables the training of deep learning algorithms without centralising data sets, resulting in benefits such as improved data privacy, operational efficiency and the fostering of data ownership policies. However,…

Machine Learning · Computer Science 2024-12-23 Sebastian Niehaus , Ingo Roeder , Nico Scherf

Parameterized analysis provides powerful mechanisms for obtaining fine-grained insights into different types of algorithms. In this work, we combine this field with evolutionary algorithms and provide parameterized complexity analysis of…

Combinatorics · Mathematics 2023-03-22 Samuel Baguley , Tobias Friedrich , Aneta Neumann , Frank Neumann , Marcus Pappik , Ziena Zeif

In multi-objective optimization, computing the entire non-dominated set (also known as the Pareto front or the Pareto frontier) is often intractable. However, for any multiplicative factor greater than one, an approximation set can be…

Optimization and Control · Mathematics 2026-04-30 Levin Nemesch , Stefan Ruzika , Clemens Thielen , Alina Wittmann

Multiobjective combinatorial optimization deals with problems considering more than one viewpoint or scenario. The problem of aggregating multiple criteria to obtain a globalizing objective function is of special interest when the number of…

Optimization and Control · Mathematics 2013-06-07 Elena Fernández , Miguel A. Pozo , Justo Puerto

Efficient fine-tuning of pre-trained Text-to-Image (T2I) models involves adjusting the model to suit a particular task or dataset while minimizing computational resources and limiting the number of trainable parameters. However, it often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Komal Kumar , Rao Muhammad Anwer , Fahad Shahbaz Khan , Salman Khan , Ivan Laptev , Hisham Cholakkal

In this paper, we develop a global descent method for non-convex multi-objective optimization problems. The proposed approach builds upon foundational concepts from single-objective global descent techniques while removing the need for…

Optimization and Control · Mathematics 2025-07-31 Bikram Adhikary , Md Abu Talhamainuddin Ansary , Savin Treanta

Hypervolume is widely used in the evolutionary multi-objective optimization (EMO) field to evaluate the quality of a solution set. For a solution set with $\mu$ solutions on a Pareto front, a larger hypervolume means a better solution set.…

Neural and Evolutionary Computing · Computer Science 2021-07-01 Ke Shang , Hisao Ishibuchi , Weiyu Chen , Yang Nan , Weiduo Liao

We investigate an evolutionary multi-objective approach to good micro for real-time strategy games. Good micro helps a player win skirmishes and is one of the keys to developing better real-time strategy game play. In prior work, the same…

Neural and Evolutionary Computing · Computer Science 2018-03-29 Rahul Dubey , Joseph Ghantous , Sushil Louis , Siming Liu

In the domain of multi-objective optimization, evolutionary algorithms are distinguished by their capability to generate a diverse population of solutions that navigate the trade-offs inherent among competing objectives. This has catalyzed…

Neural and Evolutionary Computing · Computer Science 2025-01-07 Yuxin Ma , Zherui Zhang , Ran Cheng , Yaochu Jin , Kay Chen Tan