English
Related papers

Related papers: Objective Improvement in Information-Geometric Opt…

200 papers

Parametric multi-objective optimization (PMO) addresses the challenge of solving an infinite family of multi-objective optimization problems, where optimal solutions must adapt to varying parameters. Traditional methods require re-execution…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Ji Cheng , Bo Xue , Qingfu Zhang

Deformable image registration is inherently a multi-objective optimization (MOO) problem, requiring a delicate balance between image similarity and deformation regularity. These conflicting objectives often lead to poor optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yi Zhang , Yidong Zhao , Qian Tao

The Rapid Iterative FiTting (RIFT) parameter inference algorithm provides a framework for efficient, highly-parallelized parameter inference for GW sources. In this paper, we summarize essential algorithm enhancements and operating point…

General Relativity and Quantum Cosmology · Physics 2023-02-03 J. Wofford , A. Yelikar , H. Gallagher , E. Champion , D. Wysocki , V. Delfavero , J. Lange , C. Rose , V. Valsan , S. Morisaki , J. Read , C. Henshaw , R. O'Shaughnessy

The reconstruction of gap-free signals from observation data is a critical challenge for numerous application domains, such as geoscience and space-based earth observation, when the available sensors or the data collection processes lead to…

Image and Video Processing · Electrical Eng. & Systems 2022-11-15 Maxime Beauchamp , Joseph Thompson , Hugo Georgenthum , Quentin Febvre , Ronan Fablet

We introduce a principled learning to optimize (L2O) framework for solving fixed-point problems involving general nonexpansive mappings. Our idea is to deliberately inject summable perturbations into a standard Krasnosel'skii-Mann iteration…

Systems and Control · Electrical Eng. & Systems 2026-01-13 Andrea Martin , Giuseppe Belgioioso

Large language models have demonstrated remarkable capabilities, but their performance is heavily reliant on effective prompt engineering. Automatic prompt optimization (APO) methods are designed to automate this and can be broadly…

Computation and Language · Computer Science 2024-11-08 Xingchen Wan , Ruoxi Sun , Hootan Nakhost , Sercan O. Arik

Preference Optimization (PO), is gaining popularity as an alternative choice of Proximal Policy Optimization (PPO) for aligning Large Language Models (LLMs). Recent research on aligning LLMs iteratively with synthetic or partially synthetic…

Computation and Language · Computer Science 2024-09-16 Yaojie Shen , Xinyao Wang , Yulei Niu , Ying Zhou , Lexin Tang , Libo Zhang , Fan Chen , Longyin Wen

We present a reformulation of stochastic global optimization as a filtering problem. The motivation behind this reformulation comes from the fact that for many optimization problems we cannot evaluate exactly the objective function to be…

Numerical Analysis · Mathematics 2009-12-22 Panagiotis Stinis

Black-box global optimization aims at minimizing an objective function whose analytical form is not known. To do so, many state-of-the-art methods rely on sampling-based strategies, where sampling distributions are built in an iterative…

Optimization and Control · Mathematics 2024-09-30 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

Profile Guided Optimization (PGO) uses runtime profiling to direct compiler optimization decisions, effectively combining static analysis with actual execution behavior to enhance performance. Runtime profiles, collected through…

Performance · Computer Science 2025-07-23 Bingxin Liu , Yinghui Huang , Jianhua Gao , Jianjun Shi , Yongpeng Liu , Yipin Sun , Weixing Ji

A robust-to-dynamics optimization (RDO) problem is an optimization problem specified by two pieces of input: (i) a mathematical program (an objective function $f:\mathbb{R}^n\rightarrow\mathbb{R}$ and a feasible set…

Optimization and Control · Mathematics 2023-11-27 Amir Ali Ahmadi , Oktay Gunluk

In the last twenty-five years (1990-2014), algorithmic advances in integer optimization combined with hardware improvements have resulted in an astonishing 200 billion factor speedup in solving Mixed Integer Optimization (MIO) problems. We…

Methodology · Statistics 2015-07-14 Dimitris Bertsimas , Angela King , Rahul Mazumder

We develop and analyse an approach to optimize functions $l\colon \mathbb{R}^d \rightarrow \mathbb{R}$ not assumed to be convex, differentiable or even continuous. The algorithm belongs to the class of model-based search methods. The idea…

Computation · Statistics 2025-12-04 Christophe Andrieu , Nicolas Chopin , Ettore Fincato , Mathieu Gerber

In this work we are interested in stochastic particle methods for multi-objective optimization. The problem is formulated using parametrized, single-objective sub-problems which are solved simultaneously. To this end a consensus based…

Optimization and Control · Mathematics 2022-08-03 Giacomo Borghi , Michael Herty , Lorenzo Pareschi

As we know, some global optimization problems cannot be solved using analytic methods, so numeric/algorithmic approaches are used to find near to the optimal solutions for them. A stochastic global optimization algorithm (SGoal) is an…

Artificial Intelligence · Computer Science 2017-06-08 Jonatan Gomez

Large Language Models (LLMs) have driven substantial progress in artificial intelligence in recent years, exhibiting impressive capabilities across a wide range of tasks, including mathematical problem-solving. Inspired by the success of…

Computation and Language · Computer Science 2023-10-20 Xueliang Zhao , Xinting Huang , Wei Bi , Lingpeng Kong

Traditional RL algorithms like Proximal Policy Optimization (PPO) typically train on the entire rollout buffer, operating under the assumption that all generated episodes provide a beneficial optimization signal. However, these episodes…

Machine Learning · Computer Science 2026-04-03 Dong Shu , Denghui Zhang , Jessica Hullman

This paper presents an Improved Bayesian Optimization (IBO) algorithm to solve complex high-dimensional epidemic models' optimal control solution. Evaluating the total objective function value for disease control models with hundreds of…

Methodology · Statistics 2021-08-03 Yuyang Chen , Kaiming Bi , Chih-Hang J. Wu , David Ben-Arieh , Ashesh Sinha

Machine learning algorithms minimizing average risk are susceptible to distributional shifts. Distributionally Robust Optimization (DRO) addresses this issue by optimizing the worst-case risk within an uncertainty set. However, DRO suffers…

Machine Learning · Computer Science 2023-11-10 Jiashuo Liu , Jiayun Wu , Tianyu Wang , Hao Zou , Bo Li , Peng Cui

While Retrieval-Augmented Generation (RAG) has exhibited promise in utilizing external knowledge, its generation process heavily depends on the quality and accuracy of the retrieved context. Large language models (LLMs) struggle to evaluate…

Computation and Language · Computer Science 2025-10-13 Shi-Qi Yan , Quan Liu , Zhen-Hua Ling