English
Related papers

Related papers: Multinoulli Extension: A Lossless Continuous Relax…

200 papers

Optimization of expensive computer models with the help of Gaussian process emulators in now commonplace. However, when several (competing) objectives are considered, choosing an appropriate sampling strategy remains an open question. We…

Optimization and Control · Mathematics 2013-10-03 Victor Picheny

In this paper, we consider a broad class of nonsmooth and nonconvex fractional programs, where the numerator can be written as the sum of a continuously differentiable convex function whose gradient is Lipschitz continuous and a proper…

Optimization and Control · Mathematics 2022-01-19 Radu Ioan Boţ , Minh N. Dao , Guoyin Li

We propose a unified deep meta-learning framework for accelerated magnetic resonance imaging (MRI) that jointly addresses multi-coil reconstruction and cross-modality synthesis. Motivated by the limitations of conventional methods in…

Optimization and Control · Mathematics 2026-03-10 Merham Fouladvand , Peuroly Batra

Motivated by robust dynamic resource allocation in operations research, we study the \textit{Online Learning to Transport} (OLT) problem where the decision variable is a probability measure, an infinite-dimensional object. We draw…

Machine Learning · Computer Science 2022-11-21 Wenxuan Guo , YoonHaeng Hur , Tengyuan Liang , Christopher Ryan

We consider the nonsmooth convex composition optimization problem where the objective is a composition of two finite-sum functions and analyze stochastic compositional variance reduced gradient (SCVRG) methods for them. SCVRG and its…

Optimization and Control · Mathematics 2019-08-01 Tianyi Lin , Chenyou Fan , Mengdi Wang

In real-world applications, it is important for machine learning algorithms to be robust against data outliers or corruptions. In this paper, we focus on improving the robustness of a large class of learning algorithms that are formulated…

Machine Learning · Computer Science 2021-06-04 Quanming Yao , Hangsi Yang , En-Liang Hu , James Kwok

This study tasckles the problem of many-objective sequence optimization for semi-automated robotic disassembly operations. To this end, we employ a many-objective genetic algorithm (MaOGA) algorithm inspired by the Non-dominated Sorting…

Robotics · Computer Science 2024-01-04 Takuya Kiyokawa , Kensuke Harada , Weiwei Wan , Tomoki Ishikura , Naoya Miyaji , Genichiro Matsuda

Feature subset selection, as a special case of the general subset selection problem, has been the topic of a considerable number of studies due to the growing importance of data-mining applications. In the feature subset selection problem…

Machine Learning · Computer Science 2014-11-13 Tofigh Naghibi , Sarah Hoffmann , Beat Pfister

In this paper, based on the limited memory techniques and subspace minimization conjugate gradient (SMCG) methods, a regularized limited memory subspace minimization conjugate gradient method is proposed, which contains two types of…

Optimization and Control · Mathematics 2023-01-10 Wumei Sun , Hongwei Liu , Zexian Liu

This paper considers the minimization of a continuously differentiable function over a cardinality constraint. We focus on smooth and relatively smooth functions. These smoothness criteria result in new descent lemmas. Based on the new…

Optimization and Control · Mathematics 2024-09-26 Fatih Selim Aktas , Mustafa Celebi Pinar

Problem decomposition plays a vital role when applying cooperative coevolution (CC) to large scale global optimization problems. However, most learning-based decomposition algorithms either only apply to additively separable problems or…

Neural and Evolutionary Computing · Computer Science 2021-01-20 An Chen , Zhigang Ren , Muyi Wang , Yongsheng Liang , Hanqing Liu , Wenhao Du

The Stochastic Extragradient (SEG) method is one of the most popular algorithms for solving min-max optimization and variational inequalities problems (VIP) appearing in various machine learning tasks. However, several important questions…

Optimization and Control · Mathematics 2022-02-23 Eduard Gorbunov , Hugo Berard , Gauthier Gidel , Nicolas Loizou

We consider maximization of stochastic monotone continuous submodular functions (CSF) with a diminishing return property. Existing algorithms only guarantee the performance \textit{in expectation}, and do not bound the probability of…

Data Structures and Algorithms · Computer Science 2023-03-22 Evan Becker , Jingdong Gao , Ted Zadouri , Baharan Mirzasoleiman

Two algorithms are proposed, analyzed, and tested for solving continuous optimization problems with nonlinear equality constraints. Each is an extension of a stochastic momentum-based method from the unconstrained setting to the setting of…

Optimization and Control · Mathematics 2026-01-21 Qi Wang , Christian Piermarini , Yunlang Zhu , Frank E. Curtis

In this paper, we consider the general non-oblivious stochastic optimization where the underlying stochasticity may change during the optimization procedure and depends on the point at which the function is evaluated. We develop Stochastic…

Optimization and Control · Mathematics 2020-09-10 Hamed Hassani , Amin Karbasi , Aryan Mokhtari , Zebang Shen

Quality of deep convolutional neural network predictions strongly depends on the size of the training dataset and the quality of the annotations. Creating annotations, especially for 3D medical image segmentation, is time-consuming and…

Image and Video Processing · Electrical Eng. & Systems 2023-05-11 Matin Hosseinzadeh , Anindo Saha , Joeran Bosma , Henkjan Huisman

In this paper, we propose a general class of algorithms for optimizing an extensive variety of nonsmoothly penalized objective functions that satisfy certain regularity conditions. The proposed framework utilizes the…

Computation · Statistics 2011-01-24 Elizabeth D. Schifano , Robert L. Strawderman , Martin T. Wells

Asynchronous distributed algorithms are a popular way to reduce synchronization costs in large-scale optimization, and in particular for neural network training. However, for nonsmooth and nonconvex objectives, few convergence guarantees…

Optimization and Control · Mathematics 2020-07-14 Vyacheslav Kungurtsev , Malcolm Egan , Bapi Chatterjee , Dan Alistarh

Point cloud few-shot semantic segmentation (PC-FSS) aims to segment targets of novel categories in a given query point cloud with only a few annotated support samples. The current top-performing prototypical learning methods employ…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhaoyang Li , Yuan Wang , Wangkai Li , Rui Sun , Tianzhu Zhang

Mobile edge computing (MEC) is essential for next-generation mobile network applications that prioritize various performance metrics, including delays and energy consumption. However, conventional single-objective scheduling solutions…

Networking and Internet Architecture · Computer Science 2023-07-28 Ning Yang , Junrui Wen , Meng Zhang , Ming Tang