English
Related papers

Related papers: GENDIRECT: a GENeralized DIRECT-type algorithmic f…

200 papers

Stochastic simulation models effectively capture complex system dynamics but are often too slow for real-time decision-making. Traditional metamodeling techniques learn relationships between simulator inputs and a single output summary…

Machine Learning · Computer Science 2026-01-21 L. Jeff Hong , Yanxi Hou , Qingkai Zhang , Xiaowei Zhang

In this paper, a multi-objective approach for the design of composite data-driven mathematical models is proposed. It allows automating the identification of graph-based heterogeneous pipelines that consist of different blocks: machine…

Neural and Evolutionary Computing · Computer Science 2021-05-19 Iana S. Polonskaia , Nikolay O. Nikitin , Ilia Revin , Pavel Vychuzhanin , Anna V. Kalyuzhnaya

In this paper, a novel derivative-free pattern search based algorithm for Black-box optimization is proposed over a simplex constrained parameter space. At each iteration, starting from the current solution, new possible set of solutions…

Optimization and Control · Mathematics 2026-04-16 Priyam Das

Methods for distributed optimization have received significant attention in recent years owing to their wide applicability in various domains. A distributed optimization method typically consists of two key components: communication and…

Optimization and Control · Mathematics 2018-06-04 Albert S. Berahas , Raghu Bollapragada , Nitish Shirish Keskar , Ermin Wei

The advent of parameter-efficient fine-tuning methods has significantly reduced the computational burden of adapting large-scale pretrained models to diverse downstream tasks. However, existing approaches often struggle to achieve robust…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Haotian Zhang , Liu Liu , Baosheng Yu , Jiayan Qiu , Yanwei Ren , Xianglong Liu

Finding repeated patterns or motifs in a time series is an important unsupervised task that has still a number of open issues, starting by the definition of motif. In this paper, we revise the notion of motif support, characterizing it as…

Machine Learning · Computer Science 2016-12-06 Joan Serrà , Aleksandar Matic , Josep Luis Arcos , Alexandros Karatzoglou

We present a novel deep learning approach to approximate the solution of large, sparse, symmetric, positive-definite linear systems of equations. These systems arise from many problems in applied science, e.g., in numerical methods for…

Machine Learning · Computer Science 2022-10-04 Ayano Kaneda , Osman Akar , Jingyu Chen , Victoria Kala , David Hyde , Joseph Teran

General distribution steering is intrinsically an infinite-dimensional problem, when the continuous distributions to steer are arbitrary. We put forward a moment representation of the primal system for control in [42]. However, the system…

Optimization and Control · Mathematics 2025-04-01 Guangyu Wu , Anders Lindquist

Distributed optimization is an essential paradigm to solve large-scale optimization problems in modern applications where big-data and high-dimensionality creates a computational bottleneck. Distributed optimization algorithms that exhibit…

Systems and Control · Electrical Eng. & Systems 2023-05-25 Aayushya Agarwal , Larry Pileggi

This article proposes new perspectives for developing derivative based numerical algorithms, supported by the introduction of a generalized derivative operators. It demonstrates that these operators have the potential to enhance and extend…

General Mathematics · Mathematics 2026-01-13 Flavio Barbosa , Fernando Nogueira

Diffusion models have demonstrated empirical successes in various applications and can be adapted to task-specific needs via guidance. This paper studies a form of gradient guidance for adapting a pre-trained diffusion model towards…

Machine Learning · Statistics 2024-10-17 Yingqing Guo , Hui Yuan , Yukang Yang , Minshuo Chen , Mengdi Wang

We introduce the GEneralized Newton Inexact Operator Splitting solver (GeNIOS) for large-scale convex optimization. GeNIOS speeds up ADMM by approximately solving approximate subproblems: it uses a second-order approximation to the most…

Optimization and Control · Mathematics 2026-01-01 Theo Diamandis , Zachary Frangella , Shipu Zhao , Bartolomeo Stellato , Madeleine Udell

This paper investigates a category of constrained fractional optimization problems that emerge in various practical applications. The objective function for this category is characterized by the ratio of a numerator and denominator, both…

Optimization and Control · Mathematics 2026-05-28 Yizun Lin , Jian-Feng Cai , Zhao-Rong Lai , Cheng Li

Large-scale multi-objective optimization poses challenges to existing evolutionary algorithms in maintaining the performances of convergence and diversity because of high dimensional decision variables. Inspired by the motion of particles…

Neural and Evolutionary Computing · Computer Science 2025-09-22 Jia-Cheng Li , Min-Rong Chen , Guo-Qiang Zeng , Jian Weng , Man Wang , Jia-Lin Mai

Generative recommendation (GenRec) offers LLM integration, reduced embedding costs, and eliminates per-candidate scoring, attracting great attention. Despite its promising performance, this study reveals that it suffers from generation…

Information Retrieval · Computer Science 2025-07-08 Kun Yang , Siyao Zheng , Tianyi Li , Xiaodong Li , Hui Li

Diffusion Models represent a significant advancement in generative modeling, employing a dual-phase process that first degrades domain-specific information via Gaussian noise and restores it through a trainable model. This framework enables…

Neural and Evolutionary Computing · Computer Science 2024-11-21 Benedikt Hartl , Yanbo Zhang , Hananel Hazan , Michael Levin

Tracking a point through a video can be a challenging task due to uncertainty arising from visual obfuscations, such as appearance changes and occlusions. Although current state-of-the-art discriminative models excel in regressing long-term…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Mattie Tesfaldet , Adam W. Harley , Konstantinos G. Derpanis , Derek Nowrouzezahrai , Christopher Pal

Deep generative models can learn to generate realistic-looking images, but many of the most effective methods are adversarial and involve a saddlepoint optimization, which requires a careful balancing of training between a generator network…

Machine Learning · Statistics 2020-02-18 Akash Srivastava , Kai Xu , Michael U. Gutmann , Charles Sutton

Working with exhaustive search on large dataset is infeasible for several reasons. Recently, developed techniques that made pattern set mining feasible by a general solver with long execution time that supports heuristic search and are…

Artificial Intelligence · Computer Science 2015-07-21 Shanjida Khatun , Hasib Ul Alam , Swakkhar Shatabda

We present new efficient \textit{projection-free} algorithms for online convex optimization (OCO), where by projection-free we refer to algorithms that avoid computing orthogonal projections onto the feasible set, and instead relay on…

Machine Learning · Computer Science 2023-03-21 Dan Garber , Ben Kretzu