中文
相关论文

相关论文: Feasible-First Exploration for Constrained ML Depl…

200 篇论文

Distributed execution of deep learning training involves a dynamic interplay between hardware accelerator architecture and device placement strategy. This is the first work to explore the co-optimization of determining the optimal…

机器学习 · 计算机科学 2024-07-19 Irene Wang , Jakub Tarnawski , Amar Phanishayee , Divya Mahajan

In this paper, we present a novel technique to search for hardware architectures of accelerators optimized for end-to-end training of deep neural networks (DNNs). Our approach addresses both single-device and distributed pipeline and tensor…

硬件体系结构 · 计算机科学 2024-04-24 Muhammad Adnan , Amar Phanishayee , Janardhan Kulkarni , Prashant J. Nair , Divya Mahajan

In this paper we propose an annealing based framework to incorporate inequality constraints in optimization problems such as facility location, simultaneous facility location with path optimization, and the last mile delivery problem. These…

最优化与控制 · 数学 2020-02-11 Amber Srivastava , Gabriel Barsi Haberfeld , Naira Hovakimyan , Srinivasa M Salapaka

We study unconstrained smooth convex optimization under stochastic first- and zeroth-order oracles subject only to finite-moment bounds, naturally admitting persistent bias and heavy-tailed noise. In this hostile environment, integrating…

最优化与控制 · 数学 2026-04-20 Shunzhi Zhang , Shichen Liao , Congying Han , Tiande Guo

The generalization abilities of heuristic optimizers may deteriorate with the increment of the search space dimensionality. To achieve generalized performance across Large Scale Blackbox Optimization (LSBO) tasks, it ispossible to ensemble…

神经与进化计算 · 计算机科学 2019-09-19 Mingde Zhao , Hongwei Ge , Yi Lian , Kai Zhang

In cloud machine learning (ML) inference systems, providing low latency to end-users is of utmost importance. However, maximizing server utilization and system throughput is also crucial for ML service providers as it helps lower the…

分布式、并行与集群计算 · 计算机科学 2022-03-01 Yunseong Kim , Yujeong Choi , Minsoo Rhu

The process of optimizing the latency of DNN operators with ML models and hardware-in-the-loop, called auto-tuning, has established itself as a pervasive method for the deployment of neural networks. From a search space of…

机器学习 · 计算机科学 2022-06-01 Dennis Rieber , Moritz Reiber , Oliver Bringmann , Holger Fröning

The aim of this paper is twofold. First, we introduce "resource constraints" as a general concept that covers many practical restrictions on experimental design. Second, for computing efficient exact designs of experiments under any…

统计计算 · 统计学 2014-08-08 Radoslav Harman , Alena Bachratá , Lenka Filová

Bayesian optimization (BO) is an efficient framework for optimization of black-box objectives when function evaluations are costly and gradient information is not easily accessible. BO has been successfully applied to automate the task of…

机器学习 · 计算机科学 2024-07-09 Pallavi Mitra , Felix Biessmann

Resource-intensive computations are a major factor that limits the effectiveness of automated machine learning solutions. In the paper, we propose a modular approach that can be used to increase the quality of evolutionary optimization for…

机器学习 · 计算机科学 2023-01-13 Nikolay O. Nikitin , Sergey Teryoshkin , Valerii Pokrovskii , Sergey Pakulin , Denis Nasonov

Efficient exploration remains one of the longstanding problems of deep reinforcement learning. Instead of depending solely on extrinsic rewards from the environments, existing methods use intrinsic rewards to enhance exploration. However,…

机器学习 · 计算机科学 2024-12-09 SuMin Oh , WanSoo Kim , HyunJin Kim

Energy systems optimization problems are complex due to strongly non-linear system behavior and multiple competing objectives, e.g. economic gain vs. environmental impact. Moreover, a large number of input variables and different variable…

In this paper we address the optimal planning of autonomous teams for general purpose tasks including a wide spectrum of situations: from project management of human teams to the coordination of an automated assembly lines, focusing in the…

系统与控制 · 电气工程与系统科学 2024-11-07 Antonio Sojo , Iván Maza , Aníbal Ollero

How should Large Language Model (LLM) practitioners select the right model for a task without wasting money? We introduce BELLA (Budget-Efficient LLM Selection via Automated skill-profiling), a framework that recommends optimal LLM…

人工智能 · 计算机科学 2026-02-03 Mika Okamoto , Ansel Kaplan Erol , Glenn Matlin

Black-box optimization (BBO) involves functions that are unknown, inexact and/or expensive-to-evaluate. Existing BBO algorithms face several challenges, including high computational cost from extensive evaluations, difficulty in handling…

最优化与控制 · 数学 2025-09-26 Zixuan Zhang , Xiaowei Song , Jiaming Li , Yujiao Zeng , Yaling Nie , Min Zhu , Dongyun Lu , Yibo Zhang , Xin Xiao , Jie Li

The hm admissible heuristics for (sequential and temporal) regression planning are defined by a parameterized relaxation of the optimal cost function in the regression search space, where the parameter m offers a trade-off between the…

人工智能 · 计算机科学 2011-09-28 P. Haslum

The rapid advancement of GPU technology has unlocked powerful parallel processing capabilities, creating new opportunities to enhance classic search algorithms. This hardware has been exploited in best-first search algorithms with neural…

人工智能 · 计算机科学 2025-11-18 Ehsan Futuhi , Nathan R. Sturtevant

Transfer-based attacks craft adversarial examples on white-box surrogate models and directly deploy them against black-box target models, offering model-agnostic and query-free threat scenarios. While flatness-enhanced methods have recently…

计算机视觉与模式识别 · 计算机科学 2026-01-15 Chunlin Qiu , Ang Li , Yiheng Duan , Shenyi Zhang , Yuanjie Zhang , Lingchen Zhao , Qian Wang

Hierarchical learning algorithms that gradually approximate a solution to a data-driven optimization problem are essential to decision-making systems, especially under limitations on time and computational resources. In this study, we…

机器学习 · 计算机科学 2023-03-22 Christos Mavridis , John Baras

This paper presents a novel two-stage flexible dynamic decision support based optimal threat evaluation and defensive resource scheduling algorithm for multi-target air-borne threats. The algorithm provides flexibility and optimality by…

人工智能 · 计算机科学 2009-06-30 Huma Naeem , Asif Masood , Mukhtar Hussain , Shoab A. Khan