English
Related papers

Related papers: Scalable Acceleration for Classification-Based Der…

200 papers

Hyperparameter tuning is one of the the most time-consuming parts in machine learning. Despite the existence of modern optimization algorithms that minimize the number of evaluations needed, evaluations of a single setting may still be…

Machine Learning · Computer Science 2024-03-27 Philip Buczak , Andreas Groll , Markus Pauly , Jakob Rehof , Daniel Horn

For high-dimensional classification, it is well known that naively performing the Fisher discriminant rule leads to poor results due to diverging spectra and noise accumulation. Therefore, researchers proposed independence rules to…

Machine Learning · Statistics 2011-11-10 Jianqing Fan , Yang Feng , Xin Tong

This paper proposes a novel mission planning algorithm for autonomous robots that selects an optimal waypoint sequence from a predefined set to maximize total reward while satisfying obstacle avoidance, state, input, derivative, mission…

Robotics · Computer Science 2025-05-07 Jose D. Hoyos , Tianyu Zhou , Zehui Lu , Shaoshuai Mou

Efficient scalability of automated driving (AD) is key to reducing costs, enhancing safety, conserving resources, and maximizing impact. However, research focuses on specific vehicles and context, while broad deployment requires scalability…

Computers and Society · Computer Science 2025-07-25 Lars Ullrich , Michael Buchholz , Jonathan Petit , Klaus Dietmayer , Knut Graichen

Several classical adaptive optimization algorithms, such as line search and trust region methods, have been recently extended to stochastic settings where function values, gradients, and Hessians in some cases, are estimated via stochastic…

Optimization and Control · Mathematics 2023-10-02 Billy Jin , Katya Scheinberg , Miaolan Xie

In this paper, we explore provable acceleration of diffusion models without any additional retraining. Focusing on the task of approximating a target data distribution in $\mathbb{R}^d$ to within $\varepsilon$ total-variation distance, we…

Machine Learning · Computer Science 2025-08-14 Gen Li , Yuchen Zhou , Yuting Wei , Yuxin Chen

Policy optimization methods have shown great promise in solving complex reinforcement and imitation learning tasks. While model-free methods are broadly applicable, they often require many samples to optimize complex policies. Model-based…

Artificial Intelligence · Computer Science 2017-11-23 Daniel Levy , Stefano Ermon

We consider the speed planning problem for a robotic manipulator. In particular, we present an algorithm for finding the time-optimal speed law along an assigned path that satisfies velocity and acceleration constraints and respects the…

Robotics · Computer Science 2018-10-04 Luca Consolini , Marco Locatelli , Andrea Minari , Akos Nagy , Istvan Vajk

Widely used data race detectors, including the state-of-the-art FastTrack algorithm, incur performance costs that are acceptable for regular in-house testing, but miss races detectable from the analyzed execution. Predictive analyses detect…

Software Engineering · Computer Science 2020-04-10 Jake Roemer , Kaan Genç , Michael D. Bond

We propose two novel algorithms for constructing convex collision-free polytopes in robot configuration space. Finding these polytopes enables the application of stronger motion-planning frameworks such as trajectory optimization with…

Robotics · Computer Science 2024-11-15 Peter Werner , Thomas Cohn , Rebecca H. Jiang , Tim Seyde , Max Simchowitz , Russ Tedrake , Daniela Rus

Spatially-coupled (SC) codes, known for their threshold saturation phenomenon and low-latency windowed decoding algorithms, are ideal for streaming applications. They also find application in various data storage systems because of their…

Information Theory · Computer Science 2021-01-26 Siyi Yang , Ahmed Hareedy , Shyam Venkatasubramanian , Robert Calderbank , Lara Dolecek

The work presented here is motivated by the development of StoDARS, a framework for large-scale stochastic blackbox optimization that not only is both an algorithmic and theoretical extension of the stochastic directional direct-search…

Optimization and Control · Mathematics 2024-03-21 K. J. Dzahini , S. M. Wild

We propose and analyze a model-based derivative-free (DFO) algorithm for solving bound-constrained optimization problems where the objective function is the composition of a smooth function and a vector of black-box functions. We assume…

Optimization and Control · Mathematics 2024-01-03 Frank E. Curtis , Shima Dezfulian , Andreas Wächter

We present a novel approach for unsupervised road segmentation in adverse weather conditions such as rain or fog. This includes a new algorithm for source-free domain adaptation (SFDA) using self-supervised learning. Moreover, our approach…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Divya Kothandaraman , Rohan Chandra , Dinesh Manocha

We develop adaptive discretization algorithms for locally optimal experimental design of nonlinear prediction models. With these algorithms, we refine and improve a pertinent state-of-the-art algorithm in various respects. We establish…

Optimization and Control · Mathematics 2024-06-04 Jochen Schmid , Philipp Seufert , Michael Bortz

Single-objective black box optimization (also known as zeroth-order optimization) is the process of minimizing a scalar objective $f(x)$, given evaluations at adaptively chosen inputs $x$. In this paper, we consider multi-objective…

Machine Learning · Computer Science 2020-06-11 Daniel Golovin , Qiuyi Zhang

We are interested in derivative-free optimization of high-dimensional functions. The sample complexity of existing methods is high and depends on problem dimensionality, unlike the dimensionality-independent rates of first-order methods.…

Machine Learning · Computer Science 2020-04-28 Ozan Sener , Vladlen Koltun

Reliable yet efficient evaluation of generalisation performance of a proposed architecture is crucial to the success of neural architecture search (NAS). Traditional approaches face a variety of limitations: training each architecture to…

Machine Learning · Statistics 2021-06-09 Binxin Ru , Clare Lyle , Lisa Schut , Miroslav Fil , Mark van der Wilk , Yarin Gal

Generating safety-critical scenarios is essential for testing and verifying the safety of autonomous vehicles. Traditional optimization techniques suffer from the curse of dimensionality and limit the search space to fixed parameter spaces.…

Machine Learning · Computer Science 2024-03-08 Haolan Liu , Liangjun Zhang , Siva Kumar Sastry Hari , Jishen Zhao

The need for fast sparse optimization is emerging, e.g., to deal with large-dimensional data-driven problems and to track time-varying systems. In the framework of linear sparse optimization, the iterative shrinkage-thresholding algorithm…

Optimization and Control · Mathematics 2025-01-22 Vito Cerone , Sophie M. Fosson , Diego Regruto