English
Related papers

Related papers: Automated tuning for the parameters of linear solv…

200 papers

The challenge of mapping indoor environments is addressed. Typical heuristic algorithms for solving the motion planning problem are frontier-based methods, that are especially effective when the environment is completely unknown. However,…

Machine Learning · Computer Science 2022-03-01 Elchanan Zwecher , Eran Iceland , Sean R. Levy , Shmuel Y. Hayoun , Oren Gal , Ariel Barel

In large-scale, data-driven applications, parameters are often only known approximately due to noise and limited data samples. In this paper, we focus on high-dimensional optimization problems with linear constraints under uncertain…

Optimization and Control · Mathematics 2024-03-01 Naqi Huang , Nestor Parolya , Theresia van Essen

Control algorithms such as model predictive control (MPC) and state estimators rely on a number of different parameters. The performance of the closed loop usually depends on the correct setting of these parameters. Tuning is often done…

Systems and Control · Electrical Eng. & Systems 2020-10-15 David Stenger , Muzaffer Ay , Dirk Abel

In recent years, many design automation methods have been developed to routinely create approximate implementations of circuits and programs that show excellent trade-offs between the quality of output and required resources. This paper…

Neural and Evolutionary Computing · Computer Science 2021-08-17 Lukas Sekanina

The parameter selection is crucial to regularization based image restoration methods. Generally speaking, a spatially fixed parameter for regularization item in the whole image does not perform well for both edge and smooth areas. A larger…

Image and Video Processing · Electrical Eng. & Systems 2021-04-07 Tingting Zhang , Jie Chen , Caiying Wu , Zhifei He , Tieyong Zeng , Qiyu Jin

This material provides thorough tutorials on some optimization techniques frequently used in various engineering disciplines, including convex optimization, linearization techniques and mixed-integer linear programming, robust optimization,…

Optimization and Control · Mathematics 2020-07-28 Wei Wei

This paper presents a framework to solve constrained optimization problems in an accelerated manner based on High-Order Tuners (HT). Our approach is based on reformulating the original constrained problem as the unconstrained optimization…

Optimization and Control · Mathematics 2022-05-27 Anjali Parashar , Priyank Srivastava , Anuradha M. Annaswamy

The digital transformation of automation places new demands on data acquisition and processing in industrial processes. Logical relationships between acquired data and cyclic process sequences must be correctly interpreted and evaluated. To…

Neural and Evolutionary Computing · Computer Science 2023-04-13 Marlon Löppenberg , Andreas Schwung

Most evolutionary algorithms have parameters, which allow a great flexibility in controlling their behavior and adapting them to new problems. To achieve the best performance, it is often needed to control some of the parameters during…

Neural and Evolutionary Computing · Computer Science 2021-06-07 Maxim Buzdalov , Carola Doerr

Parameter-efficient tuning aims to distill knowledge for downstream tasks by optimizing a few introduced parameters while freezing the pretrained language models (PLMs). Continuous prompt tuning which prepends a few trainable vectors to the…

Computation and Language · Computer Science 2022-04-14 Haoran Yang , Piji Li , Wai Lam

Algorithms typically come with tunable parameters that have a considerable impact on the computational resources they consume. Too often, practitioners must hand-tune the parameters, a tedious and error-prone task. A recent line of research…

Machine Learning · Computer Science 2020-11-24 Maria-Florina Balcan , Tuomas Sandholm , Ellen Vitercik

In this paper we investigate how standard nonlinear programming algorithms can be used to solve constrained optimization problems in a distributed manner. The optimization setup consists of a set of agents interacting through a…

Optimization and Control · Mathematics 2017-07-18 Ion Matei , John S. Baras

This paper presents a novel generative model to synthesize fluid simulations from a set of reduced parameters. A convolutional neural network is trained on a collection of discrete, parameterizable fluid simulation velocity fields. Due to…

Machine Learning · Computer Science 2019-09-05 Byungsoo Kim , Vinicius C. Azevedo , Nils Thuerey , Theodore Kim , Markus Gross , Barbara Solenthaler

The computational cost of many signal processing and machine learning techniques is often dominated by the cost of applying certain linear operators to high-dimensional vectors. This paper introduces an algorithm aimed at reducing the…

Machine Learning · Computer Science 2016-03-30 Luc Le Magoarou , Rémi Gribonval

This paper presents fast first-order methods for solving linear programs (LPs) approximately. We adapt online linear programming algorithms to offline LPs and obtain algorithms that avoid any matrix multiplication. We also introduce a…

Optimization and Control · Mathematics 2024-11-07 Wenzhi Gao , Dongdong Ge , Chunlin Sun , Yinyu Ye

Efficiently solving sparse linear algebraic equations is an important research topic of numerical simulation. Commonly used approaches include direct methods and iterative methods. Compared with the direct methods, the iterative methods…

Numerical Analysis · Mathematics 2023-10-11 Haifeng Zou , Xiaowen Xu , Chen-Song Zhang

We consider a discrete optimization formulation for learning sparse classifiers, where the outcome depends upon a linear combination of a small subset of features. Recent work has shown that mixed integer programming (MIP) can be used to…

Machine Learning · Statistics 2021-06-08 Antoine Dedieu , Hussein Hazimeh , Rahul Mazumder

Correctly setting the parameters of a production machine is essential to improve product quality, increase efficiency, and reduce production costs while also supporting sustainability goals. Identifying optimal parameters involves an…

Machine Learning · Computer Science 2025-03-24 Philipp Wagner , Tobias Nagel , Philipp Leube , Marco F. Huber

We present algorithms for efficiently learning regularizers that improve generalization. Our approach is based on the insight that regularizers can be viewed as upper bounds on the generalization gap, and that reducing the slack in the…

Machine Learning · Computer Science 2019-02-25 Matthew Streeter

In this paper, we formulate the hyperparameter tuning problem in machine learning as a bilevel program. The bilevel program is solved using a micro genetic algorithm that is enhanced with a linear program. While the genetic algorithm…

Machine Learning · Computer Science 2024-07-02 Ankur Sinha , Paritosh Pankaj