English
Related papers

Related papers: Impact of domain reduction techniques in polynomia…

200 papers

We study an optimization problem in which the objective is given as a sum of logarithmic-polynomial functions. This formulation is motivated by statistical estimation principles such as maximum likelihood estimation, and by loss functions…

Optimization and Control · Mathematics 2026-01-07 Jiyoung Choi , Jiawang Nie , Xindong Tang , Suhan Zhong

This work develops an LLM-based optimization framework ensuring strict constraint satisfaction in network optimization. While LLMs possess contextual reasoning capabilities, existing approaches often fail to enforce constraints, causing…

Networking and Internet Architecture · Computer Science 2025-09-10 Youngjin Song , Wookjin Lee , Hong Ki Kim , Sang Hyun Lee

Deep reinforcement learning (DRL) has achieved remarkable success across various domains, such as video games, robotics, and, recently, large language models. However, the computational costs and memory requirements of DRL models often…

Machine Learning · Computer Science 2024-07-09 Heng Lu , Mehdi Alemi , Reza Rawassizadeh

Policy optimization methods are popular reinforcement learning algorithms in practice. Recent works have built theoretical foundation for them by proving $\sqrt{T}$ regret bounds even when the losses are adversarial. Such bounds are tight…

Machine Learning · Computer Science 2023-02-21 Christoph Dann , Chen-Yu Wei , Julian Zimmert

Many applications require efficient methods for solving continuous shortest path problems. Such paths can be viewed as characteristics of static Hamilton-Jacobi equations. Several fast numerical algorithms have been developed to solve such…

Numerical Analysis · Mathematics 2016-01-06 Zachary Clawson , Adam Chacon , Alexander Vladimirsky

In this paper, we consider the linear programming (LP) formulation for deep reinforcement learning. The number of the constraints depends on the size of state and action spaces, which makes the problem intractable in large or continuous…

Optimization and Control · Mathematics 2021-05-21 Yongfeng Li , Mingming Zhao , Weijie Chen , Zaiwen Wen

This paper describes an approximate method for global optimization of polynomial programming problems with bounded variables. The method uses a reformulation and linearization technique to transform the original polynomial optimization…

Optimization and Control · Mathematics 2012-05-30 Joseph W. Norman

Domain adaptation is an important problem and often needed for real-world applications. In this problem, instead of i.i.d. training and testing datapoints, we assume that the source (training) data and the target (testing) data have…

Machine Learning · Computer Science 2022-03-15 A. Tuan Nguyen , Toan Tran , Yarin Gal , Philip H. S. Torr , Atılım Güneş Baydin

We study how to solve semidefinite programming relaxations for large scale polynomial optimization. When interior-point methods are used, typically only small or moderately large problems could be solved. This paper studies regularization…

Optimization and Control · Mathematics 2011-12-06 Jiawang Nie , Li Wang

In this thesis, I explore the possibilities of conducting Bayesian optimization techniques in high dimensional domains. Although high dimensional domains can be defined to be between hundreds and thousands of dimensions, we will primarily…

Machine Learning · Computer Science 2020-10-09 David Yenicelik

Randomized dimensionality reduction is a widely-used algorithmic technique for speeding up large-scale Euclidean optimization problems. In this paper, we study dimension reduction for a variety of maximization problems, including…

Data Structures and Algorithms · Computer Science 2025-06-03 Jie Gao , Rajesh Jayaram , Benedikt Kolbe , Shay Sapir , Chris Schwiegelshohn , Sandeep Silwal , Erik Waingarten

This study investigates imposing hard inequality constraints on the outputs of convolutional neural networks (CNN) during training. Several recent works showed that the theoretical and practical advantages of Lagrangian optimization over…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Hoel Kervadec , Jose Dolz , Jing Yuan , Christian Desrosiers , Eric Granger , Ismail Ben Ayed

We propose a simple domain adaptation method for neural networks in a supervised setting. Supervised domain adaptation is a way of improving the generalization performance on the target domain by using the source domain dataset, assuming…

Computation and Language · Computer Science 2016-07-05 Yusuke Watanabe , Kazuma Hashimoto , Yoshimasa Tsuruoka

In this paper, we are interested in building a domain knowledge based deep learning framework to solve the chiller plants energy optimization problems. Compared to the hotspot applications of deep learning (e.g. image classification and…

Signal Processing · Electrical Eng. & Systems 2021-06-14 Fanhe Ma , Faen Zhang , Shenglan Ben , Shuxin Qin , Pengcheng Zhou , Changsheng Zhou , Fengyi Xu

We describe a new technique for computing lower-bounds on the minimum energy configuration of a planar Markov Random Field (MRF). Our method successively adds large numbers of constraints and enforces consistency over binary projections of…

Machine Learning · Computer Science 2012-02-20 Julian Yarkony , Ragib Morshed , Alexander T. Ihler , Charless C. Fowlkes

Nonnegativity certificates can be used to obtain tight dual bounds for polynomial optimization problems. Hierarchies of certificate-based relaxations ensure convergence to the global optimum, but higher levels of such hierarchies can become…

Optimization and Control · Mathematics 2023-04-25 Ksenia Bestuzheva , Helena Völker , Ambros Gleixner

Polynomial optimization problems represent a wide class of optimization problems, with a large number of real-world applications. Current approaches for polynomial optimization, such as the sum of squares (SOS) method, rely on large-scale…

Optimization and Control · Mathematics 2025-07-04 Dimitris Bertsimas , Dick den Hertog , Thodoris Koukouvinos

We consider the dynamic resource allocation problem where the decision space is finite-dimensional, yet the solution must satisfy a large or even infinite number of constraints revealed via streaming data or oracle feedback. We model this…

Machine Learning · Computer Science 2026-03-18 Yiming Zong , Jiashuo Jiang

Inspired by applications in optimal control of semilinear elliptic partial differential equations and physics-integrated imaging, differential equation constrained optimization problems with constituents that are only accessible through…

Optimization and Control · Mathematics 2020-08-26 Guozhi Dong , Michael Hintermueller , Kostas Papafitsoros

With recent advancements in computer hardware and software platforms, there has been a surge of interest in solving partial differential equations with deep learning-based methods, and the integration with domain decomposition strategies…

Numerical Analysis · Mathematics 2023-05-18 Qi Sun , Xuejun Xu , Haotian Yi