English
Related papers

Related papers: Continuous Parallel Relaxation for Finding Diverse…

200 papers

Several recent unsupervised learning methods use probabilistic approaches to solve combinatorial optimization (CO) problems based on the assumption of statistically independent solution variables. We demonstrate that this assumption imposes…

Machine Learning · Computer Science 2023-11-27 Sebastian Sanokowski , Wilhelm Berghammer , Sepp Hochreiter , Sebastian Lehner

This work studies reinforcement learning (RL) in the context of multi-period supply chains subject to constraints, e.g., on production and inventory. We introduce Distributional Constrained Policy Optimization (DCPO), a novel approach for…

Machine Learning · Computer Science 2023-02-06 Jaime Sabal Bermúdez , Antonio del Rio Chanona , Calvin Tsay

Combinatorial problems stated as Constraint Satisfaction Problems (CSP) are examined. It is shown by example that any algorithm designed for the original CSP, and involving the AllDifferent constraint, has at least the same level of…

Artificial Intelligence · Computer Science 2020-12-15 Geoff Harris

Reinforcement learning-based methods for constructing solutions to combinatorial optimization problems are rapidly approaching the performance of human-designed algorithms. To further narrow the gap, learning-based approaches must…

Machine Learning · Computer Science 2025-10-07 André Hottung , Mridul Mahajan , Kevin Tierney

The penalization method is a popular technique to provide particle swarm optimizers with the ability to handle constraints. The downside is the need of penalization coefficients whose settings are problem-specific. While adaptive…

Neural and Evolutionary Computing · Computer Science 2021-01-28 Mauro S. Innocente , Johann Sienz

In recent years, bilevel approaches have become very popular to efficiently estimate high-dimensional hyperparameters of machine learning models. However, to date, binary parameters are handled by continuous relaxation and rounding…

Machine Learning · Computer Science 2025-03-20 Sara Venturini , Marianna de Santis , Jordan Patracone , Francesco Rinaldi , Saverio Salzo , Martin Schmidt

This paper investigates the cooperative planning and control problem for multiple connected autonomous vehicles (CAVs) in different scenarios. In the existing literature, most of the methods suffer from significant problems in computational…

Multiagent Systems · Computer Science 2021-01-05 Xiaoxue Zhang , Zilong Cheng , Jun Ma , Sunan Huang , Frank L. Lewis , Tong Heng Lee

Neural Combinatorial Optimization (NCO) has emerged as a promising approach for NP-hard problems. However, prevailing RL-based methods suffer from low sample efficiency due to sparse rewards and underused solutions. We propose Best-anchored…

Machine Learning · Computer Science 2025-06-03 Zijun Liao , Jinbiao Chen , Debing Wang , Zizhen Zhang , Jiahai Wang

Reinforcement Learning Fine-Tuning (RLFT) has achieved notable success in tasks with objectively verifiable answers (e.g., code generation, mathematical reasoning), yet struggles with open-ended subjective tasks like role-playing dialogue.…

Computation and Language · Computer Science 2025-08-13 Xinge Ye , Rui Wang , Yuchuan Wu , Victor Ma , Feiteng Fang , Fei Huang , Yongbin Li

Reinforcement learning has significantly enhanced the reasoning capabilities of Large Language Models (LLMs) in complex problem-solving tasks. Recently, the introduction of DeepSeek R1 has inspired a surge of interest in leveraging…

Machine Learning · Computer Science 2025-08-07 Jinghang Han , Jiawei Chen , Hang Shao , Hao Ma , Mingcheng Li , Xintian Shen , Lihao Zheng , Wei Chen , Tao Wei , Lihua Zhang

We consider convex constrained optimization problems that also include a cardinality constraint. In general, optimization problems with cardinality constraints are difficult mathematical programs which are usually solved by global…

Optimization and Control · Mathematics 2022-09-08 Nataša Krejić , Evelin H. M. Krulikovski , Marcos Raydan

Combinatorial optimization problems are crucial in industry. However, many COPs are NP-hard, causing the search space to grow exponentially with problem size and rendering large-scale instances computationally intractable. Conventional…

Emerging Technologies · Computer Science 2026-02-27 Eiji Kawase , Shuta Kikuchi , Hideaki Tamai , Shu Tanaka

This thesis develops theoretical frameworks and algorithms that advance constrained reinforcement learning (RL) across control, preference learning, and alignment of large language models. The first contribution addresses constrained Markov…

Machine Learning · Computer Science 2025-12-12 Akhil Agnihotri

In recent years, various means of efficiently detecting changepoints in the univariate setting have been proposed, with one popular approach involving minimising a penalised cost function using dynamic programming. In some situations, these…

Methodology · Statistics 2018-10-09 S. O. Tickle , I. A. Eckley , P. Fearnhead , K. Haynes

For many applications of reinforcement learning it can be more convenient to specify both a reward function and constraints, rather than trying to design behavior through the reward function. For example, systems that physically interact…

Machine Learning · Computer Science 2017-05-31 Joshua Achiam , David Held , Aviv Tamar , Pieter Abbeel

Binary optimization is a central problem in mathematical optimization and its applications are abundant. To solve this problem, we propose a new class of continuous optimization techniques which is based on Mathematical Programming with…

Optimization and Control · Mathematics 2017-12-07 Ganzhao Yuan , Bernard Ghanem

We present a proximal policy optimization (PPO) agent trained through curriculum learning (CL) principles and meticulous reward engineering to optimize a real-world high-throughput waste sorting facility. Our work addresses the challenge of…

Machine Learning · Computer Science 2024-07-24 Abhijeet Pendyala , Asma Atamna , Tobias Glasmachers

Mixed discrete-continuous optimization is central to engineering design, where discrete choices interact with continuous fields. These problems are difficult due to high-dimensional, complex search spaces. To tackle them, Quantum Annealing…

Computational Engineering, Finance, and Science · Computer Science 2026-03-19 Fabian Key , Lukas Freinberger , Mayu Muramatsu , Norbert Hosters

Combinatorial problems are a common challenge in business, requiring finding optimal solutions under specified constraints. While significant progress has been made with variational approaches such as QAOA, most problems addressed are…

Quantum Physics · Physics 2025-01-14 Monit Sharma , Yan Jin , Hoong Chuin Lau , Rudy Raymond

Neural Combinatorial Optimization approaches have recently leveraged the expressiveness and flexibility of deep neural networks to learn efficient heuristics for hard Combinatorial Optimization (CO) problems. However, most of the current…

Machine Learning · Computer Science 2022-10-04 Sahil Manchanda , Sofia Michel , Darko Drakulic , Jean-Marc Andreoli