English
Related papers

Related papers: Towards Exploratory Reformulation of Constraint Mo…

200 papers

Various control schemes rely on a solution of a convex optimization problem involving a particular robust quadratic constraint, which can be reformulated as a linear matrix inequality using the well-known $\mathcal{S}$-lemma. However, the…

Optimization and Control · Mathematics 2020-12-10 Goran Banjac , Jianzhe Zhen , Dick den Hertog , John Lygeros

The dynamics of real-world applications and systems require efficient methods for improving infeasible solutions or restoring corrupted ones by making modifications to the current state of a system in a restricted way. We propose a new…

We investigate the value of extending the completeness of a decision model along different dimensions of refinement. Specifically, we analyze the expected value of quantitative, conceptual, and structural refinement of decision models. We…

Artificial Intelligence · Computer Science 2013-03-08 Kim-Leng Poh , Eric J. Horvitz

We study the problem of learning a good search policy for combinatorial search spaces. We propose retrospective imitation learning, which, after initial training by an expert, improves itself by learning from \textit{retrospective…

Machine Learning · Computer Science 2019-06-25 Jialin Song , Ravi Lanka , Albert Zhao , Aadyot Bhatnagar , Yisong Yue , Masahiro Ono

Problem Statement: The huge number of information on the web as well as the growth of new inexperienced users creates new challenges for information retrieval. It has become increasingly difficult for these users to find relevant documents…

Information Retrieval · Computer Science 2011-06-14 Abdelkrim Bouramoul , Mohamed-Khireddine Kholladi , Bich-Lien Doan

Reinforcement learning allows solving complex tasks, however, the learning tends to be task-specific and the sample efficiency remains a challenge. We present Plan2Explore, a self-supervised reinforcement learning agent that tackles both…

Machine Learning · Computer Science 2020-07-02 Ramanan Sekar , Oleh Rybkin , Kostas Daniilidis , Pieter Abbeel , Danijar Hafner , Deepak Pathak

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years. One of the key challenges in manipulation is the exploration of the dynamics of the environment when…

Robotics · Computer Science 2022-10-25 Tim Schneider , Boris Belousov , Georgia Chalvatzaki , Diego Romeres , Devesh K. Jha , Jan Peters

Models based on approximation capabilities have recently been studied in the context of Optimal Recovery. These models, however, are not compatible with overparametrization, since model- and data-consistent functions could then be…

Optimization and Control · Mathematics 2020-04-02 Simon Foucart

Constraints are essential for stabilizing reinforcement learning fine-tuning (RFT) and preventing degenerate outputs, yet they inherently conflict with the optimization objective because stronger constraints limit the ability of a…

Machine Learning · Computer Science 2026-03-20 Hao Ma , Zhiqiang Pu , Yang Liu , Xiaolin Ai

An important factor in the practical implementation of optimization models is the acceptance by the intended users. This is influenced among other factors by the interpretability of the solution process. Decision rules that meet this…

Machine Learning · Computer Science 2024-12-03 Marc Goerigk , Michael Hartisch , Sebastian Merten

Bi-factor analysis is a form of confirmatory factor analysis widely used in psychological and educational measurement. The use of a bi-factor model requires the specification of an explicit bi-factor structure on the relationship between…

Methodology · Statistics 2025-05-21 Jiawei Qiao , Yunxiao Chen , Zhiliang Ying

Designing effective model-based reinforcement learning algorithms is difficult because the ease of data generation must be weighed against the bias of model-generated data. In this paper, we study the role of model usage in policy…

Machine Learning · Computer Science 2021-11-30 Michael Janner , Justin Fu , Marvin Zhang , Sergey Levine

The exploration \& exploitation dilemma poses significant challenges in reinforcement learning (RL). Recently, curiosity-based exploration methods achieved great success in tackling hard-exploration problems. However, they necessitate…

Machine Learning · Computer Science 2024-12-06 Yiran Wang , Chenshu Liu , Yunfan Li , Sanae Amani , Bolei Zhou , Lin F. Yang

We consider the task of training machine learning models with data-dependent constraints. Such constraints often arise as empirical versions of expected value constraints that enforce fairness or stability goals. We reformulate…

Machine Learning · Statistics 2023-01-18 Songkai Xue , Yuekai Sun , Mikhail Yurochkin

A widely adopted approach to solving constraint satisfaction problems combines systematic tree search with various degrees of constraint propagation for pruning the search space. One common technique to improve the execution efficiency is…

Logic in Computer Science · Computer Science 2007-05-23 Chiu Wo Choi , Jimmy Ho-Man Lee , Peter J. Stuckey

For optimization models to be used in practice, it is crucial that users trust the results. A key factor in this aspect is the interpretability of the solution process. A previous framework for inherently interpretable optimization models…

Optimization and Control · Mathematics 2026-02-13 Marc Goerigk , Michael Hartisch , Sebastian Merten , Kartikey Sharma

Reasoning large language models (LLMs) excel in complex tasks, which has drawn significant attention to reinforcement learning (RL) for LLMs. However, existing approaches allocate an equal number of rollouts to all questions during the RL…

Machine Learning · Computer Science 2025-10-21 Mengqi Liao , Xiangyu Xi , Ruinian Chen , Jia Leng , Yangen Hu , Ke Zeng , Shuai Liu , Huaiyu Wan

The Abstraction Refinement Model has been widely adopted since it was firstly proposed many decades ago. This powerful model of software evolution process brings important properties into the system under development, properties such as the…

Software Engineering · Computer Science 2022-10-28 Mohamed Toufik Ailane , Christoph Knieke , Andreas Rausch

The exploration of complex physical or technological processes usually requires exploiting available information from different sources: (i) physical laws often represented as a family of parameter dependent partial differential equations…

Numerical Analysis · Mathematics 2020-02-04 Albert Cohen , Wolfgang Dahmen , Ron DeVore

Ensuring safety in industrial control systems usually involves imposing constraints at the design stage of the control algorithm. Enforcing constraints is challenging if the underlying functional form is unknown. The challenge can be…

Optimization and Control · Mathematics 2023-06-09 Marta Zagorowska , Efe C. Balta , Varsha Behrunani , Alisa Rupenyan , John Lygeros