English
Related papers

Related papers: Principled Option Learning in Markov Decision Proc…

200 papers

In the paper, we propose a novel methodology to map learning algorithms on data (performance map) in order to gain more insights in the distribution of their performances across their parameter space. This methodology provides useful…

Machine Learning · Computer Science 2021-07-16 Filippo Neri

In the theory of social choice the research is focused around the projection of individual preference orders to the social preference order. Also, the justification of the preference order formalism begins with the concept of utility i.e.…

Computer Science and Game Theory · Computer Science 2010-10-27 Redjan F. Shabani

This paper surveys the recent attempts, both from the machine learning and operations research communities, at leveraging machine learning to solve combinatorial optimization problems. Given the hard nature of these problems,…

Machine Learning · Computer Science 2020-03-16 Yoshua Bengio , Andrea Lodi , Antoine Prouvost

Revision of the paper previously entitled "Learning a Machine for the Decision in a Partially Observable Markov Universe" In this paper, we are interested in optimal decisions in a partially observable universe. Our approach is to directly…

Optimization and Control · Mathematics 2007-06-13 Frederic Dambreville

The paper introduces a generalization for known probabilistic models such as log-linear and graphical models, called here multiplicative models. These models, that express probabilities via product of parameters are shown to capture…

Artificial Intelligence · Computer Science 2012-06-18 Ydo Wexler , Christopher Meek

Recommender systems use algorithms to provide users with product or service recommendations. Recently, these systems have been using machine learning algorithms from the field of artificial intelligence. However, choosing a suitable machine…

Software Engineering · Computer Science 2016-02-25 Ivens Portugal , Paulo Alencar , Donald Cowan

Randomized sampling based algorithms are widely used in robot motion planning due to the problem's intractability, and are experimentally effective on a wide range of problem instances. Most variants do not sample uniformly at random, and…

We consider the challenge of preference elicitation in systems that help users discover the most desirable item(s) within a given database. Past work on preference elicitation focused on structured models that provide a factored…

Artificial Intelligence · Computer Science 2012-07-19 Ronen I. Brafman , Carmel Domshlak , Tanya Kogan

Describing systems in terms of choices and their resulting costs and rewards offers the promise of freeing algorithm designers and programmers from specifying how those choices should be made; in implementations, the choices can be realized…

Logic in Computer Science · Computer Science 2024-02-14 Martin Abadi , Gordon Plotkin

Preference-based reward learning is a popular technique for teaching robots and autonomous systems how a human user wants them to perform a task. Previous works have shown that actively synthesizing preference queries to maximize…

Robotics · Computer Science 2024-03-12 Evan Ellis , Gaurav R. Ghosal , Stuart J. Russell , Anca Dragan , Erdem Bıyık

Many real-world decision processes are modeled by optimization problems whose defining parameters are unknown and must be inferred from observable data. The Predict-Then-Optimize framework uses machine learning models to predict unknown…

Machine Learning · Computer Science 2023-11-23 James Kotary , Vincenzo Di Vito , Jacob Christopher , Pascal Van Hentenryck , Ferdinando Fioretto

Class-incremental learning deals with sequential data streams composed of batches of classes. Various algorithms have been proposed to address the challenging case where samples from past classes cannot be stored. However, selecting an…

Machine Learning · Computer Science 2024-03-28 Eva Feillet , Adrian Popescu , Céline Hudelot

Data-efficient learning algorithms are essential in many practical applications where data collection is expensive, e.g., in robotics due to the wear and tear. To address this problem, meta-learning algorithms use prior experience about…

Machine Learning · Computer Science 2020-10-26 Jean Kaddour , Steindór Sæmundsson , Marc Peter Deisenroth

In this paper, we propose how to use objective arguments grounded in statistical mechanics concepts in order to obtain a single number, obtained after aggregation, which would allow to rank "agents", "opinions", ..., all defined in a very…

Physics and Society · Physics 2024-05-02 Marcel Ausloos , Giulia Rotundo , Roy Cerqueti

From this set of procedures for given clause we shall choose only interrogation of experts on pairs decisions. It is widely widespread method. It makes the whole chapter in the theory of the decision-making, well investigated with the…

Optimization and Control · Mathematics 2010-03-05 V. Zhukovin , N. Chkhikvadze , Z. Alimbarashvili

The notion of preferences plays an important role in many disciplines including service robotics which is concerned with scenarios in which robots interact with humans. These interactions can be favored by robots taking human preferences…

Human preferences are not always represented via complete linear orders: It is natural to employ partially-ordered preferences for expressing incomparable outcomes. In this work, we consider decision-making and probabilistic planning in…

Robotics · Computer Science 2024-10-21 Hazhar Rahmani , Abhishek N. Kulkarni , Jie Fu

We consider grammar-restricted exact learning of formulas and terms in finite variable logics. We propose a novel and versatile automata-theoretic technique for solving such problems. We first show results for learning formulas that…

Logic in Computer Science · Computer Science 2021-11-15 Paul Krogmeier , P. Madhusudan

Model explainability is crucial for human users to be able to interpret how a proposed classifier assigns labels to data based on its feature values. We study generalized linear models constructed using sets of feature value rules, which…

Machine Learning · Statistics 2023-11-06 Sanjeeb Dash , Soumyadip Ghosh , Joao Goncalves , Mark S. Squillante

In this paper, we provide a novel algorithm for solving planning and learning problems of Markov decision processes. The proposed algorithm follows a policy iteration-type update by using a rank-one approximation of the transition…

Optimization and Control · Mathematics 2025-10-23 Arman Sharifi Kolarijani , Tolga Ok , Peyman Mohajerin Esfahani , Mohamad Amin Sharif Kolarijani