English
Related papers

Related papers: $\pi2\text{vec}$: Policy Representations with Succ…

200 papers

We introduce a new family of video prediction models designed to support downstream control tasks. We call these models Video Occupancy models (VOCs). VOCs operate in a compact latent space, thus avoiding the need to make predictions about…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Manan Tomar , Philippe Hansen-Estruch , Philip Bachman , Alex Lamb , John Langford , Matthew E. Taylor , Sergey Levine

Studying competition and market structure at the product level instead of brand level can provide firms with insights on cannibalization and product line optimization. However, it is computationally challenging to analyze product-level…

Machine Learning · Computer Science 2020-05-22 Fanglin Chen , Xiao Liu , Davide Proserpio , Isamar Troncoso , Feiyu Xiong

In this work we investigate the representation of counterfactual conditionals using the vector logic, a matrix-vectors formalism for logical functions and truth values. Inside this formalism, the counterfactuals can be transformed in…

Computation and Language · Computer Science 2020-09-03 Eduardo Mizraji

Policy evaluation is a fundamental component of the development and deployment pipeline for robotic policies. In modern manipulation systems, this problem is particularly challenging: rewards are often sparse, task progression of evaluation…

Robotics · Computer Science 2026-05-13 Hao Wang , Joshua Bowden , Colton Crosby , Somil Bansal

Foreign policy analysis has been struggling to find ways to measure policy preferences and paradigm shifts in international political systems. This paper presents a novel, potential solution to this challenge, through the application of a…

Computation and Language · Computer Science 2017-07-13 Stefano Gurciullo , Slava Mikhaylov

We present an approach to explain the decisions of black box models for image classification. While using the black box to label images, our explanation method exploits the latent feature space learned through an adversarial autoencoder.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Riccardo Guidotti , Anna Monreale , Stan Matwin , Dino Pedreschi

Learning effective visuomotor policies for robotic manipulation is challenging, as it requires generating precise actions while maintaining computational efficiency. Existing methods remain unsatisfactory due to inherent limitations in the…

Robotics · Computer Science 2025-10-07 Yiming Zhong , Yumeng Liu , Chuyang Xiao , Zemin Yang , Youzhuo Wang , Yufei Zhu , Ye Shi , Yujing Sun , Xinge Zhu , Yuexin Ma

In the context of computational social choice, we study voting methods that assign a set of winners to each profile of voter preferences. A voting method satisfies the property of positive involvement (PI) if for any election in which a…

Computer Science and Game Theory · Computer Science 2021-06-23 Wesley H. Holliday , Eric Pacuit

Off-policy evaluation (OPE) is widely applied in sectors such as pharmaceuticals and e-commerce to evaluate the efficacy of novel products or policies from offline datasets. This paper introduces a causal deepset framework that relaxes…

Machine Learning · Statistics 2024-07-26 Runpeng Dai , Jianing Wang , Fan Zhou , Shikai Luo , Zhiwei Qin , Chengchun Shi , Hongtu Zhu

Artificial intelligence techniques are increasingly being applied to solve control problems, but often rely on black-box methods without transparent output generation. To improve the interpretability and transparency in control systems,…

Neural and Evolutionary Computing · Computer Science 2025-06-11 Sigur de Vries , Sander Keemink , Marcel van Gerven

In high-stakes applications of data-driven decision making like healthcare, it is of paramount importance to learn a policy that maximizes the reward while avoiding potentially dangerous actions when there is uncertainty. There are two main…

Machine Learning · Computer Science 2022-03-10 Mahed Abroshan , Kai Hou Yip , Cem Tekin , Mihaela van der Schaar

Reinforcement learning is well suited for optimizing policies of recommender systems. Current solutions mostly focus on model-free approaches, which require frequent interactions with the real environment, and thus are expensive in model…

Machine Learning · Computer Science 2020-01-22 Xueying Bai , Jian Guan , Hongning Wang

We propose a Geometry-aware Policy Imitation (GPI) approach that rethinks imitation learning by treating demonstrations as geometric curves rather than collections of state-action samples. From these curves, GPI derives distance fields that…

Robotics · Computer Science 2025-10-13 Yiming Li , Nael Darwiche , Amirreza Razmjoo , Sichao Liu , Yilun Du , Auke Ijspeert , Sylvain Calinon

Explaining and reasoning about processes which underlie observed black-box phenomena enables the discovery of causal mechanisms, derivation of suitable abstract representations and the formulation of more robust predictions. We propose to…

Artificial Intelligence · Computer Science 2017-07-27 Svetlin Penkov , Subramanian Ramamoorthy

Complementary products recommendation is an important problem in e-commerce. Such recommendations increase the average order price and the number of products in baskets. Complementary products are typically inferred from basket data. In…

Information Retrieval · Computer Science 2018-09-27 Ilya Trofimov

Transfer in reinforcement learning refers to the notion that generalization should occur not only within a task but also across tasks. We propose a transfer framework for the scenario where the reward function changes between tasks but the…

Artificial Intelligence · Computer Science 2018-04-13 André Barreto , Will Dabney , Rémi Munos , Jonathan J. Hunt , Tom Schaul , Hado van Hasselt , David Silver

We revisit the problem of offline reinforcement learning with value function realizability but without Bellman completeness. Previous work by Xie and Jiang (2021) and Foster et al. (2022) left open the question whether a bounded…

Machine Learning · Computer Science 2024-03-27 Zeyu Jia , Alexander Rakhlin , Ayush Sekhari , Chen-Yu Wei

We propose Partially Interpretable Estimators (PIE) which attribute a prediction to individual features via an interpretable model, while a (possibly) small part of the PIE prediction is attributed to the interaction of features via a…

Machine Learning · Computer Science 2021-05-07 Tong Wang , Jingyi Yang , Yunyi Li , Boxiang Wang

In this paper, we propose a method that efficiently utilizes appearance features and text vectors to accurately classify political posters from other similar political images. The majority of this work focuses on political posters that are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Xuan Qin , Meizhu Liu , Yifan Hu , Christina Moo , Christian M. Riblet , Changwei Hu , Kevin Yen , Haibin Ling

Options in reinforcement learning allow agents to hierarchically decompose a task into subtasks, having the potential to speed up learning and planning. However, autonomously learning effective sets of options is still a major challenge in…

Machine Learning · Computer Science 2018-02-27 Marlos C. Machado , Clemens Rosenbaum , Xiaoxiao Guo , Miao Liu , Gerald Tesauro , Murray Campbell