English
Related papers

Related papers: On Learning Action Costs from Input Plans

200 papers

We introduce online learning with vector costs (\OLVCp) where in each time step $t \in \{1,\ldots, T\}$, we need to play an action $i \in \{1,\ldots,n\}$ that incurs an unknown vector cost in $[0,1]^{d}$. The goal of the online algorithm is…

Machine Learning · Computer Science 2020-10-19 Thomas Kesselheim , Sahil Singla

The goal of strategic classification is to learn decision rules which are robust to strategic input manipulation. Earlier works assume that these responses are known; while some recent works handle unknown responses, they exclusively study…

Machine Learning · Computer Science 2024-06-24 Elan Rosenfeld , Nir Rosenfeld

We consider the setting of iterative learning control, or model-based policy learning in the presence of uncertain, time-varying dynamics. In this setting, we propose a new performance metric, planning regret, which replaces the standard…

Machine Learning · Computer Science 2021-03-01 Naman Agarwal , Elad Hazan , Anirudha Majumdar , Karan Singh

Existing approaches to active learning maximize the system performance by sampling unlabeled instances for annotation that yield the most efficient training. However, when active learning is integrated with an end-user application, this can…

Computation and Language · Computer Science 2020-05-13 Ji-Ung Lee , Christian M. Meyer , Iryna Gurevych

We address challenges of active learning under scarce informational resources in non-stationary environments. In real-world settings, data labeled and integrated into a predictive model may become invalid over time. However, the data can…

Machine Learning · Computer Science 2012-06-26 Ashish Kapoor , Eric J. Horvitz

Many applications require the collection of data on different variables or measurements over many system performance metrics. We term those broadly as measures or variables. Often data collection along each measure incurs a cost, thus it is…

Methodology · Statistics 2021-11-30 Donghui Yan , Zhiwei Qin , Songxiang Gu , Haiping Xu , Ming Shao

A recent line of works apply machine learning techniques to assist or rebuild cost-based query optimizers in DBMS. While exhibiting superiority in some benchmarks, their deficiencies, e.g., unstable performance, high training cost, and slow…

Databases · Computer Science 2023-02-21 Rong Zhu , Wei Chen , Bolin Ding , Xingguang Chen , Andreas Pfadler , Ziniu Wu , Jingren Zhou

This paper presents a sampling-based method for optimal motion planning in non-holonomic systems in the absence of known cost functions. It uses the principle of learning through experience to deduce the cost-to-go of regions within the…

Robotics · Computer Science 2021-01-08 Nahas Pareekutty , Francis James , Balaraman Ravindran , Suril V. Shah

Inspired by human learning, researchers have proposed ordering examples during training based on their difficulty. Both curriculum learning, exposing a network to easier examples early in training, and anti-curriculum learning, showing the…

Machine Learning · Computer Science 2021-02-10 Xiaoxia Wu , Ethan Dyer , Behnam Neyshabur

Curriculum learning (CL) is a commonly used machine learning training strategy. However, we still lack a clear theoretical understanding of CL's benefits. In this paper, we study the benefits of CL in the multitask linear regression problem…

Machine Learning · Statistics 2021-11-16 Ziping Xu , Ambuj Tewari

Model efficiency is a critical aspect of developing and deploying machine learning models. Inference time and latency directly affect the user experience, and some applications have hard requirements. In addition to inference costs, model…

Machine Learning · Computer Science 2022-03-17 Mostafa Dehghani , Anurag Arnab , Lucas Beyer , Ashish Vaswani , Yi Tay

Resource-constrained classification tasks are common in real-world applications such as allocating tests for disease diagnosis, hiring decisions when filling a limited number of positions, and defect detection in manufacturing settings…

Machine Learning · Computer Science 2023-11-22 Danit Shifman Abukasis , Izack Cohen , Xiaochen Xian , Kejun Huang , Gonen Singer

We construct and analyze active learning algorithms for the problem of binary classification with abstention. We consider three abstention settings: \emph{fixed-cost} and two variants of \emph{bounded-rate} abstention, and for each of them…

Machine Learning · Computer Science 2019-06-04 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

We formulate the problem of learning to imitate multiple, non-deterministic teachers with minimal interaction cost. Rather than learning a specific policy as in standard imitation learning, the goal in this problem is to learn a…

Machine Learning · Computer Science 2020-06-16 Khanh Nguyen , Hal Daumé

Plan Recognition algorithms require to recognize a complete hierarchy explaining the agent's actions and goals. While the output of such algorithms is informative to the recognizer, the cost of its calculation is high in run-time, space,…

Artificial Intelligence · Computer Science 2017-03-03 Retuh Mirsky , Ya'akov , Gal

Learning new skills by observing humans' behaviors is an essential capability of AI. In this work, we leverage instructional videos to study humans' decision-making processes, focusing on learning a model to plan goal-directed actions in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Jing Bi , Jiebo Luo , Chenliang Xu

Curriculum learning strategies in prior multi-task learning approaches arrange datasets in a difficulty hierarchy either based on human perception or by exhaustively searching the optimal arrangement. However, human perception of difficulty…

Machine Learning · Computer Science 2022-05-30 Neeraj Varshney , Swaroop Mishra , Chitta Baral

There is a widespread intuition that model-based control methods should be able to surpass the data efficiency of model-free approaches. In this paper we attempt to evaluate this intuition on various challenging locomotion tasks. We take a…

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

Machine Learning · Computer Science 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

Many studies on the cost-sensitive learning assumed that a unique cost matrix is known for a problem. However, this assumption may not hold for many real-world problems. For example, a classifier might need to be applied in several…

Machine Learning · Computer Science 2012-05-03 Rui Wang , Ke Tang