中文
相关论文

相关论文: Learning Beam Search Policies via Imitation Learni…

200 篇论文

In recent years, we know that the interaction with images has increased. Image similarity involves fetching similar-looking images abiding by a given reference image. The target is to find out whether the image searched as a query can…

计算机视觉与模式识别 · 计算机科学 2022-05-19 Sayan Nath , Nikhil Nayak

Among the most impressive recent applications of neural decoding is the visual representation decoding, where the category of an object that a subject either sees or imagines is inferred by observing his/her brain activity. Even though…

神经与进化计算 · 计算机科学 2018-11-06 Angeliki Papadimitriou , Nikolaos Passalis , Anastasios Tefas

Classically, imitation learning algorithms have been developed for idealized situations, e.g., the demonstrations are often required to be collected in the exact same environment and usually include the demonstrator's actions. Recently,…

机器学习 · 计算机科学 2019-06-20 Faraz Torabi , Garrett Warnell , Peter Stone

Imitation learning seeks to learn an expert policy from sampled demonstrations. However, in the real world, it is often difficult to find a perfect expert and avoiding dangerous behaviors becomes relevant for safety reasons. We present the…

机器学习 · 计算机科学 2019-09-26 David Venuto , Leonard Boussioux , Junhao Wang , Rola Dali , Jhelum Chakravorty , Yoshua Bengio , Doina Precup

Complex planning and scheduling problems have long been solved using various optimization or heuristic approaches. In recent years, imitation learning that aims to learn from expert demonstrations has been proposed as a viable alternative…

机器学习 · 计算机科学 2024-05-24 Qian Shao , Pradeep Varakantham , Shih-Fen Cheng

In imitation learning, imitators and demonstrators are policies for picking actions given past interactions with the environment. If we run an imitator, we probably want events to unfold similarly to the way they would have if the…

机器学习 · 计算机科学 2022-10-05 Michael K. Cohen , Marcus Hutter , Neel Nanda

Amidst the wide popularity of imitation learning algorithms in robotics, their properties regarding hyperparameter sensitivity, ease of training, data efficiency, and performance have not been well-studied in high-precision…

机器人学 · 计算机科学 2024-08-27 Michael Drolet , Simon Stepputtis , Siva Kailas , Ajinkya Jain , Jan Peters , Stefan Schaal , Heni Ben Amor

Similarity query is the family of queries based on some similarity metrics. Unlike the traditional database queries which are mostly based on value equality, similarity queries aim to find targets "similar enough to" the given data objects,…

数据库 · 计算机科学 2022-04-19 Yifan Wang

There have been multiple recent proposals on using deep neural networks for code search using natural language. Common across these proposals is the idea of $\mathit{embedding}$ code and natural language queries, into real vectors and then…

软件工程 · 计算机科学 2019-10-16 Jose Cambronero , Hongyu Li , Seohyun Kim , Koushik Sen , Satish Chandra

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

机器学习 · 计算机科学 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

Imitation learning is a way to teach robots skills that are demonstrated by humans. Transfering skills between these different kinematic structures seems to be straightforward in Cartesian space. Because of the correspondence problem,…

机器人学 · 计算机科学 2019-06-11 Alexander Fabisch

Imitation Learning (IL) is an effective learning paradigm exploiting the interactions between agents and environments. It does not require explicit reward signals and instead tries to recover desired policies using expert demonstrations. In…

机器学习 · 计算机科学 2021-12-14 Yang Liu , Yongzhe Chang , Shilei Jiang , Xueqian Wang , Bin Liang , Bo Yuan

Over the past decade, deep neural networks have demonstrated significant success using the training scheme that involves mini-batch stochastic gradient descent on extensive datasets. Expanding upon this accomplishment, there has been a…

机器学习 · 计算机科学 2024-11-11 Jaehyeon Son , Soochan Lee , Gunhee Kim

Codebook-based beam selection is one approach for configuring millimeter wave communication links. The overhead required to reconfigure the transmit and receive beam pair, though, increases in highly dynamic vehicular communication systems.…

信号处理 · 电气工程与系统科学 2024-04-18 Ibrahim Kilinc , Ryan M. Dreifuerst , Junghoon Kim , Robert W. Heath

Exploration algorithms for reinforcement learning typically replace or augment the reward function with an additional ``intrinsic'' reward that trains the agent to seek previously unseen states of the environment. Here, we consider an…

机器学习 · 计算机科学 2025-09-30 Kevin McKee , Eric Alt , Andrew Grebenisan , Mick van Gelderen , Gary Miguel

Neural Information Retrieval models hold the promise to replace lexical matching models, e.g. BM25, in modern search engines. While their capabilities have fully shone on in-domain datasets like MS MARCO, they have recently been challenged…

信息检索 · 计算机科学 2021-12-14 Thibault Formal , Benjamin Piwowarski , Stéphane Clinchant

We design a lightweight beam-searching algorithm for mobile millimeter-wave systems. We construct and maintain a set of path skeletons, i.e., potential paths between a user and the serving base station to substantially expedite the…

信号处理 · 电气工程与系统科学 2019-12-30 Sara Khosravi , Hossein S. Ghadikolaei , Marina Petrova

The budgeted information gathering problem - where a robot with a fixed fuel budget is required to maximize the amount of information gathered from the world - appears in practice across a wide range of applications in autonomous…

机器人学 · 计算机科学 2016-11-15 Sanjiban Choudhury , Ashish Kapoor , Gireeja Ranade , Debadeepta Dey

Recently, motion generation by machine learning has been actively researched to automate various tasks. Imitation learning is one such method that learns motions from data collected in advance. However, executing long-term tasks remains…

机器人学 · 计算机科学 2022-03-17 Kazuki Hayashi , Sho Sakaino , Toshiaki Tsuji

Deep learning has become the most popular direction in machine learning and artificial intelligence. However, the preparation of training data, as well as model training, are often time-consuming and become the bottleneck of the end-to-end…

信息检索 · 计算机科学 2022-06-06 Lixi Zhou , Arindam Jain , Zijie Wang , Amitabh Das , Yingzhen Yang , Jia Zou