中文
相关论文

相关论文: Imitate TheWorld: A Search Engine Simulation Platf…

200 篇论文

We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm for learning adaptive policies that can be transferred between environments of varying dynamics, by imitating a small number of demonstrations collected from a single…

机器学习 · 计算机科学 2020-08-31 Yiren Lu , Jonathan Tompson

Reinforcement learning algorithms typically utilize an interactive simulator (i.e., environment) with a predefined reward function for policy training. Developing such simulators and manually defining reward functions, however, is often…

机器学习 · 计算机科学 2026-03-26 Woo-Jin Ahn , Sang-Ryul Baek , Yong-Jun Lee , Hyun-Duck Choi , Myo-Taeg Lim

Agent-based modeling (ABM) has long been used in economics to study human behavior, and large language model (LLM) agents now enable new forms of social and economic simulation. While prior work has discovered strategic deception by LLM…

Researchers have developed excellent feed-forward models that learn to map images to desired outputs, such as to the images' latent factors, or to other images, using supervised learning. Learning such mappings from unlabelled data, or…

计算机视觉与模式识别 · 计算机科学 2017-11-21 Hsiao-Yu Fish Tung , Adam W. Harley , William Seto , Katerina Fragkiadaki

Generative Adversarial Imitation Learning (GAIL) is a powerful and practical approach for learning sequential decision-making policies. Different from Reinforcement Learning (RL), GAIL takes advantage of demonstration data by experts (e.g.,…

机器学习 · 计算机科学 2020-01-14 Minshuo Chen , Yizhou Wang , Tianyi Liu , Zhuoran Yang , Xingguo Li , Zhaoran Wang , Tuo Zhao

Adversarial imitation learning (AIL) has become a popular alternative to supervised imitation learning that reduces the distribution shift suffered by the latter. However, AIL requires effective exploration during an online reinforcement…

机器学习 · 计算机科学 2023-10-16 Trevor Ablett , Bryan Chan , Jonathan Kelly

Post-hoc saliency methods are widely used to interpret deep neural networks, but their faithfulness is difficult to evaluate reliably. Existing evaluations mask features according to saliency-induced feature ordering and measure performance…

机器学习 · 计算机科学 2026-05-19 Chia-Ying Hsieh , Hsin-Yuan Fang , Chun-Shu Wei

In robotic manipulation, acquiring samples is extremely expensive because it often requires interacting with the real world. Traditional image-level data augmentation has shown the potential to improve sample efficiency in various machine…

机器人学 · 计算机科学 2022-11-02 Mingxi Jia , Dian Wang , Guanang Su , David Klee , Xupeng Zhu , Robin Walters , Robert Platt

This paper introduces a novel generalized self-imitation learning ($\textbf{GSIL}$) framework, which effectively and efficiently aligns large language models with offline demonstration data. We develop $\textbf{GSIL}$ by deriving a…

计算与语言 · 计算机科学 2024-10-15 Teng Xiao , Mingxiao Li , Yige Yuan , Huaisheng Zhu , Chao Cui , Vasant G Honavar

The development of open benchmarking platforms could greatly accelerate the adoption of AI agents in retail. This paper presents comprehensive simulations of customer shopping behaviors for the purpose of benchmarking reinforcement learning…

人工智能 · 计算机科学 2024-05-20 Yu Xia , Sriram Narayanamoorthy , Zhengyuan Zhou , Joshua Mabry

Search query variation poses a challenge in e-commerce search, as equivalent search intents can be expressed through different queries with surface-level differences. This paper introduces a framework to recognize and leverage query…

信息检索 · 计算机科学 2023-08-09 Aritra Mandal , Daniel Tunkelang , Zhe Wu

Relevance modeling aims to locate desirable items for corresponding queries, which is crucial for search engines to ensure user experience. Although most conventional approaches address this problem by assessing the semantic similarity…

信息检索 · 计算机科学 2023-10-25 Zeyuan Chen , Wei Chen , Jia Xu , Zhongyi Liu , Wei Zhang

Contemporary real-world online ad auctions differ from canonical models [Edelman et al., 2007; Varian, 2009] in at least four ways: (1) values and click-through rates can depend upon users' search queries, but advertisers can only partially…

机器学习 · 计算机科学 2024-04-11 Ming Chen , Sareh Nabi , Marciano Siniscalchi

Many adversarial attacks have been proposed to investigate the security issues of deep neural networks. In the black-box setting, current model stealing attacks train a substitute model to counterfeit the functionality of the target model.…

计算机视觉与模式识别 · 计算机科学 2021-04-07 Chen Ma , Li Chen , Jun-Hai Yong

Effective query reformulation is pivotal in narrowing the gap between a user's exploratory search behavior and the identification of relevant products in e-commerce environments. While traditional approaches predominantly model query…

信息检索 · 计算机科学 2025-10-20 Jayanth Yetukuri , Mehran Elyasi , Samarth Agrawal , Aritra Mandal , Rui Kong , Harish Vempati , Ishita Khan

Many active learning and search approaches are intractable for large-scale industrial settings with billions of unlabeled examples. Existing approaches search globally for the optimal examples to label, scaling linearly or even…

In the rapidly evolving landscape of eCommerce, Artificial Intelligence (AI) based pricing algorithms, particularly those utilizing Reinforcement Learning (RL), are becoming increasingly prevalent. This rise has led to an inextricable…

机器学习 · 计算机科学 2024-06-06 Michael Schlechtinger , Damaris Kosack , Franz Krause , Heiko Paulheim

Decision-making in long-tail scenarios is pivotal to autonomous-driving development, and realistic and challenging simulations play a crucial role in testing safety-critical situations. However, existing open-source datasets lack systematic…

机器人学 · 计算机科学 2025-09-09 Chuancheng Zhang , Zhenhao Wang , Jiangcheng Wang , Kun Su , Qiang Lv , Bin Jiang , Kunkun Hao , Wenyu Wang

Imitation learning algorithms learn viable policies by imitating an expert's behavior when reward signals are not available. Generative Adversarial Imitation Learning (GAIL) is a state-of-the-art algorithm for learning policies when the…

The aim in imitation learning is to learn effective policies by utilizing near-optimal expert demonstrations. However, high-quality demonstrations from human experts can be expensive to obtain in large numbers. On the other hand, it is…

机器学习 · 计算机科学 2021-10-29 Mengjiao Yang , Sergey Levine , Ofir Nachum