English
Related papers

Related papers: Adversarial Gradient Driven Exploration for Deep C…

200 papers

Incomplete knowledge of the environment leads an agent to make decisions under uncertainty. One of the major dilemmas in Reinforcement Learning (RL) where an autonomous agent has to balance two contrasting needs in making its decisions is:…

Machine Learning · Statistics 2024-02-21 Valentina Zangirolami , Matteo Borrotti

Modern information retrieval systems, including web search, ads placement, and recommender systems, typically rely on learning from user feedback. Click models, which study how users interact with a ranked list of items, provide a useful…

Information Retrieval · Computer Science 2021-04-20 Xinyi Dai , Jianghao Lin , Weinan Zhang , Shuai Li , Weiwen Liu , Ruiming Tang , Xiuqiang He , Jianye Hao , Jun Wang , Yong Yu

Deep Neural Networks (DNNs) are well-known to be vulnerable to Adversarial Examples (AEs). A large amount of efforts have been spent to launch and heat the arms race between the attackers and defenders. Recently, advanced gradient-based…

Cryptography and Security · Computer Science 2020-05-29 Han Qiu , Yi Zeng , Qinkai Zheng , Tianwei Zhang , Meikang Qiu , Gerard Memmi

Reinforcement learning (RL) with sparse and deceptive rewards is challenging because non-zero rewards are rarely obtained. Hence, the gradient calculated by the agent can be stochastic and without valid information. Recent studies that…

Machine Learning · Computer Science 2024-02-08 Guojian Wang , Faguo Wu , Xiao Zhang , Jianxiang Liu

Due to the limited availability of medical data, deep learning approaches for medical image analysis tend to generalise poorly to unseen data. Augmenting data during training with random transformations has been shown to help and became a…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Tian Xia , Pedro Sanchez , Chen Qin , Sotirios A. Tsaftaris

We present a general computational framework for solving continuous-time financial market equilibria under minimal modeling assumptions while incorporating realistic financial frictions, such as trading costs, and supporting multiple…

Mathematical Finance · Quantitative Finance 2025-04-08 Anastasis Kratsios , Xiaofei Shi , Qiang Sun , Zhanhao Zhang

Gaze estimation models are widely used in applications such as driver attention monitoring and human-computer interaction. While many methods for gaze estimation exist, they rely heavily on data-hungry deep learning to achieve high…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Lingyu Du , Yupei Liu , Jinyuan Jia , Guohao Lan

The discounting mechanism in Reinforcement Learning determines the relative importance of future and present rewards. While exponential discounting is widely used in practice, non-exponential discounting methods that align with human…

Machine Learning · Computer Science 2023-02-14 Ariel Kwiatkowski , Vicky Kalogeiton , Julien Pettré , Marie-Paule Cani

Generative adversarial networks (GANs) have been a popular deep generative model for real-world applications. Despite many recent efforts on GANs that have been contributed, mode collapse and instability of GANs are still open problems…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Shiming Chen , Wenjie Wang , Beihao Xia , Xinge You , Zehong Cao , Weiping Ding

We introduce an online active exploration algorithm for data-efficiently learning an abstract symbolic model of an environment. Our algorithm is divided into two parts: the first part quickly generates an intermediate Bayesian symbolic…

Artificial Intelligence · Computer Science 2017-11-02 Garrett Andersen , George Konidaris

It has been a challenge to learning skills for an agent from long-horizon unannotated demonstrations. Existing approaches like Hierarchical Imitation Learning(HIL) are prone to compounding errors or suboptimal solutions. In this paper, we…

Machine Learning · Computer Science 2021-06-14 Mingxuan Jing , Wenbing Huang , Fuchun Sun , Xiaojian Ma , Tao Kong , Chuang Gan , Lei Li

Advances in the development of adversarial attacks have been fundamental to the progress of adversarial defense research. Efficient and effective attacks are crucial for reliable evaluation of defenses, and also for developing robust…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Gaurang Sriramanan , Sravanti Addepalli , Arya Baburaj , R. Venkatesh Babu

Autonomous racing creates challenging control problems, but Model Predictive Control (MPC) has made promising steps toward solving both the minimum lap-time problem and head-to-head racing. Yet, accurate models of the system are necessary…

Systems and Control · Electrical Eng. & Systems 2023-11-06 Tommaso Benciolini , Chen Tang , Marion Leibold , Catherine Weaver , Masayoshi Tomizuka , Wei Zhan

Autonomous vehicles in interactive traffic environments are often limited by the scarcity of safety-critical tail events in static datasets, which biases learned policies toward average-case behaviors and reduces robustness. Existing…

Robotics · Computer Science 2026-04-10 Yicheng Guo , Jiaqi Liu , Chengkai Xu , Peng Hang , Jian Sun

Discrete choice models are fundamental tools in management science, economics, and marketing for understanding and predicting decision-making. Logit-based models are dominant in applied work, largely due to their convenient closed-form…

Methodology · Statistics 2026-04-06 Easton Huch , Michael Keane

Testing new, innovative technologies is a crucial task for safety and acceptance. But how can new systems be tested if no historical real-world data exist? Simulation provides an answer to this important question. Classical simulation tools…

Machine Learning · Statistics 2020-09-04 Tom Peetz , Sebastian Vogt , Martin Zaefferer , Thomas Bartz-Beielstein

This paper proposes Evolutionary Multi-objective Optimization (EMO)-based Adversarial Example (AE) design method that performs under black-box setting. Previous gradient-based methods produce AEs by changing all pixels of a target image,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Takahiro Suzuki , Shingo Takeshita , Satoshi Ono

While leveraging additional training data is well established to improve adversarial robustness, it incurs the unavoidable cost of data collection and the heavy computation to train models. To mitigate the costs, we propose Guided…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Salah Ghamizi , Jingfeng Zhang , Maxime Cordy , Mike Papadakis , Masashi Sugiyama , Yves Le Traon

Deep neural networks (DNNs) are vulnerable to adversarial examples obtained by adding small perturbations to original examples. The added perturbations in existing attacks are mainly determined by the gradient of the loss function with…

Cryptography and Security · Computer Science 2023-06-06 Chen Wan , Fangjun Huang

This paper investigates recently proposed approaches for defending against adversarial examples and evaluating adversarial robustness. We motivate 'adversarial risk' as an objective for achieving models robust to worst-case inputs. We then…

Machine Learning · Computer Science 2018-06-13 Jonathan Uesato , Brendan O'Donoghue , Aaron van den Oord , Pushmeet Kohli