English
Related papers

Related papers: Reward Shaping Using Convolutional Neural Network

200 papers

In this paper we present a methodology that uses convolutional neural networks (CNNs) for segmentation by iteratively growing predicted mask regions in each coordinate direction. The CNN is used to predict class probability scores in a…

Image and Video Processing · Electrical Eng. & Systems 2020-09-25 John Lagergren , Erica Rutter , Kevin Flores

Recently there has been a proliferation of intrinsic motivation (IM) reward-shaping methods to learn in complex and sparse-reward environments. These methods can often inadvertently change the set of optimal policies in an environment,…

Machine Learning · Computer Science 2024-02-13 Grant C. Forbes , Nitish Gupta , Leonardo Villalobos-Arias , Colin M. Potts , Arnav Jhala , David L. Roberts

Conversational Recommender Systems (CRS) actively elicit user preferences to generate adaptive recommendations. Mainstream reinforcement learning-based CRS solutions heavily rely on handcrafted reward functions, which may not be aligned…

Information Retrieval · Computer Science 2023-11-01 Zhendong Chu , Nan Wang , Hongning Wang

The convolutional neural networks (CNNs) have proven to be a powerful tool for discriminative learning. Recently researchers have also started to show interest in the generative aspects of CNNs in order to gain a deeper understanding of…

Computer Vision and Pattern Recognition · Computer Science 2015-04-10 Jifeng Dai , Yang Lu , Ying-Nian Wu

We present AIRS: Automatic Intrinsic Reward Shaping that intelligently and adaptively provides high-quality intrinsic rewards to enhance exploration in reinforcement learning (RL). More specifically, AIRS selects shaping function from a…

Machine Learning · Computer Science 2023-10-13 Mingqi Yuan , Bo Li , Xin Jin , Wenjun Zeng

This paper presents a framework for Convolutional Neural Network (CNN)-based quality enhancement task, by taking advantage of coding information in the compressed video signal. The motivation is that normative decisions made by the encoder…

Image and Video Processing · Electrical Eng. & Systems 2021-05-13 Fatemeh Nasiri , Wassim Hamidouche , Luce Morin , Nicolas Dhollande , Gildas Cocherel

Convolutional neural networks (CNNs) are widely used for image recognition and text analysis, and have been suggested for application on one-dimensional data as a way to reduce the need for pre-processing steps. Pre-processing is an…

Machine Learning · Computer Science 2020-05-18 Ine L. Jernelv , Dag Roar Hjelme , Yuji Matsuura , Astrid Aksnes

Reward shaping is effective in addressing the sparse-reward challenge in reinforcement learning (RL) by providing immediate feedback through auxiliary, informative rewards. Based on the reward shaping strategy, we propose a novel multi-task…

Machine Learning · Computer Science 2025-10-28 Haozhe Ma , Zhengding Luo , Thanh Vinh Vo , Kuankuan Sima , Tze-Yun Leong

Reward and representation learning are two long-standing challenges for learning an expanding set of robot manipulation skills from sensory observations. Given the inherent cost and scarcity of in-domain, task-specific robot data, learning…

Robotics · Computer Science 2023-03-08 Yecheng Jason Ma , Shagun Sodhani , Dinesh Jayaraman , Osbert Bastani , Vikash Kumar , Amy Zhang

Shape learning, or the ability to leverage shape information, could be a desirable property of convolutional neural networks (CNNs) when target objects have specific shapes. While some research on the topic is emerging, there is no…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yixin Zhang , Maciej A. Mazurowski

This article presents a reduced-order modeling methodology via deep convolutional neural networks (CNNs) for shape optimization applications. The CNN provides a nonlinear mapping between the shapes and their associated attributes while…

Optimization and Control · Mathematics 2022-02-16 Wrik Mallik , Neil Farvolden , Jasmin Jelovica , Rajeev K. Jaiman

Convolutional Neural Networks (CNNs) were recently shown to provide state-of-the-art results for object category viewpoint estimation. However different ways of formulating this problem have been proposed and the competing approaches have…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Francisco Massa , Renaud Marlet , Mathieu Aubry

Recent research has shown that map raw pixels from a single front-facing camera directly to steering commands are surprisingly powerful. This paper presents a convolutional neural network (CNN) to playing the CarRacing-v0 using imitation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Yanyu Zhang

Convolutional neural network (CNN) models have demonstrated great success in various computer vision tasks including image classification and object detection. However, some equally important tasks such as visual tracking remain relatively…

Computer Vision and Pattern Recognition · Computer Science 2015-04-24 Naiyan Wang , Siyi Li , Abhinav Gupta , Dit-Yan Yeung

Recent RL research has utilized reward shaping--particularly complex shaping rewards such as intrinsic motivation (IM)--to encourage agent exploration in sparse-reward environments. While often effective, ``reward hacking'' can lead to the…

Machine Learning · Computer Science 2025-05-20 Grant C. Forbes , Jianxun Wang , Leonardo Villalobos-Arias , Arnav Jhala , David L. Roberts

The use of Potential-Based Reward Shaping (PBRS) has shown great promise in the ongoing research effort to tackle sample inefficiency in Reinforcement Learning (RL). However, choosing the right potential function remains an open challenge.…

Machine Learning · Computer Science 2025-08-12 Giuseppe Canonaco , Leo Ardon , Alberto Pozanco , Daniel Borrajo

Path planning is an important topic in robotics. Recently, value iteration based deep learning models have achieved good performance such as Value Iteration Network(VIN). However, previous methods suffer from slow convergence and low…

Robotics · Computer Science 2021-04-30 Buqing Nie , Yue Gao , Yidong Mei , Feng Gao

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

Deep Reinforcement Learning has enabled the learning of policies for complex tasks in partially observable environments, without explicitly learning the underlying model of the tasks. While such model-free methods achieve considerable…

Machine Learning · Computer Science 2017-01-11 Tanmay Shankar , Santosha K. Dwivedy , Prithwijit Guha

Designing effective reward functions remains a central challenge in reinforcement learning, especially in multi-objective environments. In this work, we propose Multi-Objective Reward Shaping with Exploration (MORSE), a general framework…

Machine Learning · Computer Science 2025-12-18 Yuqing Xie , Jiayu Chen , Wenhao Tang , Ya Zhang , Chao Yu , Yu Wang