English
Related papers

Related papers: Airfoil Shape Optimization using Deep Q-Network

200 papers

This paper proposes an Improved Noisy Deep Q-Network (Noisy DQN) to enhance the exploration and stability of Unmanned Aerial Vehicle (UAV) when applying deep reinforcement learning in simulated environments. This method enhances the…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Zhang Hengyu , Maryam Cheraghy , Liu Wei , Armin Farhadi , Meysam Soltanpour , Zhong Zhuoqing

Effective airfoil geometry optimization requires exploring a diverse range of designs using as few design variables as possible. This study introduces AirDbM, a Design-by-Morphing (DbM) approach specialized for airfoil optimization that…

Machine Learning · Computer Science 2025-11-17 Sangjoon Lee , Haris Moazam Sheikh

We consider a dynamic multichannel access problem, where multiple correlated channels follow an unknown joint Markov model. A user at each time slot selects a channel to transmit data and receives a reward based on the success or failure of…

Networking and Internet Architecture · Computer Science 2018-02-21 Shangxing Wang , Hanpeng Liu , Pedro Henrique Gomes , Bhaskar Krishnamachari

Drones equipped with overhead manipulators offer unique capabilities for inspection, maintenance, and contact-based interaction. However, the motion of the drone and its manipulator is tightly linked, and even small attitude changes caused…

Robotics · Computer Science 2026-03-30 Hazim Alzorgan , Sayed Pedram Haeri Boroujeni , Abolfazl Razi

Global optimization of aerodynamic shapes usually requires a large number of expensive computational fluid dynamics simulations because of the high dimensionality of the design space. One approach to combat this problem is to reduce the…

Computational Engineering, Finance, and Science · Computer Science 2020-06-30 Wei Chen , Kevin Chiu , Mark Fuge

Meshing is a critical, but user-intensive process necessary for stable and accurate simulations in computational fluid dynamics (CFD). Mesh generation is often a bottleneck in CFD pipelines. Adaptive meshing techniques allow the mesh to be…

Machine Learning · Computer Science 2022-12-06 Cooper Lorsung , Amir Barati Farimani

Considering its advantages in dealing with high-dimensional visual input and learning control policies in discrete domain, Deep Q Network (DQN) could be an alternative method of traditional auto-focus means in the future. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Xiaofan Yu , Runze Yu , Jingsong Yang , Xiaohui Duan

Currently decision making is one of the biggest challenges in autonomous driving. This paper introduces a method for safely navigating an autonomous vehicle in highway scenarios by combining deep Q-Networks and insight from control theory.…

Robotics · Computer Science 2023-03-23 Max Peter Ronecker , Yuan Zhu

The aerodynamic optimization process of cars requires multiple iterations between aerodynamicists and stylists. Response Surface Modeling and Reduced-Order Modeling are commonly used to eliminate the overhead due to Computational Fluid…

Computational Engineering, Finance, and Science · Computer Science 2022-05-26 Sam Jacob Jacob , Markus Mrosek , Carsten Othmer , Harald Köstler

Traditionally, deriving aerodynamic parameters for an airfoil via Computational Fluid Dynamics requires significant time and effort. However, recent approaches employ neural networks to replace this process, it still grapples with…

Fluid Dynamics · Physics 2024-03-25 Zemin Cai , Zhengyuan Fan , Tianshu Liu

Unmanned aerial vehicles (UAVs) technique has been recognized as a promising solution in future wireless connectivity from the sky, and UAV navigation is one of the most significant open research problems, which has attracted wide interest…

Signal Processing · Electrical Eng. & Systems 2019-11-28 Hongji Huang , Yuchun Yang , Hong Wang , Zhiguo Ding , Hikmet Sari , Fumiyuki Adachi

With the rapidly growing expansion in the use of UAVs, the ability to autonomously navigate in varying environments and weather conditions remains a highly desirable but as-of-yet unsolved challenge. In this work, we use Deep Reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2019-12-13 Bruna G. Maciel-Pearson , Letizia Marchegiani , Samet Akcay , Amir Atapour-Abarghouei , James Garforth , Toby P. Breckon

Machine Learning algorithms and Neural Networks are widely applied to many different areas such as stock market prediction, face recognition and population analysis. This paper will introduce a strategy based on the classic Deep…

Portfolio Management · Quantitative Finance 2020-03-16 Ziming Gao , Yuan Gao , Yi Hu , Zhengyong Jiang , Jionglong Su

In this paper, we propose a new autonomous braking system based on deep reinforcement learning. The proposed autonomous braking system automatically decides whether to apply the brake at each time step when confronting the risk of collision…

Artificial Intelligence · Computer Science 2017-04-25 Hyunmin Chae , Chang Mook Kang , ByeoungDo Kim , Jaekyum Kim , Chung Choo Chung , Jun Won Choi

Deep Reinforcement Learning (RL) is well known for being highly sensitive to hyperparameters, requiring practitioners substantial efforts to optimize them for the problem at hand. This also limits the applicability of RL in real-world…

Machine Learning · Computer Science 2025-03-04 Théo Vincent , Fabian Wahren , Jan Peters , Boris Belousov , Carlo D'Eramo

Decision making for autonomous driving in urban environments is challenging due to the complexity of the road structure and the uncertainty in the behavior of diverse road users. Traditional methods consist of manually designed rules as the…

Neural and Evolutionary Computing · Computer Science 2020-10-27 Niranjan Deshpande , Dominique Vaufreydaz , Anne Spalanzani

Deep Reinforcement Learning has shown excellent performance in generating efficient solutions for complex tasks. However, its efficacy is often limited by static training modes and heavy reliance on vast data from stable environments. To…

Machine Learning · Computer Science 2024-11-06 Xinhao Zhang , Jinghan Zhang , Wujun Si , Kunpeng Liu

Deep Q-learning Network (DQN) is a successful way which combines reinforcement learning with deep neural networks and leads to a widespread application of reinforcement learning. One challenging problem when applying DQN or other…

Machine Learning · Computer Science 2022-09-19 Zhe Zhang , Yukun Zou , Junjie Lai , Qing Xu

In this paper, a deep reinforcement learning based method is proposed to obtain optimal policies for optimal infinite-horizon control of probabilistic Boolean control networks (PBCNs). Compared with the existing literatures, the proposed…

Systems and Control · Electrical Eng. & Systems 2023-04-10 Jingjie Ni , Fangfei Li , Zheng-Guang Wu

Cooperative beamforming across access points (APs) and fronthaul quantization strategies are essential for cloud radio access network (C-RAN) systems. The nonconvexity of the C-RAN optimization problems, which is stemmed from per-AP power…

Signal Processing · Electrical Eng. & Systems 2021-07-07 Daesung Yu , Hoon Lee , Seok-Hwan Park , Seung-Eun Hong