English
Related papers

Related papers: Airfoil Shape Optimization using Deep Q-Network

200 papers

Aerodynamic performance evaluation is an important part of the aircraft aerodynamic design optimization process; however, traditional methods are costly and time-consuming. Despite the fact that various machine learning methods can achieve…

Fluid Dynamics · Physics 2023-03-07 Hairun Xie , Jing Wang , Miao Zhang

The deep reinforcement learning method usually requires a large number of training images and executing actions to obtain sufficient results. When it is extended a real-task in the real environment with an actual robot, the method will be…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Daiki Kimura

Optimizing deformation energies over a mesh, in two or three dimensions, is a common and critical problem in physical simulation and geometry processing. We present three new improvements to the state of the art: a barrier-aware line-search…

Optimization and Control · Mathematics 2018-02-02 Yufeng Zhu , Robert Bridson , Danny M. Kaufman

Predicting of airfoil aerodynamic performance is a key part of aircraft design optimization, but the traditional methods (such as wind tunnel test and CFD simulation) have the problems of high cost and low efficiency, and the existing…

Neural and Evolutionary Computing · Computer Science 2025-06-10 MaolinYang , Yaohui Wang , Pingyu Jiang

In this paper, we propose a novel approach to 3D deformable object manipulation leveraging a deep neural network called DeformerNet. Controlling the shape of a 3D object requires an effective state representation that can capture the full…

Robotics · Computer Science 2021-07-20 Bao Thach , Alan Kuntz , Tucker Hermans

Network slicing promises to provision diversified services with distinct requirements in one infrastructure. Deep reinforcement learning (e.g., deep $\mathcal{Q}$-learning, DQL) is assumed to be an appropriate algorithm to solve the…

Machine Learning · Computer Science 2019-06-12 Chen Qi , Yuxiu Hua , Rongpeng Li , Zhifeng Zhao , Honggang Zhang

Bus timetable optimization is a key issue to reduce operational cost of bus companies and improve the service quality. Existing methods use exact or heuristic algorithms to optimize the timetable in an offline manner. In practice, the…

Artificial Intelligence · Computer Science 2021-07-16 Guanqun Ai , Xingquan Zuo , Gang chen , Binglin Wu

This correspondence considers the resource allocation problem in wireless interference channel (IC) under link outage constraints. Since the optimization problem is non-convex in nature, existing approaches to find the optimal power…

Networking and Internet Architecture · Computer Science 2022-03-08 Saniul Alam , Sadia Islam , Muhammad R. A. Khandaker , Risala T. Khan , Faisal Tariq , Apriana Toding

In this work we present a method for using Deep Q-Networks (DQNs) in multi-objective environments. Deep Q-Networks provide remarkable performance in single objective problems learning from high-level visual state representations. However,…

Artificial Intelligence · Computer Science 2018-02-26 Tomasz Tajmajer

In this paper, we formulate the adaptive learning problem---the problem of how to find an individualized learning plan (called policy) that chooses the most appropriate learning materials based on learner's latent traits---faced in adaptive…

Machine Learning · Computer Science 2020-04-21 Xiao Li , Hanchen Xu , Jinming Zhang , Hua-hua Chang

The design of aerodynamic shapes, such as airfoils, has traditionally required significant computational resources and relied on predefined design parameters, which limit the potential for novel shape synthesis. In this work, we introduce a…

Machine Learning · Computer Science 2024-12-19 Reid Graves , Amir Barati Farimani

With this study we investigate the accuracy of deep learning models for the inference of Reynolds-Averaged Navier-Stokes solutions. We focus on a modernized U-net architecture, and evaluate a large number of trained neural networks with…

Machine Learning · Computer Science 2020-10-20 Nils Thuerey , Konstantin Weissenow , Lukas Prantl , Xiangyu Hu

Federated learning allows mobile devices, i.e., workers, to use their local data to collaboratively train a global model required by the model owner. Federated learning thus addresses the privacy issues of traditional machine learning.…

Networking and Internet Architecture · Computer Science 2019-10-22 Huy T. Nguyen , Nguyen Cong Luong , Jun Zhao , Chau Yuen , Dusit Niyato

Neural networks allow Q-learning reinforcement learning agents such as deep Q-networks (DQN) to approximate complex mappings from state spaces to value functions. However, this also brings drawbacks when compared to other function…

Machine Learning · Computer Science 2018-06-21 Jack Shannon , Marek Grzes

Aerodynamic design optimisation plays a crucial role in improving the performance and efficiency of automotive vehicles. This paper presents a novel approach for aerodynamic optimisation in car design using deep reinforcement learning…

Robotics · Computer Science 2024-05-21 Jignesh Patel , Yannis Spyridis , Vasileios Argyriou

In this letter, we study the energy efficiency (EE) optimisation of unmanned aerial vehicles (UAVs) providing wireless coverage to static and mobile ground users. Recent multi-agent reinforcement learning approaches optimise the system's EE…

Networking and Internet Architecture · Computer Science 2022-04-05 Babatunji Omoniwa , Boris Galkin , Ivana Dusparic

In this letter, we study an unmanned aerial vehicle (UAV)-mounted mobile edge computing network, where the UAV executes computational tasks offloaded from mobile terminal users (TUs) and the motion of each TU follows a Gauss-Markov random…

Information Theory · Computer Science 2020-01-29 Q. Liu , L. Shi , L. Sun , J. Li , M. Ding , F. Shu

A central problem in computational biophysics is protein structure prediction, i.e., finding the optimal folding of a given amino acid sequence. This problem has been studied in a classical abstract model, the HP model, where the protein is…

Machine Learning · Computer Science 2023-03-14 Kaiyuan Yang , Houjing Huang , Olafs Vandans , Adithya Murali , Fujia Tian , Roland H. C. Yap , Liang Dai

In cellular-connected unmanned aerial vehicle (UAV) network, a minimization problem on the weighted sum of time cost and expected outage duration is considered. Taking advantage of UAV's adjustable mobility, an intelligent UAV navigation…

Signal Processing · Electrical Eng. & Systems 2021-09-20 Yuanjian Li , A. Hamid Aghvami , Daoyi Dong

The deep Q-network (DQN) and return-based reinforcement learning are two promising algorithms proposed in recent years. DQN brings advances to complex sequential decision problems, while return-based algorithms have advantages in making use…

Machine Learning · Computer Science 2019-12-02 Wenjia Meng , Qian Zheng , Long Yang , Pengfei Li , Gang Pan