English
Related papers

Related papers: Airfoil Shape Optimization using Deep Q-Network

200 papers

We develop a deep reinforcement learning method for training a jellyfish-like swimmer to effectively track a moving target in a two-dimensional flow. This swimmer is a flexible object equipped with a muscle model based on torsional springs.…

Fluid Dynamics · Physics 2025-08-20 Yihao Chen , Yue Yang

A key problem in network theory is how to reconfigure a graph in order to optimize a quantifiable objective. Given the ubiquity of networked systems, such work has broad practical applications in a variety of situations, ranging from drug…

Machine Learning · Computer Science 2023-01-31 Christoffel Doorman , Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

In component shape optimization, the component properties are often evaluated by computationally expensive simulations. Such optimization becomes unfeasible when it is focused on a global search requiring thousands of simulations to be…

Computational Engineering, Finance, and Science · Computer Science 2025-12-08 Lucie Kubíčková , Onřej Gebouský , Jan Haidl , Martin Isoz

Distribution network reconfiguration (DNR) has proved to be an economical and effective way to improve the reliability of distribution systems. As optimal network configuration depends on system operating states (e.g., loads at each node),…

Systems and Control · Electrical Eng. & Systems 2023-05-03 Mukesh Gautam , Narayan Bhusal , Mohammed Benidris

Reinforcement learning continuously optimizes decision-making based on real-time feedback reward signals through continuous interaction with the environment, demonstrating strong adaptive and self-learning capabilities. In recent years, it…

Robotics · Computer Science 2024-08-15 Zixiang Wang , Hao Yan , Yining Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu

Exploring the expected quantizing scheme with suitable mixed-precision policy is the key point to compress deep neural networks (DNNs) in high efficiency and accuracy. This exploration implies heavy workloads for domain experts, and an…

Machine Learning · Computer Science 2023-04-11 Cheng Gong , Ye Lu , Surong Dai , Deng Qian , Chenkun Du , Tao Li

In this paper, we propose a principled deep reinforcement learning (RL) approach that is able to accelerate the convergence rate of general deep neural networks (DNNs). With our approach, a deep RL agent (synonym for optimizer in this work)…

Machine Learning · Computer Science 2017-07-14 Jie Fu

We propose two deep learning models that fully automate shape parameterization for aerodynamic shape optimization. Both models are optimized to parameterize via deep geometric learning to embed human prior knowledge into learned geometric…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Zhen Wei , Pascal Fua , Michaël Bauerheim

The current success of Reinforcement Learning algorithms for its performance in complex environments has inspired many recent theoretical approaches to cognitive science. Artistic environments are studied within the cognitive science…

Robotics · Computer Science 2024-02-02 Raul Fernandez-Fernandez , Juan G. Victores , Carlos Balaguer

Cost-effective asset management is an area of interest across several industries. Specifically, this paper develops a deep reinforcement learning (DRL) solution to automatically determine an optimal rehabilitation policy for continuously…

Machine Learning · Computer Science 2023-04-19 Zaharah A. Bukhsh , Nils Jansen , Hajo Molegraaf

We introduce an adjoint-based aerodynamic shape optimization framework that integrates a diffusion model trained on existing designs to learn a smooth manifold of aerodynamically viable shapes. This manifold is enforced as an equality…

Computational Engineering, Finance, and Science · Computer Science 2025-08-01 Long Chen , Emre Oezkaya , Jan Rottmayer , Nicolas R. Gauger , Zebang Shen , Yinyu Ye

Transformer-based architectures have recently propelled advances in sequence modeling across domains, but their application to the hydrophobic-hydrophilic (H-P) model for protein folding remains relatively unexplored. In this work, we adapt…

Machine Learning · Computer Science 2025-04-23 Peizheng Liu , Hitoshi Iba

Profile extrusion is a continuous production process for manufacturing plastic profiles from molten polymer. Especially interesting is the design of the die, through which the melt is pressed to attain the desired shape. However, due to an…

Computational Engineering, Finance, and Science · Computer Science 2023-04-05 Clemens Fricke , Daniel Wolff , Marco Kemmerling , Stefanie Elgeti

We present Design-by-Morphing (DbM), a novel design methodology applicable to creating a search space for topology optimization of 2D airfoils. Most design techniques impose geometric constraints and sometimes designers' bias on the design…

Geometric Topology · Mathematics 2025-10-20 Haris Moazam Sheikh , Sangjoon Lee , Jinge Wang , Philip S. Marcus

Using deep neural nets as function approximator for reinforcement learning tasks have recently been shown to be very powerful for solving problems approaching real-world complexity. Using these results as a benchmark, we discuss the role…

Machine Learning · Computer Science 2016-01-21 Vincent François-Lavet , Raphael Fonteneau , Damien Ernst

Unmanned aerial vehicles (UAVs) are envisioned to complement the 5G communication infrastructure in future smart cities. Hot spots easily appear in road intersections, where effective communication among vehicles is challenging. UAVs may…

Machine Learning · Computer Science 2023-02-22 Ming Zhu , Xiao-Yang Liu , Anwar Walid

Unmanned aerial vehicles (UAVs) are the emerging vital components of millimeter wave (mmWave) wireless systems. Accurate beam alignment is essential for efficient beam-based mmWave communications of UAVs with base stations (BSs).…

Signal Processing · Electrical Eng. & Systems 2021-10-14 Susarla Praneeth , Gouda Bikshapathi , Deng Yansha , Juntti Markku , Silven Olli , Tolli Antti

Integration of reinforcement learning with unmanned aerial vehicles (UAVs) to achieve autonomous flight has been an active research area in recent years. An important part focuses on obstacle detection and avoidance for UAVs navigating…

Artificial Intelligence · Computer Science 2021-03-12 Jeremy Roghair , Kyungtae Ko , Amir Ehsan Niaraki Asli , Ali Jannesari

The variable and unpredictable load demands in hybrid agricultural tractors make it difficult to design optimal rule-based energy management strategies, motivating the use of adaptive, learning-based control. However, existing approaches…

Systems and Control · Electrical Eng. & Systems 2025-08-06 Hend Abououf , Sidra Ghayour Bhatti , Qadeer Ahmed

In this paper, an unmanned aerial vehicle (UAV)-assisted wireless network is considered in which a battery-constrained UAV is assumed to move towards energy-constrained ground nodes to receive status updates about their observed processes.…

Information Theory · Computer Science 2020-06-30 Aidin Ferdowsi , Mohamed A. Abd-Elmagid , Walid Saad , Harpreet S. Dhillon