English
Related papers

Related papers: Adaptive Sensor Steering Strategy Using Deep Reinf…

200 papers

This article presents a digital twin (DT)-enhanced reinforcement learning (RL) framework aimed at optimizing performance and reliability in network resource management, since the traditional RL methods face several unified challenges when…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Nan Cheng , Xiucheng Wang , Zan Li , Zhisheng Yin , Tom Luan , Xuemin Shen

Active localization is the problem of generating robot actions that allow it to maximally disambiguate its pose within a reference map. Traditional approaches to this use an information-theoretic criterion for action selection and…

Robotics · Computer Science 2019-03-06 Sai Krishna , Keehong Seo , Dhaivat Bhatt , Vincent Mai , Krishna Murthy , Liam Paull

This work develops a methodology for creating a data-driven digital twin from a library of physics-based models representing various asset states. The digital twin is updated using interpretable machine learning. Specifically, we use…

Computational Engineering, Finance, and Science · Computer Science 2020-04-30 Michael G. Kapteyn , Karen E. Willcox

Control Co-Design (CCD) integrates physical and control system design to improve the performance of dynamic and autonomous systems. Despite advances in uncertainty-aware CCD methods, real-world uncertainties remain highly unpredictable.…

Machine Learning · Computer Science 2025-10-14 Ying-Kuan Tsai , Vispi Karkaria , Yi-Ping Chen , Wei Chen

The accurate and efficient modeling of nuclear reactor transients is crucial for ensuring safe and optimal reactor operation. Traditional physics-based models, while valuable, can be computationally intensive and may not fully capture the…

Applications · Statistics 2024-11-28 James Daniell , Kazuma Kobayashi , Ayodeji Alajo , Syed Bahauddin Alam

This research proposes a new integrated framework for identifying safe landing locations and planning in-flight divert maneuvers. The state-of-the-art algorithms for landing zone selection utilize local terrain features such as slopes and…

Robotics · Computer Science 2021-02-25 Keidai Iiyama , Kento Tomita , Bhavi A. Jagatia , Tatsuwaki Nakagawa , Koki Ho

It is not until we become senior citizens do we recognise how much we took maintaining a simple standing posture for granted. It is truly fascinating to observe the magnitude of control the human brain exercises, in real time, to activate…

Robotics · Computer Science 2020-08-28 Mohammed Hossny , Julie Iskander

Deep learning (DL) techniques have demonstrated strong performance in compressing and reconstructing channel state information (CSI) while reducing feedback overhead in massive MIMO systems. A key challenge, however, is their reliance on…

Signal Processing · Electrical Eng. & Systems 2025-10-01 Hao Luo , Shuaifeng Jiang , Saeed R. Khosravirad , Ahmed Alkhateeb

Wireless sensor networks consist of randomly distributed sensor nodes for monitoring targets or areas of interest. Maintaining the network for continuous surveillance is a challenge due to the limited battery capacity in each sensor.…

Machine Learning · Computer Science 2023-10-03 Ngoc Bui , Phi Le Nguyen , Viet Anh Nguyen , Phan Thuan Do

Industrial process optimization and control is crucial to increase economic and ecologic efficiency. However, data sovereignty, differing goals, or the required expert knowledge for implementation impede holistic implementation. Further,…

Machine Learning · Computer Science 2024-08-28 Johannes Emmert , Ronald Mendez , Houman Mirzaalian Dastjerdi , Christopher Syben , Andreas Maier

Autonomous navigation in underwater environments remains a major challenge due to the absence of GPS, degraded visibility, and the presence of submerged obstacles. This article investigates these issues through the case of the BlueROV2, an…

Machine Learning · Computer Science 2025-12-12 Zamirddine Mari , Mohamad Motasem Nawaf , Pierre Drap

Achieving a holistic and long-term understanding through accurate network modeling is essential for orchestrating future networks with increasing service diversity and infrastructure complexities. However, due to unselective data collection…

Networking and Internet Architecture · Computer Science 2024-05-13 Pengyi Jia , Xianbin Wang , Xuemin Shen

Objective: This paper describes the development of hybrid artificial intelligence strategies for drone navigation. Methods: The navigation module combines a deep learning model with a rule-based engine depending on the agent state. The deep…

Artificial Intelligence · Computer Science 2025-01-09 Rubén San-Segundo , Lucía Angulo , Manuel Gil-Martín , David Carramiñana , Ana M. Bernardos

In dynamic decision-making scenarios across business and healthcare, leveraging sample trajectories from diverse populations can significantly enhance reinforcement learning (RL) performance for specific target populations, especially when…

Machine Learning · Statistics 2025-04-15 Jinhang Chai , Elynn Chen , Jianqing Fan

Active Inference is an emerging framework providing a quantitative account of behavioral processes in neuroscience and a principled approach to decision-making under uncertainty. Its application to agency problems is natural, offering an…

Computational Engineering, Finance, and Science · Computer Science 2026-04-15 Francesco Maria Mancinelli , Matteo Torzoni , Domenico Maisto , Francesco Donnarumma , Alberto Corigliano , Giovanni Pezzulo , Andrea Manzoni

Unsignalized intersections pose safety and efficiency challenges due to complex traffic flows and blind spots. In this paper, a digital twin (DT)-based cooperative driving system with roadside unit (RSU)-centric architecture is proposed for…

Systems and Control · Electrical Eng. & Systems 2025-09-19 Taoyuan Yu , Kui Wang , Zongdian Li , Tao Yu , Kei Sakaguchi , Walid Saad

Realizing the potential gains of large-scale MIMO systems requires the accurate estimation of their channels or the fine adjustment of their narrow beams. This, however, is typically associated with high channel acquisition/beam sweeping…

Signal Processing · Electrical Eng. & Systems 2023-01-19 Shuaifeng Jiang , Ahmed Alkhateeb

Optimizing modern wireless networks is exceptionally challenging due to their high dynamism and complexity. While the agentic artificial intelligence (AI) powered by reinforcement learning (RL) offers a promising solution, its practical…

Systems and Control · Electrical Eng. & Systems 2025-11-26 Zhenyu Tao , Wei Xu , Xiaohu You

With the development of satellite communication technology, satellite-terrestrial integrated networks (STIN), which integrate satellite networks and ground networks, can realize seamless global coverage of communication services.…

Networking and Internet Architecture · Computer Science 2024-09-10 Yihong Tao , Bo Lei , Haoyang Shi , Jingkai Chen , Xing Zhang

We present a machine learning framework for adaptive source localization in which agents use a structure-preserving digital twin of a coupled hydrodynamic-transport system for real-time trajectory planning and data assimilation. The twin is…

Machine Learning · Computer Science 2025-09-15 Benjamin David Shaffer , Brooks Kinch , Joseph Klobusicky , M. Ani Hsieh , Nathaniel Trask