English
Related papers

Related papers: Transformer-Based Deep Learning Model for Bored Pi…

200 papers

Molecular property prediction with deep learning has gained much attention over the past years. Owing to the scarcity of labeled molecules, there has been growing interest in self-supervised learning methods that learn generalizable…

Machine Learning · Computer Science 2023-09-04 Peizhen Bai , Xianyuan Liu , Haiping Lu

A novel multiphysics-decision tree learning algorithm is presented for (1) estimating transport properties in the variably saturated subsurface governed by explicitly coupled equations for water, heat, and solute transport; and (2)…

Geophysics · Physics 2023-12-19 Michael J Friedel , Massimo Buscema

This paper proposes a deep learning-based beamforming design framework that directly maps a target beam pattern to optimal beamforming vectors across multiple antenna array architectures, including digital, analog, and hybrid beamforming.…

Signal Processing · Electrical Eng. & Systems 2025-10-14 Hongpu Zhang , Shu Sun , Hangsong Yan , Jianhua Mo

This research introduces a novel dual-attention transformer architecture for predicting soil electrical resistivity, a critical parameter for high-voltage substation construction. Our model employs attention mechanisms operating across both…

Signal Processing · Electrical Eng. & Systems 2025-04-07 Warat Kongkitkul , Sompote Youwai , Warut Sakulpojworachai

Estimating path loss for a transmitter-receiver location is key to many use-cases including network planning and handover. Machine learning has become a popular tool to predict wireless channel properties based on map data. In this work, we…

Transformer models have consistently achieved remarkable results in various domains such as natural language processing and computer vision. However, despite ongoing research efforts to better understand these models, the field still lacks…

Machine Learning · Computer Science 2024-10-18 Ilya Kaufman , Omri Azencot

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

In this paper, we propose multi-stage and deformable deep convolutional neural networks for object detection. This new deep learning object detection diagram has innovations in multiple aspects. In the proposed new deep architecture, a new…

Computer Vision and Pattern Recognition · Computer Science 2014-09-12 Wanli Ouyang , Ping Luo , Xingyu Zeng , Shi Qiu , Yonglong Tian , Hongsheng Li , Shuo Yang , Zhe Wang , Yuanjun Xiong , Chen Qian , Zhenyao Zhu , Ruohui Wang , Chen-Change Loy , Xiaogang Wang , Xiaoou Tang

A new deep-learning-based reduced-order modeling (ROM) framework is proposed for application in subsurface flow simulation. The reduced-order model is based on an existing embed-to-control (E2C) framework and includes an auto-encoder, which…

Computational Physics · Physics 2019-06-11 Zhaoyang Larry Jin , Yimin Liu , Louis J. Durlofsky

Rapid progress in machine learning and deep learning has enabled a wide range of applications in the electricity load forecasting of power systems, for instance, univariate and multivariate short-term load forecasting. Though the strong…

Machine Learning · Computer Science 2024-02-20 Yuqi Jiang , Yan Li , Yize Chen

Whether it is oil and gas exploration or geological science research, it is necessary to accurately grasp the structural information of underground media. Full waveform inversion is currently the most popular seismic wave inversion method,…

Geophysics · Physics 2024-07-30 Guoxin Chen

This paper studies fast adaptive beamforming optimization for the signal-to-interference-plus-noise ratio balancing problem in a multiuser multiple-input single-output downlink system. Existing deep learning based approaches to predict…

Information Theory · Computer Science 2020-11-03 Yi Yuan , Gan Zheng , Kai-Kit Wong , Björn Ottersten , Zhi-Quan Luo

Electrical energy is essential in today's society. Accurate electrical load forecasting is beneficial for better scheduling of electricity generation and saving electrical energy. In this paper, we propose theory-guided deep-learning load…

Machine Learning · Computer Science 2022-10-07 Jiaxin Gao , Wenbo Hu , Dongxiao Zhang , Yuntian Chen

This paper presents a method for learning world models for wheel loaders performing automatic loading actions on a pile of soil. Data-driven models were learned to output the resulting pile state, loaded mass, time, and work for a single…

Robotics · Computer Science 2024-05-30 Koji Aoshima , Arvid Fälldin , Eddie Wadbro , Martin Servin

The large volumes of Sentinel-1 data produced over Europe are being used to develop pan-national ground motion services. However, simple analysis techniques like thresholding cannot detect and classify complex deformation signals reliably…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Nantheera Anantrasirichai , Juliet Biggs , Krisztina Kelevitz , Zahra Sadeghi , Tim Wright , James Thompson , Alin Achim , David Bull

We consider the task of building compact deep learning pipelines suitable for deployment on storage and power constrained mobile devices. We propose a unified framework to learn a broad family of structured parameter matrices that are…

Machine Learning · Statistics 2015-10-07 Vikas Sindhwani , Tara N. Sainath , Sanjiv Kumar

Early identification of drought stress in crops is vital for implementing effective mitigation measures and reducing yield loss. Non-invasive imaging techniques hold immense potential by capturing subtle physiological changes in plants…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Aswini Kumar Patra , Lingaraj Sahoo

It's difficult to accurately predict the flow with shock waves over an aircraft due to the flow's strongly nonlinear characteristics. In this study, we propose an accuracy-enhanced flow prediction method that fuses deep learning and…

Fluid Dynamics · Physics 2024-05-27 Xuyi Jia , Chunlin Gong , Wen Ji , Chunna Li

Current neural network (NN) models can learn patterns from data points with historical dependence. Specifically, in natural language processing (NLP), sequential learning has transitioned from recurrence-based architectures to…

Machine Learning · Computer Science 2025-04-08 Muhammed Adil Yatkin , Mihkel Korgesaar , Jani Romanoff , Umit Islak , Hasan Kurban

The high dimensionality and complex dynamics of turbulent flows in urban street canyons present significant challenges for wind and environmental engineering, particularly in addressing air quality, pollutant dispersion, and extreme wind…

Fluid Dynamics · Physics 2025-01-24 Tomek Jaroslawski , Aakash Patil , Beverley McKeon