English
Related papers

Related papers: TENET: Transformer Encoding Network for Effective …

200 papers

This study presents an innovative approach to predicting VCSEL emission characteristics using transformer neural networks. We demonstrate how to modify the transformer neural network for applications in physics. Our model achieved high…

Disordered Systems and Neural Networks · Physics 2025-09-17 Aleksei V. Belonovskii , Elizaveta I. Girshova , Erkki Lähderanta , Mikhail Kaliteevski

This paper conducts research on the short-term electric load forecast method under the background of big data. It builds a new electric load forecast model based on Deep Auto-Encoder Networks (DAENs), which takes into account…

Signal Processing · Electrical Eng. & Systems 2019-07-23 Xin Shi

Autonomous driving requires the model to perceive the environment and (re)act within a low latency for safety. While past works ignore the inevitable changes in the environment after processing, streaming perception is proposed to jointly…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Jinrong Yang , Songtao Liu , Zeming Li , Xiaoping Li , Jian Sun

Predicting the future trajectories of on-road vehicles is critical for autonomous driving. In this paper, we introduce a novel prediction framework called PRIME, which stands for Prediction with Model-based Planning. Unlike recent…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Haoran Song , Di Luan , Wenchao Ding , Michael Yu Wang , Qifeng Chen

Within the domain of medical image analysis, three distinct methodologies have demonstrated commendable accuracy: Neural Networks, Decision Trees, and Ensemble-Based Learning Algorithms, particularly in the specialized context of genstro…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Zeshan Khan

Accurate trajectory forecasting is crucial for the performance of various systems, such as advanced driver-assistance systems and self-driving vehicles. These forecasts allow us to anticipate events that lead to collisions and, therefore,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Adrien Lafage , Mathieu Barbier , Gianni Franchi , David Filliat

Image animation aims to animate a source image by using motion learned from a driving video. Current state-of-the-art methods typically use convolutional neural networks (CNNs) to predict motion information, such as motion keypoints and…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Jiale Tao , Biao Wang , Tiezheng Ge , Yuning Jiang , Wen Li , Lixin Duan

The ability to predict future structure features of environments based on past perception information is extremely needed by autonomous vehicles, which helps to make the following decision-making and path planning more reasonable. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Zhen Luo , Junyi Ma , Zijie Zhou , Guangming Xiong

We introduce optical Flow transFormer, dubbed as FlowFormer, a transformer-based neural network architecture for learning optical flow. FlowFormer tokenizes the 4D cost volume built from an image pair, encodes the cost tokens into a cost…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Zhaoyang Huang , Xiaoyu Shi , Chao Zhang , Qiang Wang , Ka Chun Cheung , Hongwei Qin , Jifeng Dai , Hongsheng Li

We show that Transformer encoder architectures can be sped up, with limited accuracy costs, by replacing the self-attention sublayers with simple linear transformations that "mix" input tokens. These linear mixers, along with standard…

Computation and Language · Computer Science 2022-05-30 James Lee-Thorp , Joshua Ainslie , Ilya Eckstein , Santiago Ontanon

The prediction of periodical time-series remains challenging due to various types of data distortions and misalignments. Here, we propose a novel model called Temporal embedding-enhanced convolutional neural Network (TeNet) to learn…

Machine Learning · Computer Science 2022-02-09 Jiajun Liu , Kun Zhao , Brano Kusy , Ji-rong Wen , Raja Jurdak

The growing interest in Temporal Graph Neural Networks (TGNNs) stems from their ability to model complex dynamics and deliver superior performance. However, TGNNs encounter fundamental challenges in capturing long-term dependencies and…

Machine Learning · Computer Science 2026-05-26 Hongjiang Chen , Pengfei Jiao , Ming Du , Xuan Guo , Zhidong Zhao , Di Jin , Xiao Liu

Autonomous vehicles operating in complex real-world environments require accurate predictions of interactive behaviors between traffic participants. This paper tackles the interaction prediction problem by formulating it with hierarchical…

Robotics · Computer Science 2023-08-15 Zhiyu Huang , Haochen Liu , Chen Lv

Motion prediction is a challenging problem in autonomous driving as it demands the system to comprehend stochastic dynamics and the multi-modal nature of real-world agent interactions. Diffusion models have recently risen to prominence, and…

Robotics · Computer Science 2024-05-03 Jiahui Li , Tianle Shen , Zekai Gu , Jiawei Sun , Chengran Yuan , Yuhang Han , Shuo Sun , Marcelo H. Ang

Text-Video retrieval is a task of great practical value and has received increasing attention, among which learning spatial-temporal video representation is one of the research hotspots. The video encoders in the state-of-the-art video…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Yuqi Liu , Pengfei Xiong , Luhui Xu , Shengming Cao , Qin Jin

While hardware-software co-design has significantly improved the efficiency of neural network inference, modeling the training phase remains a critical yet underexplored challenge. Training workloads impose distinct constraints,…

Machine Learning · Computer Science 2026-03-17 Jérémy Morlier , Robin Geens , Stef Cuyckens , Arne Symons , Marian Verhelst , Vincent Gripon , Mathieu Léonardon

Autonomous driving requires reasoning about interactions with surrounding traffic. A prevailing approach is large-scale imitation learning on expert driving datasets, aimed at generalizing across diverse real-world scenarios. For online…

Predicting future trajectories of road agents is a critical task for autonomous driving. Recent goal-based trajectory prediction methods, such as DenseTNT and PECNet, have shown good performance on prediction tasks on public datasets.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Qiujing Lu , Weiqiao Han , Jeffrey Ling , Minfa Wang , Haoyu Chen , Balakrishnan Varadarajan , Paul Covington

Lane detection is one of the core functions in autonomous driving and has aroused widespread attention recently. The networks to segment lane instances, especially with bad appearance, must be able to explore lane distribution properties.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Jiaxing Yang , Lihe Zhang , Huchuan Lu

Training neural network often uses a machine learning framework such as TensorFlow and Caffe2. These frameworks employ a dataflow model where the NN training is modeled as a directed graph composed of a set of nodes. Operations in neural…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-20 Jiawen Liu , Dong Li , Gokcen Kestor , Jeffrey Vetter