English
Related papers

Related papers: M3Net: Multimodal Multi-task Learning for 3D Detec…

200 papers

Humans are very good at directing their visual attention toward relevant areas when they search for different types of objects. For instance, when we search for cars, we will look at the streets, not at the top of buildings. The motivation…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Hughes Perreault , Guillaume-Alexandre Bilodeau , Nicolas Saunier , Maguelonne Héritier

The recent vision transformer(i.e.for image classification) learns non-local attentive interaction of different patch tokens. However, prior arts miss learning the cross-scale dependencies of different pixels, the semantic correspondence of…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Yuanfeng Ji , Ruimao Zhang , Huijie Wang , Zhen Li , Lingyun Wu , Shaoting Zhang , Ping Luo

Network traffic prediction techniques have attracted much attention since they are valuable for network congestion control and user experience improvement. While existing prediction techniques can achieve favorable performance when there is…

Networking and Internet Architecture · Computer Science 2025-05-29 Hui Ma , Kai Yang

Multi-Task Learning is a learning paradigm that uses correlated tasks to improve performance generalization. A common way to learn multiple tasks is through the hard parameter sharing approach, in which a single architecture is used to…

Machine Learning · Computer Science 2022-04-15 Angelica Tiemi Mizuno Nakamura , Denis Fernando Wolf , Valdir Grassi

The goal of multi-task learning is to learn to conduct multiple tasks simultaneously based on a shared data representation. While this approach can improve learning efficiency, it may also cause performance degradation due to task conflicts…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Changwon Kang , Jisong Kim , Hongjae Shin , Junseo Park , Jun Won Choi

Camera-based Deep Learning algorithms are increasingly needed for perception in Automated Driving systems. However, constraints from the automotive industry challenge the deployment of CNNs by imposing embedded systems with limited…

Computer Vision and Pattern Recognition · Computer Science 2021-01-22 Flora Dellinger , Thomas Boulay , Diego Mendoza Barrenechea , Said El-Hachimi , Isabelle Leang , Fabian Bürger

Recently, dense connections have attracted substantial attention in computer vision because they facilitate gradient flow and implicit deep supervision during training. Particularly, DenseNet, which connects each layer to every other layer…

Computer Vision and Pattern Recognition · Computer Science 2019-03-05 Jose Dolz , Karthik Gopinath , Jing Yuan , Herve Lombaert , Christian Desrosiers , Ismail Ben Ayed

Traffic scene understanding from unmanned aerial vehicle (UAV) platforms is crucial for intelligent transportation systems due to its flexible deployment and wide-area monitoring capabilities. However, existing methods face significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yu Zhang , Zhicheng Zhao , Ze Luo , Chenglong Li , Jin Tang

Predicting the behaviors of other agents on the road is critical for autonomous driving to ensure safety and efficiency. However, the challenging part is how to represent the social interactions between agents and output different possible…

Robotics · Computer Science 2021-09-15 Zhiyu Huang , Xiaoyu Mo , Chen Lv

Existing solutions for 3D semantic occupancy prediction typically treat the task as a one-shot 3D voxel-wise segmentation perception problem. These discriminative methods focus on learning the mapping between the inputs and occupancy map in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Guoqing Wang , Zhongdao Wang , Pin Tang , Jilai Zheng , Xiangxuan Ren , Bailan Feng , Chao Ma

Clinical data elements (CDEs) (e.g., age, smoking history), blood markers and chest computed tomography (CT) structural features have been regarded as effective means for assessing lung cancer risk. These independent variables can provide…

Image and Video Processing · Electrical Eng. & Systems 2021-02-11 Riqiang Gao , Yucheng Tang , Kaiwen Xu , Michael N. Kammer , Sanja L. Antic , Steve Deppen , Kim L. Sandler , Pierre P. Massion , Yuankai Huo , Bennett A. Landman

Multi-task learning (MTL) encapsulates multiple learned tasks in a single model and often lets those tasks learn better jointly. However, when deploying MTL onto those real-world systems that are often resource-constrained or…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Hanxue Liang , Zhiwen Fan , Rishov Sarkar , Ziyu Jiang , Tianlong Chen , Kai Zou , Yu Cheng , Cong Hao , Zhangyang Wang

Multi-modality image fusion and segmentation play a vital role in autonomous driving and robotic operation. Early efforts focus on boosting the performance for only one task, \emph{e.g.,} fusion or segmentation, making it hard to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Jinyuan Liu , Zhu Liu , Guanyao Wu , Long Ma , Risheng Liu , Wei Zhong , Zhongxuan Luo , Xin Fan

We propose a Multi-Task Learning (MTL) paradigm based deep neural network architecture, called MTCNet (Multi-Task Crowd Network) for crowd density and count estimation. Crowd count estimation is challenging due to the non-uniform scale…

Machine Learning · Computer Science 2025-04-16 Abhay Kumar , Nishant Jain , Suraj Tripathi , Chirag Singh , Kamal Krishna

Despite the good results that have been achieved in unimodal segmentation, the inherent limitations of individual data increase the difficulty of achieving breakthroughs in performance. For that reason, multi-modal learning is increasingly…

Image and Video Processing · Electrical Eng. & Systems 2024-04-16 Yameng Wang , Yi Wan , Yongjun Zhang , Bin Zhang , Zhi Gao

3D visual perception tasks based on multi-camera images are essential for autonomous driving systems. Latest work in this field performs 3D object detection by leveraging multi-view images as an input and iteratively enhancing object…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jongwoo Park , Apoorv Singh , Varun Bankiti

Complex systems such as aircraft engines, turbines, and industrial machinery often operate under dynamically changing conditions. These varying operating conditions can substantially influence degradation behavior and make prognostic…

Machine Learning · Computer Science 2026-04-14 Yuqi Su , Xiaolei Fang

With the advancement of Artificial Intelligence (AI) towards multiple modalities (language, vision, speech, etc.), multi-modal models have increasingly been used across various applications (e.g., visual question answering or image…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-07 JinYi Yoon , JiHo Lee , Ting He , Nakjung Choi , Bo Ji

Multi-modal learning focuses on training models by equally combining multiple input data modalities during the prediction process. However, this equal combination can be detrimental to the prediction accuracy because different modalities…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Hu Wang , Jianpeng Zhang , Yuanhong Chen , Congbo Ma , Jodie Avery , Louise Hull , Gustavo Carneiro

Autonomous vehicles need to accomplish their tasks while interacting with human drivers in traffic. It is thus crucial to equip autonomous vehicles with artificial reasoning to better comprehend the intentions of the surrounding traffic,…

Artificial Intelligence · Computer Science 2023-11-02 Xiao Li , Kaiwen Liu , H. Eric Tseng , Anouck Girard , Ilya Kolmanovsky