English
Related papers

Related papers: MAESTRO: Task-Relevant Optimization via Adaptive F…

200 papers

Shared training approaches, such as multi-task learning (MTL) and gradient-based meta-learning, are widely used in various machine learning applications, but they often suffer from negative transfer, leading to performance degradation in…

Machine Learning · Computer Science 2024-12-10 Anshul Thakur , Yichen Huang , Soheila Molaei , Yujiang Wang , David A. Clifton

Recently, leveraging on the development of end-to-end convolutional neural networks (CNNs), deep stereo matching networks have achieved remarkable performance far exceeding traditional approaches. However, state-of-the-art stereo frameworks…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Xiao Song , Xu Zhao , Liangji Fang , Hanwen Hu

The goal of multi-task learning is to learn diverse tasks within a single unified network. As each task has its own unique objective function, conflicts emerge during training, resulting in negative transfer among them. Earlier research…

Machine Learning · Computer Science 2024-06-06 Wooseong Jeong , Kuk-Jin Yoon

In driving scenarios, automobile active safety systems are increasingly incorporating deep learning technology. These systems typically need to handle multiple tasks simultaneously, such as detecting fatigue driving and recognizing the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Shulei Qu , Zhenguo Gao , Xiaowei Chen , Na Li , Yakai Wang , Xiaoxiao Wu

Attention-based scene text recognizers have gained huge success, which leverages a more compact intermediate representation to learn 1d- or 2d- attention by a RNN-based encoder-decoder architecture. However, such methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Ning Lu , Wenwen Yu , Xianbiao Qi , Yihao Chen , Ping Gong , Rong Xiao , Xiang Bai

The purpose of offline multi-task reinforcement learning (MTRL) is to develop a unified policy applicable to diverse tasks without the need for online environmental interaction. Recent advancements approach this through sequence modeling,…

Machine Learning · Computer Science 2024-11-05 Ziqing Fan , Shengchao Hu , Yuhang Zhou , Li Shen , Ya Zhang , Yanfeng Wang , Dacheng Tao

BEV-based 3D perception has emerged as a focal point of research in end-to-end autonomous driving. However, existing BEV approaches encounter significant challenges due to the large feature space, complicating efficient modeling and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Feng Li , Zhaoyue Wang , Enyuan Zhang , Mohammad Masum Billah , Yunduan Cui , Kun Xu

Bird's-Eye-View (BEV) perception has become a vital component of autonomous driving systems due to its ability to integrate multiple sensor inputs into a unified representation, enhancing performance in various downstream tasks. However,…

Robotics · Computer Science 2024-10-10 Yuxin Li , Yiheng Li , Xulei Yang , Mengying Yu , Zihang Huang , Xiaojun Wu , Chai Kiat Yeo

3D environment recognition is essential for autonomous driving systems, as autonomous vehicles require a comprehensive understanding of surrounding scenes. Recently, the predominant approach to define this real-life problem is through 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Huizhou Chen , Jiangyi Wang , Yuxin Li , Na Zhao , Jun Cheng , Xulei Yang

Merging multiple expert models offers a promising approach for performing multi-task learning without accessing their original data. Existing methods attempt to alleviate task conflicts by sparsifying task vectors or promoting orthogonality…

Machine Learning · Computer Science 2025-05-27 Yongxian Wei , Anke Tang , Li Shen , Zixuan Hu , Chun Yuan , Xiaochun Cao

Multi-task learning (MTL) can advance assistive driving by exploring inter-task correlations through shared representations. However, existing methods face two critical limitations: single-modality constraints limiting comprehensive scene…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Wenzhuo Liu , Yicheng Qiao , Zhen Wang , Qiannan Guo , Zilong Chen , Meihua Zhou , Xinran Li , Letian Wang , Zhiwei Li , Huaping Liu , Wenshuo Wang

We propose UniSeg3D, a unified 3D scene understanding framework that achieves panoptic, semantic, instance, interactive, referring, and open-vocabulary segmentation tasks within a single model. Most previous 3D segmentation approaches are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Wei Xu , Chunsheng Shi , Sifan Tu , Xin Zhou , Dingkang Liang , Xiang Bai

When a robot autonomously performs a complex task, it frequently must balance competing objectives while maintaining safety. This becomes more difficult in uncertain environments with stochastic outcomes. Enhancing transparency in the…

Robotics · Computer Science 2024-06-19 Peter Amorese , Shohei Wakayama , Nisar Ahmed , Morteza Lahijanian

Multi-task learning (MTL) has received considerable attention, and numerous deep learning applications benefit from MTL with multiple objectives. However, constructing multiple related tasks is difficult, and sometimes only a single task is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Tao Gui , Lizhi Qing , Qi Zhang , Jiacheng Ye , Hang Yan , Zichu Fei , Xuanjing Huang

Despite the fast progress in training specialized models for various tasks, learning a single general model that works well for many tasks is still challenging for computer vision. Here we introduce multi-task self-training (MuST), which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Golnaz Ghiasi , Barret Zoph , Ekin D. Cubuk , Quoc V. Le , Tsung-Yi Lin

Multi-task learning aims at solving multiple machine learning tasks at the same time. A good solution to a multi-task learning problem should be generalizable in addition to being Pareto optimal. In this paper, we provide some insights on…

Machine Learning · Computer Science 2020-08-14 Yuyan Wang , Zhe Zhao , Bo Dai , Christopher Fifty , Dong Lin , Lichan Hong , Ed H. Chi

Recent progress in the text-driven 3D stylization of a single object has been considerably promoted by CLIP-based methods. However, the stylization of multi-object 3D scenes is still impeded in that the image-text pairs used for…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Xuying Zhang , Bo-Wen Yin , Yuming Chen , Zheng Lin , Yunheng Li , Qibin Hou , Ming-Ming Cheng

Bird's eye view (BEV)-based 3D perception plays a crucial role in autonomous driving applications. The rise of large language models has spurred interest in BEV-based captioning to understand object behavior in the surrounding environment.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yunsheng Ma , Burhaneddin Yaman , Xin Ye , Jingru Luo , Feng Tao , Abhirup Mallik , Ziran Wang , Liu Ren

In multi-task learning, multiple tasks are solved jointly, sharing inductive bias between them. Multi-task learning is inherently a multi-objective problem because different tasks may conflict, necessitating a trade-off. A common compromise…

Machine Learning · Computer Science 2019-01-14 Ozan Sener , Vladlen Koltun

The goal of multi-task learning is to enable more efficient learning than single task learning by sharing model structures for a diverse set of tasks. A standard multi-task learning objective is to minimize the average loss across all…

Machine Learning · Computer Science 2024-02-22 Bo Liu , Xingchao Liu , Xiaojie Jin , Peter Stone , Qiang Liu