English
Related papers

Related papers: Efficient Computation Sharing for Multi-Task Visua…

200 papers

Multimodal representation learning has demonstrated remarkable potential in enabling models to process and integrate diverse data modalities, such as text and images, for improved understanding and performance. While the medical domain can…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Shuvendu Roy , Franklin Ogidi , Ali Etemad , Elham Dolatabadi , Arash Afkanpour

Capitalizing on large pre-trained models for various downstream tasks of interest have recently emerged with promising performance. Due to the ever-growing model size, the standard full fine-tuning based task adaptation strategy becomes…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Junting Pan , Ziyi Lin , Xiatian Zhu , Jing Shao , Hongsheng Li

We identify an issue in multi-task learnable compression, in which a representation learned for one task does not positively contribute to the rate-distortion performance of a different task as much as expected, given the estimated amount…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Anderson de Andrade , Ivan Bajić

Multimedia applications often require concurrent solutions to multiple tasks. These tasks hold clues to each-others solutions, however as these relations can be complex this remains a rarely utilized property. When task relations are…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

Transfer learning has the potential to reduce the burden of data collection and to decrease the unavoidable risks of the training phase. In this letter, we introduce a multirobot, multitask transfer learning framework that allows a system…

Robotics · Computer Science 2018-04-04 Karime Pereida , Mohamed K. Helwa , Angela P. Schoellig

The advent of high-capacity pre-trained models has revolutionized problem-solving in computer vision, shifting the focus from training task-specific models to adapting pre-trained models. Consequently, effectively adapting large pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Wei Dong , Dawei Yan , Zhijun Lin , Peng Wang

We propose a unified look at jointly learning multiple vision tasks and visual domains through universal representations, a single deep neural network. Learning multiple problems simultaneously involves minimizing a weighted sum of multiple…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Wei-Hong Li , Xialei Liu , Hakan Bilen

Multi-task learning of dense prediction tasks, by sharing both the encoder and decoder, as opposed to sharing only the encoder, provides an attractive front to increase both accuracy and computational efficiency. When the tasks are similar,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Naresh Kumar Gurulingan , Elahe Arani , Bahram Zonooz

Traditional end-to-end deep learning models often enhance feature representation and overall performance by increasing the depth and complexity of the network during training. However, this approach inevitably introduces issues of parameter…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yuming Zhang , Peizhe Wang , Shouxin Zhang , Dongzhi Guan , Jiabin Liu , Junhao Su

The cost of annotating training data has traditionally been a bottleneck for supervised learning approaches. The problem is further exacerbated when supervised learning is applied to a number of correlated tasks simultaneously since the…

Machine Learning · Computer Science 2021-03-26 Jingxi Xu , Da Tang , Tony Jebara

In complex transfer learning scenarios new tasks might not be tightly linked to previous tasks. Approaches that transfer information contained only in the final parameters of a source model will therefore struggle. Instead, transfer…

Machine Learning · Computer Science 2019-03-25 Sebastian Flennerhag , Pablo G. Moreno , Neil D. Lawrence , Andreas Damianou

Reliable perception during fast motion maneuvers or in high dynamic range environments is crucial for robotic systems. Since event cameras are robust to these challenging conditions, they have great potential to increase the reliability of…

Computer Vision and Pattern Recognition · Computer Science 2022-02-04 Nico Messikommer , Daniel Gehrig , Mathias Gehrig , Davide Scaramuzza

Compact neural network offers many benefits for real-world applications. However, it is usually challenging to train the compact neural networks with small parameter sizes and low computational costs to achieve the same or better model…

Machine Learning · Computer Science 2023-08-28 Shen Ren , Haosen Shi

As the range of tasks performed by a general vision system expands, executing multiple tasks accurately and efficiently in a single network has become an important and still open problem. Recent computer vision approaches address this…

Machine Learning · Computer Science 2020-11-02 Hila Levi , Shimon Ullman

Parameter sharing has proven to be a parameter-efficient approach. Previous work on Transformers has focused on sharing parameters in different layers, which can improve the performance of models with limited parameters by increasing model…

Machine Learning · Computer Science 2023-06-19 Ye Lin , Mingxuan Wang , Zhexi Zhang , Xiaohui Wang , Tong Xiao , Jingbo Zhu

Real-time scene parsing is a fundamental feature for autonomous driving vehicles with multiple cameras. In this letter we demonstrate that sharing semantics between cameras with different perspectives and overlapped views can boost the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Zhenzhen Xiang , Anbo Bao , Jie Li , Jianbo Su

Deep networks consume a large amount of memory by their nature. A natural question arises can we reduce that memory requirement whilst maintaining performance. In particular, in this work we address the problem of memory efficient learning…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Eunwoo Kim , Chanho Ahn , Philip H. S. Torr , Songhwai Oh

We consider a multitask learning problem, in which several predictors are learned jointly. Prior research has shown that learning the relations between tasks, and between the input features, together with the predictor, can lead to better…

Machine Learning · Computer Science 2019-07-11 Han Zhao , Otilia Stretcu , Alex Smola , Geoff Gordon

We investigate the use of sparse coding and dictionary learning in the context of multitask and transfer learning. The central assumption of our learning method is that the tasks parameters are well approximated by sparse linear…

Machine Learning · Computer Science 2014-06-17 Andreas Maurer , Massimiliano Pontil , Bernardino Romera-Paredes

Training multiple tasks jointly in one deep network yields reduced latency during inference and better performance over the single-task counterpart by sharing certain layers of a network. However, over-sharing a network could erroneously…

Machine Learning · Computer Science 2020-06-11 Pengsheng Guo , Chen-Yu Lee , Daniel Ulbricht
‹ Prev 1 4 5 6 7 8 10 Next ›