English
Related papers

Related papers: Multi-task learning with cross-task consistency fo…

200 papers

Polyps are well-known cancer precursors identified by colonoscopy. However, variability in their size, location, and surface largely affect identification, localisation, and characterisation. Moreover, colonoscopic surveillance and removal…

Visualizing colonoscopy is crucial for medical auxiliary diagnosis to prevent undetected polyps in areas that are not fully observed. Traditional feature-based and depth-based reconstruction approaches usually end up with undesirable…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Zhenhua Wu , Yanlin Jin , Liangdong Qiu , Xiaoguang Han , Xiang Wan , Guanbin Li

The multi-task learning ($MTL$) paradigm aims to simultaneously learn multiple tasks within a single model capturing higher-level, more general hidden patterns that are shared by the tasks. In deep learning, a significant challenge in the…

Machine Learning · Computer Science 2025-06-09 Thomas Borsani , Andrea Rosani , Giuseppe Nicosia , Giuseppe Di Fatta

We aim to train a multi-task model such that users can adjust the desired compute budget and relative importance of task performances after deployment, without retraining. This enables optimizing performance for dynamically varying user…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Abhishek Aich , Samuel Schulter , Amit K. Roy-Chowdhury , Manmohan Chandraker , Yumin Suh

We investigate fine-tuning Vision-Language Models (VLMs) for multi-task medical image understanding, focusing on detection, localization, and counting of findings in medical images. Our objective is to evaluate whether instruction-tuned…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Sushant Gautam , Michael A. Riegler , Pål Halvorsen

The task of automatically segmenting 3-D surfaces representing boundaries of objects is important for quantitative analysis of volumetric images, and plays a vital role in biomedical image analysis. Recently, graph-based methods with a…

Computer Vision and Pattern Recognition · Computer Science 2018-01-10 Abhay Shah , Michael Abramoff , Xiaodong Wu

Traditional MVS methods have good accuracy but struggle with completeness, while recently developed learning-based multi-view stereo (MVS) techniques have improved completeness except accuracy being compromised. We propose depth…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Nail Ibrahimli , Hugo Ledoux , Julian Kooij , Liangliang Nan

Thanks to breakthroughs in AI and Deep learning methodology, Computer vision techniques are rapidly improving. Most computer vision applications require sophisticated image segmentation to comprehend what is image and to make an analysis of…

Machine Learning · Computer Science 2023-02-07 Lichun Gao , Chinmaya Khamesra , Uday Kumbhar , Ashay Aglawe

The detection and removal of precancerous polyps through colonoscopy is the primary technique for the prevention of colorectal cancer worldwide. However, the miss rate of colorectal polyp varies significantly among the endoscopists. It is…

Image and Video Processing · Electrical Eng. & Systems 2022-06-24 Nikhil Kumar Tomar , Abhishek Srivastava , Ulas Bagci , Debesh Jha

Multi-Task Learning has emerged as a methodology in which multiple tasks are jointly learned by a shared learning algorithm, such as a DNN. MTL is based on the assumption that the tasks under consideration are related; therefore it exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Dimitrios Kollias , Viktoriia Sharmanska , Stefanos Zafeiriou

Contrastive learning (CL) has become a powerful approach for learning representations from unlabeled images. However, existing CL methods focus predominantly on visual appearance features while neglecting topological characteristics (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guangyu Meng , Pengfei Gu , Peixian Liang , John P. Lalor , Erin Wolf Chambers , Danny Z. Chen

High screening coverage during colonoscopy is crucial to effectively prevent colon cancer. Previous work has allowed alerting the doctor to unsurveyed regions by reconstructing the 3D colonoscopic surface from colonoscopy videos in…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Yubo Zhang , Shuxian Wang , Ruibin Ma , Sarah K. McGill , Julian G. Rosenman , Stephen M. Pizer

This research paper presents an innovative multi-task learning framework that allows concurrent depth estimation and semantic segmentation using a single camera. The proposed approach is based on a shared encoder-decoder architecture, which…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Pardis Taghavi , Reza Langari , Gaurav Pandey

Monocular depth and pose estimation play an important role in the development of colonoscopy-assisted navigation, as they enable improved screening by reducing blind spots, minimizing the risk of missed or recurrent lesions, and lowering…

Computer Vision and Pattern Recognition · Computer Science 2026-02-23 Xinwei Ju , Rema Daher , Danail Stoyanov , Sophia Bano , Francisco Vasconcelos

Colonoscopic Polyp Re-Identification aims to match the same polyp from a large gallery with images from different views taken using different cameras and plays an important role in the prevention and treatment of colorectal cancer. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Suncheng Xiang , Chengfeng Zhou , Zhengjie Zhang , Shilun Cai , Dahong Qian

Piece-wise 3D planar reconstruction provides holistic scene understanding of man-made environments, especially for indoor scenarios. Most recent approaches focused on improving the segmentation and reconstruction results by introducing…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yaxu Xie , Fangwen Shu , Jason Rambach , Alain Pagani , Didier Stricker

To control the lower-limb exoskeleton robot effectively, it is essential to accurately recognize user status and environmental conditions. Previous studies have typically addressed these recognition challenges through independent models for…

Robotics · Computer Science 2023-06-27 Joonhyun Kim , Seongmin Ha , Dongbin Shin , Seoyeon Ham , Jaepil Jang , Wansoo Kim

Multi-task learning (MTL) aims to improve the generalization performance of multiple tasks by exploiting the shared factors among them. Various metrics (e.g., F-score, Area Under the ROC Curve) are used to evaluate the performances of MTL…

Machine Learning · Computer Science 2022-10-13 Ge-Yang Ke , Yan Pan , Jian Yin , Chang-Qin Huang

A common approach to medical image analysis on volumetric data uses deep 2D convolutional neural networks (CNNs). This is largely attributed to the challenges imposed by the nature of the 3D data: variable volume size, GPU exhaustion during…

Image and Video Processing · Electrical Eng. & Systems 2020-07-28 Hasib Zunair , Aimon Rahman , Nabeel Mohammed , Joseph Paul Cohen

Human face pose estimation aims at estimating the gazing direction or head postures with 2D images. It gives some very important information such as communicative gestures, saliency detection and so on, which attracts plenty of attention…

Computer Vision and Pattern Recognition · Computer Science 2017-12-19 Chaoqun Hong , Jun Yu