English
Related papers

Related papers: Identification of Cognitive Workload during Surgic…

200 papers

A comprehensive understanding of surgical scenes allows for monitoring of the surgical process, reducing the occurrence of accidents and enhancing efficiency for medical professionals. Semantic modeling within operating rooms, as a scene…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Diandian Guo , Manxi Lin , Jialun Pei , He Tang , Yueming Jin , Pheng-Ann Heng

This study proposes a novel approach combining Multimodal Deep Learning with intrinsic eXplainable Artificial Intelligence techniques to predict pathological response in non-small cell lung cancer patients undergoing neoadjuvant therapy.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Alice Natalina Caragliano , Claudia Tacconi , Carlo Greco , Lorenzo Nibid , Edy Ippolito , Michele Fiore , Giuseppe Perrone , Sara Ramella , Paolo Soda , Valerio Guarrasi

Activity recognition in surgical videos is a key research area for developing next-generation devices and workflow monitoring systems. Since surgeries are long processes with highly-variable lengths, deep learning models used for surgical…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Zhuohong He , Ali Mottaghi , Aidean Sharghi , Muhammad Abdullah Jamal , Omid Mohareri

Surgical intelligence has the potential to improve the safety and consistency of surgical care, yet most existing surgical AI frameworks remain task-specific and struggle to generalize across procedures and institutions. Although multimodal…

Temporal context is essential for robotic manipulation because such tasks are inherently non-Markovian, yet mainstream VLA models typically overlook it and struggle with long-horizon, temporally dependent tasks. Cognitive science suggests…

Robotics · Computer Science 2026-02-02 Hao Shi , Bin Xie , Yingfei Liu , Lin Sun , Fengrong Liu , Tiancai Wang , Erjin Zhou , Haoqiang Fan , Xiangyu Zhang , Gao Huang

With the advent of deep learning, many dense prediction tasks, i.e. tasks that produce pixel-level predictions, have seen significant performance improvements. The typical approach is to learn these tasks in isolation, that is, a separate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Simon Vandenhende , Stamatios Georgoulis , Wouter Van Gansbeke , Marc Proesmans , Dengxin Dai , Luc Van Gool

Surgical scene understanding and multi-tasking learning are crucial for image-guided robotic surgery. Training a real-time robotic system for the detection and segmentation of high-resolution images provides a challenging problem with the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Mobarakol Islam , Vibashan VS , Hongliang Ren

Multimedia applications often require concurrent solutions to multiple tasks. These tasks hold clues to each-others solutions, however as these relations can be complex this remains a rarely utilized property. When task relations are…

Computer Vision and Pattern Recognition · Computer Science 2019-04-08 Gjorgji Strezoski , Nanne van Noord , Marcel Worring

Sensor-based human activity segmentation and recognition are two important and challenging problems in many real-world applications and they have drawn increasing attention from the deep learning community in recent years. Most of the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Furong Duan , Tao Zhu , Jinqiang Wang , Liming Chen , Huansheng Ning , Yaping Wan

Surgical tool presence detection and surgical phase recognition are two fundamental yet challenging tasks in surgical video analysis and also very essential components in various applications in modern operating rooms. While these two…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Yueming Jin , Huaxia Li , Qi Dou , Hao Chen , Jing Qin , Chi-Wing Fu , Pheng-Ann Heng

Healthcare clinics regularly encounter dynamic data that changes due to variations in patient populations, treatment policies, medical devices, and emerging disease patterns. Deep learning models can suffer from catastrophic forgetting when…

Machine Learning · Computer Science 2023-11-09 Amritpal Singh , Mustafa Burak Gurbuz , Shiva Souhith Gantha , Prahlad Jasti

Clinical outcome or severity prediction from medical images has largely focused on learning representations from single-timepoint or snapshot scans. It has been shown that disease progression can be better characterized by temporal imaging.…

Image and Video Processing · Electrical Eng. & Systems 2022-04-01 Aishik Konwer , Xuan Xu , Joseph Bae , Chao Chen , Prateek Prasanna

Early diagnosis of interstitial lung diseases is crucial for their treatment, but even experienced physicians find it difficult, as their clinical manifestations are similar. In order to assist with the diagnosis, computer-aided diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Stergios Christodoulidis , Marios Anthimopoulos , Lukas Ebner , Andreas Christe , Stavroula Mougiakakou

Concurrent Speaker Detection (CSD), the task of identifying active speakers and their overlaps in an audio signal, is essential for various audio applications, including meeting transcription, speaker diarization, and speech separation.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-16 Amit Eliav , Sharon Gannot

Convolutional neural networks (CNNs) have become the most successful approach in many vision-related domains. However, they are limited to domains where data is abundant. Recent works have looked at multi-task learning (MTL) to mitigate…

Computer Vision and Pattern Recognition · Computer Science 2018-03-16 Ludovic Trottier , Philippe Giguère , Brahim Chaib-draa

Decoding human activity accurately from wearable sensors can aid in applications related to healthcare and context awareness. The present approaches in this domain use recurrent and/or convolutional models to capture the spatio-temporal…

Human-Computer Interaction · Computer Science 2020-12-21 Satya P. Singh , Aimé Lay-Ekuakille , Deepak Gangwar , Madan Kumar Sharma , Sukrit Gupta

Scientific publications about machine learning in healthcare are often about implementing novel methods and boosting the performance - at least from a computer science perspective. However, beyond such often short-lived improvements, much…

The task of multimodal cancer detection is to determine the locations and categories of lesions by using different imaging techniques, which is one of the key research methods for cancer diagnosis. Recently, deep learning-based object…

Image and Video Processing · Electrical Eng. & Systems 2023-12-06 Yan Tian , Zhaocheng Xu , Yujun Ma , Weiping Ding , Ruili Wang , Zhihong Gao , Guohua Cheng , Linyang He , Xuran Zhao

This paper presents a deep learning-based wound classification tool that can assist medical personnel in non-wound care specialization to classify five key wound conditions, namely deep wound, infected wound, arterial wound, venous wound,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Po-Hsuan Huang , Yi-Hsiang Pan , Ying-Sheng Luo , Yi-Fan Chen , Yu-Cheng Lo , Trista Pei-Chun Chen , Cherng-Kang Perng