English
Related papers

Related papers: Learning Appearance and Motion Cues for Panoptic T…

200 papers

Video Instance Segmentation is a fundamental computer vision task that deals with segmenting and tracking object instances across a video sequence. Most existing methods typically accomplish this task by employing a multi-stage top-down…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Jyoti Kini , Mubarak Shah

Recent approaches for high accuracy detection and tracking of object categories in video consist of complex multistage solutions that become more cumbersome each year. In this paper we propose a ConvNet architecture that jointly performs…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Christoph Feichtenhofer , Axel Pinz , Andrew Zisserman

This paper presents a novel Learning from Demonstration (LfD) method that uses neural fields to learn new skills efficiently and accurately. It achieves this by utilizing a shared embedding to learn both scene and motion representations in…

Robotics · Computer Science 2023-08-16 Ahmet Tekden , Marc Peter Deisenroth , Yasemin Bekiroglu

Handling occlusion remains a significant challenge for video instance-level tasks like Multiple Object Tracking (MOT) and Video Instance Segmentation (VIS). In this paper, we propose a novel framework, Amodal-Aware Video Instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Minh Tran , Thang Pham , Winston Bounsavy , Tri Nguyen , Ngan Le

Existing pedestrian attribute recognition (PAR) algorithms are mainly developed based on a static image. However, the performance is not reliable for images with challenging factors, such as heavy occlusion, motion blur, etc. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Jun Zhu , Jiandong Jin , Zihan Yang , Xiaohao Wu , Xiao Wang

Point tracking aims to identify the same physical point across video frames and serves as a geometry-aware representation of motion. This representation supports a wide range of applications, from robotics to augmented reality, by enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Görkay Aydemir

Temporal semantic scene understanding is critical for self-driving cars or robots operating in dynamic environments. In this paper, we propose 4D panoptic LiDAR segmentation to assign a semantic class and a temporally-consistent instance ID…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Mehmet Aygün , Aljoša Ošep , Mark Weber , Maxim Maximov , Cyrill Stachniss , Jens Behley , Laura Leal-Taixé

While generic object detection has achieved large improvements with rich feature hierarchies from deep nets, detecting small objects with poor visual cues remains challenging. Motion cues from multiple frames may be more informative for…

Computer Vision and Pattern Recognition · Computer Science 2018-05-16 Ryota Yoshihashi , Tu Tuan Trinh , Rei Kawakami , Shaodi You , Makoto Iida , Takeshi Naemura

Recognising the characteristics of objects while a robot handles them is crucial for adjusting motions that ensure stable and efficient interactions with containers. Ahead of realising stable and efficient robot motions for…

Robotics · Computer Science 2024-03-19 Namiko Saito , Joao Moura , Hiroki Uchida , Sethu Vijayakumar

The task of 3D single object tracking (SOT) with LiDAR point clouds is crucial for various applications, such as autonomous driving and robotics. However, existing approaches have primarily relied on appearance matching or motion modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhipeng Luo , Gongjie Zhang , Changqing Zhou , Zhonghua Wu , Qingyi Tao , Lewei Lu , Shijian Lu

Object detection has long been a topic of high interest in computer vision literature. Motivated by the fact that annotating data for the multi-object tracking (MOT) problem is immensely expensive, recent studies have turned their attention…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Son Tran , Cong Tran , Anh Tran , Cuong Pham

Real-time human activity recognition plays an essential role in real-world human-centered robotics applications, such as assisted living and human-robot collaboration. Although previous methods based on skeletal data to encode human poses…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Brian Reily , Qingzhao Zhu , Christopher Reardon , Hao Zhang

Autonomous driving holds great promise in addressing traffic safety concerns by leveraging artificial intelligence and sensor technology. Multi-Object Tracking plays a critical role in ensuring safer and more efficient navigation through…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Lei Cheng , Arindam Sengupta , Siyang Cao

In this paper, we propose an accurate and real-time anomaly detection and localization in crowded scenes, and two descriptors for representing anomalous behavior in video are proposed. We consider a video as being a set of cubic patches.…

Computer Vision and Pattern Recognition · Computer Science 2016-01-05 Mohammad Sabokrou , Mahmood Fathy , Mojtaba Hosseini

Video Panoptic Segmentation (VPS) aims at assigning a class label to each pixel, uniquely segmenting and identifying all object instances consistently across all frames. Classic solutions usually decompose the VPS task into several…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Yi Zhou , Hui Zhang , Hana Lee , Shuyang Sun , Pingjun Li , Yangguang Zhu , ByungIn Yoo , Xiaojuan Qi , Jae-Joon Han

Panoptic segmentation, which combines instance and semantic segmentation, has gained a lot of attention in autonomous vehicles, due to its comprehensive representation of the scene. This task can be applied for cameras and LiDAR sensors,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Fardin Ayar , Ehsan Javanmardi , Manabu Tsukada , Mahdi Javanmardi , Mohammad Rahmati

Scene flow represents the 3D motion of every point in the dynamic environments. Like the optical flow that represents the motion of pixels in 2D images, 3D motion representation of scene flow benefits many applications, such as autonomous…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Guangming Wang , Xinrui Wu , Zhe Liu , Hesheng Wang

State-of-the-art lidar panoptic segmentation (LPS) methods follow bottom-up segmentation-centric fashion wherein they build upon semantic segmentation networks by utilizing clustering to obtain object instances. In this paper, we re-think…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Abhinav Agarwalla , Xuhua Huang , Jason Ziglar , Francesco Ferroni , Laura Leal-Taixé , James Hays , Aljoša Ošep , Deva Ramanan

Detection of objects in cluttered indoor environments is one of the key enabling functionalities for service robots. The best performing object detection approaches in computer vision exploit deep Convolutional Neural Networks (CNN) to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-11 Georgios Georgakis , Arsalan Mousavian , Alexander C. Berg , Jana Kosecka

LVLMs have been shown to perform excellently in image-level tasks such as VQA and caption. However, in many instance-level tasks, such as visual grounding and object detection, LVLMs still show performance gaps compared to previous expert…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Teng Fu , Mengyang Zhao , Ke Niu , Kaixin Peng , Bin Li