English
Related papers

Related papers: Zero-Shot Multi-Animal Tracking in the Wild

200 papers

The recent Segment Anything Model (SAM) has emerged as a new paradigmatic vision foundation model, showcasing potent zero-shot generalization and flexible prompting. Despite SAM finding applications and adaptations in various domains, its…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Xumeng Han , Longhui Wei , Xuehui Yu , Zhiyang Dou , Xin He , Kuiran Wang , Yingfei Sun , Zhenjun Han , Qi Tian

Current motion-based multiple object tracking (MOT) approaches rely heavily on Intersection-over-Union (IoU) for object association. Without using 3D features, they are ineffective in scenarios with occlusions or visually similar objects.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Milad Khanchi , Maria Amer , Charalambos Poullis

Current image-based keypoint detection methods for animal (including human) bodies and faces are generally divided into full-supervised and few-shot class-agnostic approaches. The former typically relies on laborious and time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Hao Zhang , Lumin Xu , Shenqi Lai , Wenqi Shao , Nanning Zheng , Ping Luo , Yu Qiao , Kaipeng Zhang

The ability to predict future outcomes given control actions is fundamental for physical reasoning. However, such predictive models, often called world models, remains challenging to learn and are typically developed for task-specific…

Robotics · Computer Science 2025-02-04 Gaoyue Zhou , Hengkai Pan , Yann LeCun , Lerrel Pinto

The recent Segment Anything Model (SAM) has demonstrated remarkable zero-shot capability and flexible geometric prompting in general image segmentation. However, SAM often struggles when handling various unconventional images, such as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Aoran Xiao , Weihao Xuan , Heli Qi , Yun Xing , Ruijie Ren , Xiaoqin Zhang , Ling Shao , Shijian Lu

This paper introduces MCTrack, a new 3D multi-object tracking method that achieves state-of-the-art (SOTA) performance across KITTI, nuScenes, and Waymo datasets. Addressing the gap in existing tracking paradigms, which often perform well…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xiyang Wang , Shouzheng Qi , Jieyou Zhao , Hangning Zhou , Siyu Zhang , Guoan Wang , Kai Tu , Songlin Guo , Jianbo Zhao , Jian Li , Mu Yang

Multi-object tracking (MOT) is the problem of tracking the state of an unknown and time-varying number of objects using noisy measurements, with important applications such as autonomous driving, tracking animal behavior, defense systems,…

Machine Learning · Computer Science 2022-02-17 Juliano Pinto , Georg Hess , William Ljungbergh , Yuxuan Xia , Henk Wymeersch , Lennart Svensson

Increasing demand for meat products combined with farm labor shortages has resulted in a need to develop new real-time solutions to monitor animals effectively. Significant progress has been made in continuously locating individual pigs…

We introduce SAM2Point, a preliminary exploration adapting Segment Anything Model 2 (SAM 2) for zero-shot and promptable 3D segmentation. SAM2Point interprets any 3D data as a series of multi-directional videos, and leverages SAM 2 for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ziyu Guo , Renrui Zhang , Xiangyang Zhu , Chengzhuo Tong , Peng Gao , Chunyuan Li , Pheng-Ann Heng

Wildlife monitoring is crucial for studying biodiversity loss and climate change. Camera trap images provide a non-intrusive method for analyzing animal populations and identifying ecological patterns over time. However, manual analysis is…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Julian D. Santamaria , Claudia Isaza , Jhony H. Giraldo

Bird strikes present a huge risk for aircraft, especially since traditional airport bird surveillance is mainly dependent on inefficient human observation. Computer vision based technology has been proposed to automatically detect birds,…

Computer Vision and Pattern Recognition · Computer Science 2016-01-19 Ying Huang , Hong Zheng , Haibin Ling , Erik Blasch , Hao Yang

Few-shot semantic segmentation has recently attracted great attention. The goal is to develop a model capable of segmenting unseen classes using only a few annotated samples. Most existing approaches adapt a pre-trained model by training…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Bernardo Forni , Gabriele Lombardi , Federico Pozzi , Mirco Planamente

Tracking specific targets, such as pedestrians and vehicles, has been the focus of recent vision-based multitarget tracking studies. However, in some real-world scenarios, unseen categories often challenge existing methods due to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Zewei Wu , Longhao Wang , Cui Wang , César Teixeira , Wei Ke , Zhang Xiong

In agriculture, automating the accurate tracking of fruits, vegetables, and fiber is a very tough problem. The issue becomes extremely challenging in dynamic field environments. Yet, this information is critical for making day-to-day…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Md Ahmed Al Muzaddid , William J. Beksi

3D Multi-Object Tracking (MOT) provides the trajectories of surrounding objects, assisting robots or vehicles in smarter path planning and obstacle avoidance. Existing 3D MOT methods based on the Tracking-by-Detection framework typically…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Xiaohong Liu , Xulong Zhao , Gang Liu , Zili Wu , Tao Wang , Lei Meng , Yuhan Wang

The ability to detect and track the dynamic objects in different scenes is fundamental to real-world applications, e.g., autonomous driving and robot navigation. However, traditional Multi-Object Tracking (MOT) is limited to tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Qiankun Liu , Yichen Li , Yuqi Jiang , Ying Fu

Robots operating in human environments need various skills, like slow and fast walking, turning, side-stepping, and many more. However, building robot controllers that can exhibit such a large range of behaviors is a challenging problem…

Robotics · Computer Science 2022-02-28 Tianyu Li , Jungdam Won , Sehoon Ha , Akshara Rai

In order to track all persons in a scene, the tracking-by-detection paradigm has proven to be a very effective approach. Yet, relying solely on a single detector is also a major limitation, as useful image information might be ignored.…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Roberto Henschel , Laura Leal-Taixé , Daniel Cremers , Bodo Rosenhahn

Animals are described as effectively camouflaged when they blend seamlessly with their surrounding, yet no standardized quantitative measure of this seamlessness exists. We address this gap by framing camouflage evaluation as a visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Amin Karimi Monsefi , Abolfazl Meyarian , Mridul Khurana , Shuheng Wang , Pouyan Navard , Cheng Zhang , Anuj Karpatne , Wei-Lun Chao , Rajiv Ramnath

Object tracking in satellite videos remains a complex endeavor in remote sensing due to the intricate and dynamic nature of satellite imagery. Existing state-of-the-art trackers in computer vision integrate sophisticated architectures,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Athena Psalta , Vasileios Tsironis , Andreas El Saer , Konstantinos Karantzalos