English
Related papers

Related papers: AnimalFormer: Multimodal Vision Framework for Beha…

200 papers

Accurate estimation of pasture biomass from agricultural imagery is critical for sustainable livestock management, yet existing methods are limited by the small, imbalanced, and sparsely annotated datasets typical of real world monitoring.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Mridankan Mandal

Meeting the increasing global demand for food security and sustainable farming requires intelligent crop recommendation systems that operate in real time. Traditional soil analysis techniques are often slow, labor-intensive, and not…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Vishal Pandey , Ranjita Das , Debasmita Biswas

In this technical report, we introduce our solution to human-centric spatio-temporal video grounding task. We propose a concise and effective framework named STVGFormer, which models spatiotemporal visual-linguistic dependencies with a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Zihang Lin , Chaolei Tan , Jian-Fang Hu , Zhi Jin , Tiancai Ye , Wei-Shi Zheng

Multimodal protein features play a crucial role in protein function prediction. However, these features encompass a wide range of information, ranging from structural data and sequence features to protein attributes and interaction…

Machine Learning · Computer Science 2025-11-07 Xiaoling Luo , Peng Chen , Chengliang Liu , Xiaopeng Jin , Jie Wen , Yumeng Liu , Junsong Wang

In this paper, we show the surprisingly good properties of plain vision transformers for body pose estimation from various aspects, namely simplicity in model structure, scalability in model size, flexibility in training paradigm, and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Yufei Xu , Jing Zhang , Qiming Zhang , Dacheng Tao

Predicting future motion trajectories is a critical capability across domains such as robotics, autonomous systems, and human activity forecasting, enabling safer and more intelligent decision-making. This paper proposes a novel, efficient,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Zesen Zhong , Duomin Zhang , Yijia Li

This paper presents a deep learning framework designed to enhance the grasping capabilities of quadrupeds equipped with arms, with a focus on improving precision and adaptability. Our approach centers on a sim-to-real methodology that…

Recent years have witnessed a trend of applying context frames to boost the performance of object detection as video object detection. Existing methods usually aggregate features at one stroke to enhance the feature. These methods, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Han Wang , Jun Tang , Xiaodong Liu , Shanyan Guan , Rong Xie , Li Song

We present DINO-Tracker -- a new framework for long-term dense tracking in video. The pillar of our approach is combining test-time training on a single video, with the powerful localized semantic features learned by a pre-trained DINO-ViT…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Narek Tumanyan , Assaf Singer , Shai Bagon , Tali Dekel

There is a recent trend in the LiDAR perception field towards unifying multiple tasks in a single strong network with improved performance, as opposed to using separate networks for each task. In this paper, we introduce a new LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zixiang Zhou , Dongqiangzi Ye , Weijia Chen , Yufei Xie , Yu Wang , Panqu Wang , Hassan Foroosh

Nonprehensile manipulation through precise pushing is an essential skill that has been commonly challenged by perception and physical uncertainties, such as those associated with contacts, object geometries, and physical properties. For…

Robotics · Computer Science 2024-03-21 Gaotian Wang , Kejia Ren , Kaiyu Hang

We present WidthFormer, a novel transformer-based module to compute Bird's-Eye-View (BEV) representations from multi-view cameras for real-time autonomous-driving applications. WidthFormer is computationally efficient, robust and does not…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Chenhongyi Yang , Tianwei Lin , Lichao Huang , Elliot J. Crowley

Camera traps are revolutionising wildlife monitoring by capturing vast amounts of visual data; however, the manual identification of individual animals remains a significant bottleneck. This study introduces a fully self-supervised approach…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Vladimir Iashin , Horace Lee , Dan Schofield , Andrew Zisserman

This paper introduces a vision-based framework for capturing and understanding human behavior in industrial assembly lines, focusing on car door manufacturing. The framework leverages advanced computer vision techniques to estimate workers'…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Konstantinos Papoutsakis , Nikolaos Bakalos , Konstantinos Fragkoulis , Athena Zacharia , Georgia Kapetadimitri , Maria Pateraki

Local feature matching is a computationally intensive task at the subpixel level. While detector-based methods coupled with feature descriptors struggle in low-texture scenes, CNN-based methods with a sequential extract-to-match pipeline,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Qing Wang , Jiaming Zhang , Kailun Yang , Kunyu Peng , Rainer Stiefelhagen

Sophisticated learning architectures, e.g., Transformers, present a unique opportunity for robots to understand complex vehicle-terrain kinodynamic interactions for off-road mobility. While internet-scale data are available for Natural…

Robotics · Computer Science 2025-02-04 Mohammad Nazeri , Anuj Pokhrel , Alexandyr Card , Aniket Datar , Garrett Warnell , Xuesu Xiao

Learning-based simulation of multi-object rigid-body dynamics remains difficult because contact is discontinuous and errors compound over long horizons. Most existing methods remain tied to mesh connectivity and vertex-level message…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhiyang Dou , Minghao Guo , Haixu Wu , Doug Roble , Tuur Stuyck , Wojciech Matusik

Traditional vision-based material perception methods often experience substantial performance degradation under visually impaired conditions, thereby motivating the shift toward non-visual multimodal material perception. Despite this,…

Machine Learning · Computer Science 2025-11-26 Kailin Lyu , Long Xiao , Jianing Zeng , Junhao Dong , Xuexin Liu , Zhuojun Zou , Haoyue Yang , Lin Shu , Jie Hao

The agility of animals, particularly in complex activities such as running, turning, jumping, and backflipping, stands as an exemplar for robotic system design. Transferring this suite of behaviors to legged robotic systems introduces…

Robotics · Computer Science 2025-05-06 Ruihan Yang , Zhuoqun Chen , Jianhan Ma , Chongyi Zheng , Yiyu Chen , Quan Nguyen , Xiaolong Wang

Motion prediction is an important aspect for Autonomous Driving (AD) and Advance Driver Assistance Systems (ADAS). Current state-of-the-art motion prediction methods rely on High Definition (HD) maps for capturing the surrounding context of…

Machine Learning · Computer Science 2025-04-15 Harsh Yadav , Maximilian Schaefer , Kun Zhao , Tobias Meisen