English
Related papers

Related papers: AnimalFormer: Multimodal Vision Framework for Beha…

200 papers

The brain can only be fully understood through the lens of the behavior it generates -- a guiding principle in modern neuroscience research that nevertheless presents significant technical challenges. Many studies capture behavior with…

Neurons and Cognition · Quantitative Biology 2026-03-02 Yanchen Wang , Han Yu , Ari Blau , Yizi Zhang , The International Brain Laboratory , Liam Paninski , Cole Hurwitz , Matt Whiteway

Vehicular platooning promises transformative improvements in transportation efficiency and safety through the coordination of multi-vehicle formations enabled by Vehicle-to-Everything (V2X) communication. However, the distributed nature of…

Cryptography and Security · Computer Science 2025-12-24 Konstantinos Kalogiannis , Ahmed Mohamed Hussain , Hexu Li , Panos Papadimitratos

Accepted in the ICIP 2025 We present a novel transformer-based framework for whole-body grasping that addresses both pose generation and motion infilling, enabling realistic and stable object interactions. Our pipeline comprises three…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Edward Effendy , Kuan-Wei Tseng , Rei Kawakami

Pain is a manifold condition that impacts a significant percentage of the population. Accurate and reliable pain evaluation for the people suffering is crucial to developing effective and advanced pain management protocols. Automatic pain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Stefanos Gkikas , Raul Fernandez Rojas , Manolis Tsiknakis

Vision-driven field monitoring is central to digital agriculture, yet models built on general-domain pretrained backbones often fail to generalize across tasks, owing to the interaction of fine, variable canopy structures with fluctuating…

Unlike Object Detection, Visual Grounding task necessitates the detection of an object described by complex free-form language. To simultaneously model such complex semantic and visual representations, recent state-of-the-art studies adopt…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Weitai Kang , Luowei Zhou , Junyi Wu , Changchang Sun , Yan Yan

Most approaches for semantic segmentation use only information from color cameras to parse the scenes, yet recent advancements show that using depth data allows to further improve performances. In this work, we focus on transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Francesco Barbato , Giulia Rizzoli , Pietro Zanuttigh

Quantitative analysis of animal behavior and biomechanics requires accurate animal pose and shape estimation across species, and is important for animal welfare and biological research. However, the small network capacity of previous…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jin Lyu , Tianyi Zhu , Yi Gu , Li Lin , Pujin Cheng , Yebin Liu , Xiaoying Tang , Liang An

Despite recent advancements in AI for robotics, grasping remains a partially solved challenge, hindered by the lack of benchmarks and reproducibility constraints. This paper introduces a vision-based grasping framework that can easily be…

Robotics · Computer Science 2024-03-13 François Hélénon , Johann Huber , Faïz Ben Amar , Stéphane Doncieux

Accurate in-season crop type classification is crucial for the crop production estimation and monitoring of agricultural parcels. However, the complexity of the plant growth patterns and their spatio-temporal variability present significant…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Valentin Barriere , Martin Claverie , Maja Schneider , Guido Lemoine , Raphaël d'Andrimont

The Smart Dietary Assistant utilizes Machine Learning to provide personalized dietary advice, focusing on users with conditions like diabetes. This app leverages the Grounding DINO model, which combines a text encoder and image backbone to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Abdelilah Nossair , Hamza El Housni

Pixel grounding, encompassing tasks such as Referring Expression Segmentation (RES), has garnered considerable attention due to its immense potential for bridging the gap between vision and language modalities. However, advancements in this…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Rui Hu , Lianghui Zhu , Yuxuan Zhang , Tianheng Cheng , Lei Liu , Heng Liu , Longjin Ran , Xiaoxin Chen , Wenyu Liu , Xinggang Wang

Livestock feeding behaviour is an influential research area for those involved in animal husbandry and agriculture. In recent years, there has been a growing interest in automated systems for monitoring the behaviour of ruminants. Despite…

We propose VISO-Grasp, a novel vision-language-informed system designed to systematically address visibility constraints for grasping in severely occluded environments. By leveraging Foundation Models (FMs) for spatial reasoning and active…

Robotics · Computer Science 2025-08-07 Yitian Shi , Di Wen , Guanqi Chen , Edgar Welte , Sheng Liu , Kunyu Peng , Rainer Stiefelhagen , Rania Rayyes

The vast majority of visual animals actively control their eyes, heads, and/or bodies to direct their gaze toward different parts of their environment. In contrast, recent applications of reinforcement learning in robotic manipulation…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Youssef Zaky , Gaurav Paruthi , Bryan Tripp , James Bergstra

Pixel-level segmentation is essential in remote sensing, where foundational vision models like CLIP and Segment Anything Model(SAM) have demonstrated significant capabilities in zero-shot segmentation tasks. Despite their advances,…

Multimedia · Computer Science 2025-03-12 Xing Zi , Kairui Jin , Xian Tao , Jun Li , Ali Braytee , Rajiv Ratn Shah , Mukesh Prasad

This paper introduces a new approach to the long-term tracking of an object in a challenging environment. The object is a cow and the environment is an enclosure in a cowshed. Some of the key challenges in this domain are a cluttered…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Aram Ter-Sarkisov , Robert Ross , John Kelleher

We demonstrate a working prototype for the monitoring of cow welfare by automatically analysing the animal behaviours. Deep learning models have been developed and tested with videos acquired in a farm, and a precision of 81.2\% has been…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Chuong Nguyen , Dadong Wang , Karl Von Richter , Philip Valencia , Flavio A. P. Alvarenga , Gregory Bishop-Hurley

Multi-modality pre-training paradigm that aligns protein sequences and biological descriptions has learned general protein representations and achieved promising performance in various downstream applications. However, these works were…

Machine Learning · Computer Science 2024-12-31 Hanjing Zhou , Mingze Yin , Wei Wu , Mingyang Li , Kun Fu , Jintai Chen , Jian Wu , Zheng Wang

Due to deteriorating environmental conditions and increasing human activity, conservation efforts directed towards wildlife is crucial. Motion-activated camera traps constitute an efficient tool for tracking and monitoring wildlife…