English
Related papers

Related papers: Neural Plasticity-Inspired Multimodal Foundation M…

200 papers

We introduce NeuCo-Bench, a novel benchmark framework for evaluating (lossy) neural compression and representation learning in the context of Earth Observation (EO). Our approach builds on fixed-size embeddings that act as compact,…

Heliophysics is central to understanding and forecasting space weather events and solar activity. Despite decades of high-resolution observations from the Solar Dynamics Observatory (SDO), most models remain task-specific and constrained by…

Data-driven visual odometry (VO) is a critical subroutine for autonomous edge robotics, and recent progress in the field has produced highly accurate point predictions in complex environments. However, emerging autonomous edge robotics…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Alex C. Stutts , Danilo Erricolo , Theja Tulabandhula , Amit Ranjan Trivedi

Neural operators extend data-driven models to map between infinite-dimensional functional spaces. While these operators perform effectively in either the time or frequency domain, their performance may be limited when applied to…

Machine Learning · Computer Science 2024-06-06 Karn Tiwari , N M Anoop Krishnan , A P Prathosh

Gravitational-wave data analysis relies on accurate and efficient methods to extract physical information from noisy detector signals, yet the increasing rate and complexity of observations represent a growing challenge. Deep learning…

This paper presents two visual trackers from the different paradigms of learning and registration based tracking and evaluates their application in image based visual servoing. They can track object motion with four degrees of freedom (DoF)…

Computer Vision and Pattern Recognition · Computer Science 2017-04-05 Mennatullah Siam , Abhineet Singh , Camilo Perez , Martin Jagersand

Collaborative perception plays a crucial role in enhancing environmental understanding by expanding the perceptual range and improving robustness against sensor failures, which primarily involves collaborative 3D detection and tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Xunjie He , Christina Dao Wen Lee , Meiling Wang , Chengran Yuan , Zefan Huang , Yufeng Yue , Marcelo H. Ang

We explore the scaling behaviors of artificial intelligence to establish practical techniques for training foundation models on high-resolution electro-optical (EO) datasets that exceed the current state-of-the-art scale by orders of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Charith Wickrema , Eliza Mace , Hunter Brown , Heidys Cabrera , Nick Krall , Matthew O'Neill , Shivangi Sarkar , Lowell Weissman , Eric Hughes , Guido Zarrella

Wheeled robots have recently demonstrated superior mechanical capability to traverse vertically challenging terrain (e.g., extremely rugged boulders comparable in size to the vehicles themselves). Negotiating such terrain introduces…

Robotics · Computer Science 2024-03-26 Aniket Datar , Chenhui Pan , Mohammad Nazeri , Anuj Pokhrel , Xuesu Xiao

Optical and Synthetic Aperture Radar (SAR) fusion-based object detection has attracted significant research interest in remote sensing, as these modalities provide complementary information for all-weather monitoring. However, practical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Zhicheng Zhao , Yuancheng Xu , Andong Lu , Chenglong Li , Jin Tang

Multimodal spatiotemporal learning on real-world experimental data is constrained by two challenges: within-modality measurements are sparse, irregular, and noisy (QA/QC artifacts) but cross-modally correlated; the set of available…

Machine Learning · Computer Science 2025-11-05 Kevin Valencia , Thilina Balasooriya , Xihaier Luo , Shinjae Yoo , David Keetae Park

In robotics, Vision-Language-Action (VLA) models that integrate diverse multimodal signals from multi-view inputs have emerged as an effective approach. However, most prior work adopts static fusion that processes all visual inputs…

Robotics · Computer Science 2026-02-18 Young-Chae Son , Jung-Woo Lee , Yoon-Ji Choi , Dae-Kwan Ko , Soo-Chul Lim

Sensor-based Human Activity Recognition (HAR) underpins many ubiquitous and wearable computing applications, yet current models remain limited by scarce labels, sensor heterogeneity, and weak generalization across users, devices, and…

Signal Processing · Electrical Eng. & Systems 2026-04-10 Sizhen Bian , Mengxi Liu , Lala Shakti Swarup Ray , Bo Zhou , Bin Guo , Zhiwen Yu , Thomas Ploetz , Paul Lukowicz , Siyu Yuan , Vitor Fortes Rey

Finite Element Analysis (FEA) is a powerful but computationally intensive method for simulating physical phenomena. Recent advancements in machine learning have led to surrogate models capable of accelerating FEA. Yet there are still…

Machine Learning · Computer Science 2025-02-18 Georgios Triantafyllou , Panagiotis G. Kalozoumis , George Dimas , Dimitris K. Iakovidis

Modern Earth Observation (EO) missions generate massive volumes of imagery that challenge existing downlink and ground-processing capabilities, particularly for time-critical applications. This work investigates how a low Earth orbit (LEO)…

Networking and Internet Architecture · Computer Science 2026-04-08 Beatriz Soret , Antonio M. Mercado-Martínez , Antonio Jurado-Navas , Nicolai D. Lyholm , Marco Moretti , Petar Popovski , Israel Leyva-Mayorga

Purpose: Depth estimation in robotic surgery is vital in 3D reconstruction, surgical navigation and augmented reality visualization. Although the foundation model exhibits outstanding performance in many vision tasks, including depth…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Beilei Cui , Mobarakol Islam , Long Bai , Hongliang Ren

Multimodal image registration is a challenging but essential step for numerous image-guided procedures. Most registration algorithms rely on the computation of complex, frequently non-differentiable similarity metrics to deal with the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Matteo Ronchetti , Wolfgang Wein , Nassir Navab , Oliver Zettinig , Raphael Prevost

Optical satellites, with their diverse band layouts and ground sampling distances, supply indispensable evidence for tasks ranging from ecosystem surveillance to emergency response. However, significant discrepancies in band composition and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Xuyang Li , Chenyu Li , Danfeng Hong

Embodied foundation models are increasingly performant in real-world domains such as robotics or autonomous driving. These models are often deployed in interactive or assistive settings, where it is important that these assistive models…

Robotics · Computer Science 2026-03-06 Pradyumna Tambwekar , Andrew Silva , Deepak Gopinath , Jonathan DeCastro , Xiongyi Cui , Guy Rosman

Learning-based monocular visual odometry (VO) poses robustness, generalization, and efficiency challenges in robotics. Recent advances in visual foundation models, such as DINOv2, have improved robustness and generalization in various…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Maulana Bisyir Azhari , David Hyunchul Shim