English
Related papers

Related papers: Neural Plasticity-Inspired Multimodal Foundation M…

200 papers

Multiobjective optimization (MOO) is prevalent in numerous applications, in which a Pareto front (PF) is constructed to display optima under various preferences. Previous methods commonly utilize the set of Pareto objectives (particles on…

Machine Learning · Computer Science 2024-02-16 Xiaoyuan Zhang , Xi Lin , Yichi Zhang , Yifan Chen , Qingfu Zhang

The growing availability of Earth Observation (EO) data and recent advances in Computer Vision have driven rapid progress in machine learning for EO, producing domain-specific models at ever-increasing scales. Yet this progress risks…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Tasos Papazafeiropoulos , Nikolaos Ioannis Bountos , Nikolas Papadopoulos , Ioannis Papoutsis

Channel prediction permits to acquire channel state information (CSI) without signaling overhead. However, almost all existing channel prediction methods necessitate the deployment of a dedicated model to accommodate a specific…

Signal Processing · Electrical Eng. & Systems 2025-03-20 Boxun Liu , Shijian Gao , Xuanyu Liu , Xiang Cheng , Liuqing Yang

Recent robot foundation models largely rely on large-scale behavior cloning, which imitates expert actions but discards transferable dynamics knowledge embedded in heterogeneous embodied data. While the Unified World Model (UWM) formulation…

The purpose of this research is to employ non-uniform arrays in different active and passive sensing applications for both narrowband and wideband operations, while providing a multitude of array processing methodologies that assist in…

Signal Processing · Electrical Eng. & Systems 2018-12-10 Elie Bou Daher

Humans can flexibly interpret and compose different goal specifications, such as language instructions, spatial coordinates, or visual references, when navigating to a destination. In contrast, most existing robotic navigation policies are…

Robotics · Computer Science 2025-09-25 Noriaki Hirose , Catherine Glossop , Dhruv Shah , Sergey Levine

The learn-from-observation (LfO) paradigm is a human-inspired mode for a robot to learn to perform a task simply by watching it being performed. LfO can facilitate robot integration on factory floors by minimizing disruption and reducing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Ehsan Asali , Prashant Doshi , Jin Sun

We take the perspective in which we want to design a downstream task (such as estimating vegetation coverage) on a certain area of interest (AOI) with a limited labeling budget. By leveraging an existing Foundation Model (FM) we must decide…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Raul Ramos-Pollan , Freddie Kalaitzis , Karthick Panner Selvam

The volume of unlabelled Earth observation (EO) data is huge, but many important applications lack labelled training data. However, EO data offers the unique opportunity to pair data from different modalities and sensors automatically based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Vishal Nedungadi , Ankit Kariryaa , Stefan Oehmcke , Serge Belongie , Christian Igel , Nico Lang

The order/dimension of models derived on the basis of data is commonly restricted by the number of observations, or in the context of monitored systems, sensing nodes. This is particularly true for structural systems (e.g., civil or…

Machine Learning · Computer Science 2022-12-01 Zhilu Lai , Wei Liu , Xudong Jian , Kiran Bacsa , Limin Sun , Eleni Chatzi

Predicting future sensory states is crucial for learning agents such as robots, drones, and autonomous vehicles. In this paper, we couple multiple sensory modalities with exploratory actions and propose a predictive neural network…

Robotics · Computer Science 2021-09-17 Xiaohui Chen , Ramtin Hosseini , Karen Panetta , Jivko Sinapov

Artificial intelligence is a key enabler for next-generation wireless communication and sensing. Yet, today's learning-based wireless techniques do not generalize well: most models are task-specific, environment-dependent, and limited to…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Vahid Yazdnian , Yasaman Ghasempour

Weight-sharing neural architecture search aims to optimize a configurable neural network model (supernet) for a variety of deployment scenarios across many devices with different resource constraints. Existing approaches use evolutionary…

Machine Learning · Computer Science 2023-07-04 Achintya Kundu , Laura Wynter , Rhui Dih Lee , Luis Angel Bathen

We introduce OpenVO, a novel framework for Open-world Visual Odometry (VO) with temporal awareness under limited input conditions. OpenVO effectively estimates real-world-scale ego-motion from monocular dashcam footage with varying…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Phuc D. A. Nguyen , Anh N. Nhu , Ming C. Lin

This paper investigates a design framework for sparse fluid antenna systems (FAS) enabling high-performance direction-of-arrival (DOA) estimation, particularly in challenging millimeter-wave (mmWave) environments. By ingeniously harnessing…

Signal Processing · Electrical Eng. & Systems 2025-08-15 He Xu , Tuo Wu , Ye Tian , Ming Jin , Wei Liu , Qinghua Guo , Maged Elkashlan , Matthew C. Valenti , Chan-Byoung Chae , Kin-Fai Tong , Kai-Kit Wong

Numerical simulations are essential tools to evaluate the solution of the wave equation in complex settings, such as three-dimensional (3D) domains with heterogeneous properties. However, their application is limited by high computational…

Machine Learning · Computer Science 2025-04-09 Fanny Lehmann , Filippo Gatti , Didier Clouteau

This article presents a collaborative research effort aimed at developing a novel six-degree-of-freedom (6-DOF) motion platform for the empirical characterization of hydrodynamic forces crucial for the control and stability of surface and…

Robotics · Computer Science 2025-01-29 Juliana Danesi Ruiz , Michael Swafford , Austin Krebill , Rachel Vitali , Casey Harwood

This work presents UNO, a unified monocular visual odometry framework that enables robust and adaptable pose estimation across diverse environments, platforms, and motion patterns. Unlike traditional methods that rely on deployment-specific…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Wentao Zhao , Yihe Niu , Yanbo Wang , Tianchen Deng , Shenghai Yuan , Zhenli Wang , Rui Guo , Jingchuan Wang

The rapid advancement of remote sensing foundation models, particularly vision and multimodal models, has significantly enhanced the capabilities of intelligent geospatial data interpretation. These models combine various data modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Ziyue Huang , Hongxi Yan , Qiqi Zhan , Shuai Yang , Mingming Zhang , Chenkai Zhang , YiMing Lei , Zeming Liu , Qingjie Liu , Yunhong Wang

Multimodal instruction tuning is the de facto recipe for adapting vision language models (VLMs), yet instruction data are highly redundant, making data selection critical for training efficiency. Existing methods derive selection signals…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Mingkang Dong , Hongyi Cai , Xiwen Lei , Jie Li , Tao Zhang , Muxin Pu