English
Related papers

Related papers: Structure-Aware Multimodal LLM Framework for Trust…

200 papers

New era has unlocked exciting possibilities for extending Large Language Models (LLMs) to tackle 3D vision-language tasks. However, most existing 3D multimodal LLMs (MLLMs) rely on compressing holistic 3D scene information or segmenting…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xiaoyan Wang , Zeju Li , Yifan Xu , Jiaxing Qi , Zhifei Yang , Ruifei Ma , Xiangde Liu , Chao Zhang

Recent advancements in Large Multimodal Models (LMMs) have attracted interest in their generalization capability with only a few samples in the prompt. This progress is particularly relevant to the medical domain, where the quality and…

Computation and Language · Computer Science 2024-05-06 Seonhee Cho , Choonghan Kim , Jiho Lee , Chetan Chilkunda , Sujin Choi , Joo Heung Yoon

Extremely large-scale multiple-input multiple-output (XL-MIMO) promises to provide ultrahigh data rates in millimeter-wave (mmWave) and Terahertz (THz) spectrum. However, the spherical-wavefront wireless transmission caused by large…

Information Theory · Computer Science 2023-08-16 Xu Shi , Jintao Wang , Zhi Sun , Jian Song

The Multi-Modal Large Language Model (MLLM) refers to an extension of the Large Language Model (LLM) equipped with the capability to receive and infer multi-modal data. Spatial awareness stands as one of the crucial abilities of MLLM,…

Artificial Intelligence · Computer Science 2023-11-02 Yongqiang Zhao , Zhenyu Li , Zhi Jin , Feng Zhang , Haiyan Zhao , Chengfeng Dou , Zhengwei Tao , Xinhai Xu , Donghong Liu

Large Language Models (LLMs) have demonstrated potential in Vision-and-Language Navigation (VLN) tasks, yet current applications face challenges. While LLMs excel in general conversation scenarios, they struggle with specialized navigation…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Yunzhe Xu , Yiyuan Pan , Zhe Liu , Hesheng Wang

Ultra-massive multiple-input multiple-output (UM-MIMO) technology is a key enabler for 6G networks, offering exceptional high data rates in millimeter-wave (mmWave) and Terahertz (THz) frequency bands. The deployment of large antenna arrays…

Signal Processing · Electrical Eng. & Systems 2025-03-19 Ahmed Hussain , Asmaa Abdallah , Abdulkadir Celik , Ahmed M. Eltawil

Heterogeneous multirobot systems show great potential in complex tasks requiring coordinated hybrid cooperation. However, existing methods that rely on static or task-specific models often lack generalizability across diverse tasks and…

Robotics · Computer Science 2025-10-28 Haokun Liu , Zhaoqi Ma , Yunong Li , Junichiro Sugihara , Yicheng Chen , Jinjie Li , Moju Zhao

For low-altitude economy (LAE), fast and accurate beam prediction between high-mobility unmanned aerial vehicles (UAVs) and ground base stations is of paramount importance, which ensures seamless coverage and reliable communications.…

Networking and Internet Architecture · Computer Science 2026-02-27 Chenran Kou , Changsheng You , Mingjiang Wu , Dingzhu Wen , Zezhong Zhang , Chengwen Xing

Humans have the remarkable ability to navigate through unfamiliar environments by solely relying on our prior knowledge and descriptions of the environment. For robots to perform the same type of navigation, they need to be able to…

Robotics · Computer Science 2023-06-21 Harel Biggie , Ajay Narasimha Mopidevi , Dusty Woods , Christoffer Heckman

In the evolving landscape of transportation systems, integrating Large Language Models (LLMs) offers a promising frontier for advancing intelligent decision-making across various applications. This paper introduces a novel 3-dimensional…

Machine Learning · Computer Science 2024-12-17 Dexter Le , Aybars Yunusoglu , Karn Tiwari , Murat Isik , I. Can Dikmen

Autonomous landing is essential for drones deployed in emergency deliveries, post-disaster response, and other large-scale missions. By enabling self-docking on charging platforms, it facilitates continuous operation and significantly…

Robotics · Computer Science 2025-05-13 Siwei Cai , Yuwei Wu , Lifeng Zhou

Conventional recommendation systems frequently fail to fully exploit the high-dimensional semantic signals inherent in multimedia content, thereby limiting the fidelity of user preference modeling. While Multimodal Large Language Models…

Information Retrieval · Computer Science 2026-05-12 Yiming Zhu , Xu Liu , Ziyun Xu , Zheng Wu , Joena Zhang , Sirius Chen , Chenheli Hua , Silvester Yao , Qichao Que , Wentao Shi , Junfeng Pan , Linhong Zhu

Extremely large-scale MIMO (XL-MIMO) is a promising technique for future 6G communications. The sharp increase in the number of antennas causes electromagnetic propagation to change from far-field to near-field. Due to the near-field…

Information Theory · Computer Science 2023-05-25 Yu Lu , Zijian Zhang , Linglong Dai

We propose SpatialLLM, a novel approach advancing spatial intelligence tasks in complex urban scenes. Unlike previous methods requiring geographic analysis tools or domain expertise, SpatialLLM is a unified language model directly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Jiabin Chen , Haiping Wang , Jinpeng Li , Yuan Liu , Zhen Dong , Bisheng Yang

Recently, large language models (LLMs) have gained significant attention for their ability to generate fast and accurate answer to the given query. These models have evolved into large multimodal models (LMMs), which can interpret and…

Information Theory · Computer Science 2026-01-13 Sunwoo Kim , Byonghyo Shim

Large-scale pre-training has shown promising results on the vision-and-language navigation (VLN) task. However, most existing pre-training methods employ discrete panoramas to learn visual-textual associations. This requires the model to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Dong An , Yuankai Qi , Yangguang Li , Yan Huang , Liang Wang , Tieniu Tan , Jing Shao

While Vision-Language Models (VLMs) show significant promise for end-to-end autonomous driving by leveraging the common sense embedded in language models, their reliance on 2D image cues for complex scene understanding and decision-making…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Weijie Wei , Zhipeng Luo , Ling Feng , Venice Erin Liong

Robot vision has greatly benefited from advancements in multimodal fusion techniques and vision-language models (VLMs). We adopt a task-oriented perspective to systematically review the applications and advancements of multimodal fusion…

Accurate prediction of communication link quality metrics is essential for vehicle-to-infrastructure (V2I) systems, enabling smooth handovers, efficient beam management, and reliable low-latency communication. The increasing availability of…

Machine Learning · Computer Science 2025-09-05 Kimia Ehsani , Walid Saad

Large Vision-Language Models (LVLMs) have shown impressive capabilities across a range of tasks that integrate visual and textual understanding, such as image captioning and visual question answering. These models are trained on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Xiaomei Zhang , Hanyu Zheng , Xiangyu Zhu , Jinghuan Wei , Junhong Zou , Zhen Lei , Zhaoxiang Zhang