English
Related papers

Related papers: Structure-Aware Multimodal LLM Framework for Trust…

200 papers

Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiaoji Zheng , Lixiu Wu , Zhijie Yan , Yuanrong Tang , Hao Zhao , Chen Zhong , Bokui Chen , Jiangtao Gong

Scene understanding enables intelligent agents to interpret and comprehend their environment. While existing large vision-language models (LVLMs) for scene understanding have primarily focused on indoor household tasks, they face two…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Penglei Sun , Yaoxian Song , Xiangru Zhu , Xiang Liu , Qiang Wang , Yue Liu , Changqun Xia , Tiefeng Li , Yang Yang , Xiaowen Chu

Forecasting in the real world requires integrating structured time-series data with unstructured textual information, but existing methods are architecturally limited by fixed input/output horizons and are unable to model or quantify…

Machine Learning · Computer Science 2025-10-27 Sungjun Cho , Changho Shin , Suenggwan Jo , Xinya Yan , Shourjo Aditya Chaudhuri , Frederic Sala

Extremely large-scale massive multiple-input multiple-output (XL-MIMO) is a key enabler for sixth-generation (6G) networks, offering massive spatial degrees of freedom. Despite these advantages, the coexistence of near-field and far-field…

Machine Learning · Computer Science 2025-12-11 Renbin Li , Shuangshuang Li , Peihao Dong

Trajectory prediction serves as a critical functionality in autonomous driving, enabling the anticipation of future motion paths for traffic participants such as vehicles and pedestrians, which is essential for driving safety. Although…

Robotics · Computer Science 2025-09-16 Wei Dai , Shengen Wu , Wei Wu , Zhenhao Wang , Sisuo Lyu , Haicheng Liao , Limin Yu , Weiping Ding , Runwei Guan , Yutao Yue

Multimodal Large Language Models (MLLMs) rely on strong linguistic reasoning inherited from their base language models. However, multimodal instruction fine-tuning paradoxically degrades this text's reasoning capability, undermining…

Computation and Language · Computer Science 2026-01-13 Zijing Wang , Yongkang Liu , Mingyang Wang , Ercong Nie , Deyuan Chen , Zhengjie Zhao , Shi Feng , Daling Wang , Xiaocui Yang , Yifei Zhang , Hinrich Schütze

This work investigates the use of large language models (LLMs) for tasks in smart cities. The core idea is to leverage remote sensing imagery to characterize the built environment, including design suggestions, constructability assessment,…

Computation and Language · Computer Science 2026-05-12 Dongdong Wang , Deepak Balakrishnan , Ravi Srinivasan , Shenhao Wang

Multimodal large language models (MLLMs), such as GPT-4o, Gemini, LLaVA, and Flamingo, have made significant progress in integrating visual and textual modalities, excelling in tasks like visual question answering (VQA), image captioning,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Junxiao Xue , Quan Deng , Fei Yu , Yanhao Wang , Jun Wang , Yuehua Li

Extremely large-scale multiple-input multiple-output (XL-MIMO) is the development trend of future wireless communications. However, the extremely large-scale antenna array could bring inevitable nearfield and dual-wideband effects that…

Information Theory · Computer Science 2024-09-13 Jie Xu , Li You , George C. Alexandropoulos , Xinping Yi , Wenjin Wang , Xiqi Gao

Recent advances in large vision-language models (VLMs) have shown significant promise for 3D scene understanding. Existing VLM-based approaches typically align 3D scene features with the VLM's embedding space. However, this implicit…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Chen Li , Eric Peh , Basura Fernando

A prior-informed large language model (LLM) driven multi-task learning framework is proposed for the unified description of multiple nuclear observables. By fine-tuning the pre-trained DeepSeek-R1-1.5B model with Low-Rank Adaptation (LoRA),…

Nuclear Theory · Physics 2026-05-29 S. J. Guo , S. Y. Wang , E. H. Wang , Z. M. Niu , Y. M. Ding

Metal-organic frameworks (MOFs) are porous crystalline materials with broad applications such as carbon capture and drug delivery, yet accurately predicting their 3D structures remains a significant challenge. While Large Language Models…

Machine Learning · Computer Science 2026-01-15 Mianzhi Pan , JianFei Li , Peishuo Liu , Botian Wang , Yawen Ouyang , Yiming Rong , Hao Zhou , Jianbing Zhang

With the emergence of Large Language Models (LLMs) and Vision Foundation Models (VFMs), multimodal AI systems benefiting from large models have the potential to equally perceive the real world, make decisions, and control tools as humans.…

Accurate analysis of industrial time-series big data is critical for the Prognostics and Health Management (PHM) of industrial equipment. While recent advancements in Large Language Models (LLMs) have shown promise in time-series analysis,…

Machine Learning · Computer Science 2026-03-10 Haiteng Wang , Yikang Li , Yunfei Zhu , Jingheng Yan , Lei Ren , Laurence T. Yang

Predicting human behavior in shared environments is crucial for safe and efficient human-robot interaction. Traditional data-driven methods to that end are pre-trained on domain-specific datasets, activity types, and prediction horizons. In…

Robotics · Computer Science 2025-06-24 Yuchen Liu , Lino Lerch , Luigi Palmieri , Andrey Rudenko , Sebastian Koch , Timo Ropinski , Marco Aiello

The rapid advancement of multimodal large language models (LLMs) has opened new frontiers in artificial intelligence, enabling the integration of diverse large-scale data types such as text, images, and spatial information. In this paper,…

Artificial Intelligence · Computer Science 2025-03-21 Long Yuan , Fengran Mo , Kaiyu Huang , Wenjie Wang , Wangyuxuan Zhai , Xiaoyu Zhu , You Li , Jinan Xu , Jian-Yun Nie

Large foundation models, including large language models (LLMs), vision transformers (ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine learning lifecycle, from training to deployment. However, the…

Multi-spectral imagery is a valuable input signal for Remote Sensing applications, such as land-use and land-cover classification and environmental monitoring. However, generalist Large Multi-modal Models (LMMs) are typically trained on RGB…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Dahun Kim , Ganesh Satish Mallya , Anelia Angelova

Learning computational fluid dynamics (CFD) traditionally relies on computationally intensive simulations of the Navier-Stokes equations. Recently, large language models (LLMs) have shown remarkable pattern recognition and reasoning…

Machine Learning · Computer Science 2024-06-10 Max Zhu , Adrián Bazaga , Pietro Liò

Large Language Models (LLMs) have achieved remarkable success across a wide range of natural language tasks, and recent efforts have sought to extend their capabilities to multimodal domains and resource-constrained environments. However,…

Machine Learning · Computer Science 2025-05-26 Yun-Da Tsai