English
Related papers

Related papers: Image Segmentation with Large Language Models: A S…

200 papers

The rapid growth of Large Language Models (LLMs) has been a driving force in transforming various domains, reshaping the artificial general intelligence landscape. However, the increasing computational and memory demands of these models…

Computation and Language · Computer Science 2024-04-22 Tianyu Ding , Tianyi Chen , Haidong Zhu , Jiachen Jiang , Yiqi Zhong , Jinxin Zhou , Guangzhi Wang , Zhihui Zhu , Ilya Zharkov , Luming Liang

Large language models (LLMs) have recently demonstrated strong reasoning capabilities and attracted increasing research attention in the field of autonomous driving (AD). However, safe application of LLMs on AD perception and prediction…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Yanjiao Liu , Jiawei Liu , Xun Gong , Zifei Nie

Multi-modal Large Language Models (MLLMs) have demonstrated remarkable capabilities in understanding and generating content across various modalities, such as images and text. However, their interpretability remains a challenge, hindering…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Loris Giulivi , Giacomo Boracchi

In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing…

Machine Learning · Computer Science 2025-01-10 Xuran Zheng , Chang D. Yoo

In recent years, we have witnessed significant progress in emerging deep learning models, particularly Large Language Models (LLMs) and Vision-Language Models (VLMs). These models have demonstrated promising results, indicating a new era of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Paola Natalia Cañas , Marcos Nieto , Oihana Otaegui , Igor Rodríguez

Dynamic scenes contain intricate spatio-temporal information, crucial for mobile robots, UAVs, and autonomous driving systems to make informed decisions. Parsing these scenes into semantic triplets <Subject-Predicate-Object> for accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Hang Zhang , Zhuoling Li , Jun Liu

Large Language Models (LLM) have emerged as a tool for robots to generate task plans using common sense reasoning. For the LLM to generate actionable plans, scene context must be provided, often through a map. Recent works have shifted from…

Robotics · Computer Science 2024-09-25 Mike Zhang , Kaixian Qu , Vaishakh Patil , Cesar Cadena , Marco Hutter

Large Language Models (LLMs) have recently emerged as a focal point of research and application, driven by their unprecedented ability to understand and generate text with human-like quality. Even more recently, LLMs have been extended into…

Computation and Language · Computer Science 2024-04-03 Kilian Carolan , Laura Fennelly , Alan F. Smeaton

Large Language Models (LLMs) like GPT and LLaMA are revolutionizing the AI industry with their sophisticated capabilities. Training these models requires vast GPU clusters and significant computing time, posing major challenges in terms of…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-30 Jiangfei Duan , Shuo Zhang , Zerui Wang , Lijuan Jiang , Wenwen Qu , Qinghao Hu , Guoteng Wang , Qizhen Weng , Hang Yan , Xingcheng Zhang , Xipeng Qiu , Dahua Lin , Yonggang Wen , Xin Jin , Tianwei Zhang , Peng Sun

The task of few-shot image classification and segmentation (FS-CS) requires the classification and segmentation of target objects in a query image, given only a few examples of the target classes. We introduce a method that utilises large…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Tian Meng , Yang Tao , Wuliang Yin

Speech understanding is essential for interpreting the diverse forms of information embedded in spoken language, including linguistic, paralinguistic, and non-linguistic cues that are vital for effective human-computer interaction. The…

Audio and Speech Processing · Electrical Eng. & Systems 2025-12-08 Jing Peng , Yucheng Wang , Bohan Li , Yiwei Guo , Hankun Wang , Yangui Fang , Yu Xi , Haoyu Li , Xu Li , Ke Zhang , Shuai Wang , Kai Yu

Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, lacking a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Xiaoji Zheng , Lixiu Wu , Zhijie Yan , Yuanrong Tang , Hao Zhao , Chen Zhong , Bokui Chen , Jiangtao Gong

This paper proposes LLaFS, the first attempt to leverage large language models (LLMs) in few-shot segmentation. In contrast to the conventional few-shot segmentation methods that only rely on the limited and biased information from the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Lanyun Zhu , Tianrun Chen , Deyi Ji , Jieping Ye , Jun Liu

Traffic cameras are essential in urban areas, playing a crucial role in intelligent transportation systems. Multiple cameras at intersections enhance law enforcement capabilities, traffic management, and pedestrian safety. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Md Adnan Arefeen , Biplob Debnath , Srimat Chakradhar

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

Machine Learning · Computer Science 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique

Traffic forecasting is crucial for intelligent transportation systems. It has experienced significant advancements thanks to the power of deep learning in capturing latent patterns of traffic data. However, recent deep-learning…

Machine Learning · Computer Science 2026-01-19 Xusen Guo , Qiming Zhang , Junyue Jiang , Mingxing Peng , Meixin Zhu , Hao , Yang

Natural language processing (NLP) is a key component of intelligent transportation systems (ITS), but it faces many challenges in the transportation domain, such as domain-specific knowledge and data, and multi-modal inputs and outputs.…

Computation and Language · Computer Science 2024-02-13 Peng Wang , Xiang Wei , Fangxu Hu , Wenjuan Han

The machine learning community has been overwhelmed by a plethora of deep learning based approaches. Many challenging computer vision tasks such as detection, localization, recognition and segmentation of objects in unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Swarnendu Ghosh , Nibaran Das , Ishita Das , Ujjwal Maulik

Urban computing has emerged as a multidisciplinary field that harnesses data-driven technologies to address challenges and improve urban living. Traditional approaches, while beneficial, often face challenges with generalization,…

Computers and Society · Computer Science 2025-11-11 Zhonghang Li , Lianghao Xia , Xubin Ren , Jiabin Tang , Tianyi Chen , Yong Xu , Chao Huang

This paper introduces an innovative approach to road network generation through the utilization of a multi-modal Large Language Model (LLM). Our model is specifically designed to process aerial images of road layouts and produce detailed,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Sumedh Rasal , Sanjay Kumar Boddhu