English
Related papers

Related papers: TransGPT: Multi-modal Generative Pre-trained Trans…

200 papers

One approach for multilingual data-to-text generation is to translate grammatical configurations upfront from the source language into each target language. These configurations are then used by a surface realizer and in document planning…

Computation and Language · Computer Science 2025-01-28 Andreas Madsack , Johanna Heininger , Adela Schneider , Ching-Yi Chen , Christian Eckard , Robert Weißgraeber

While recently Multimodal Large Language Models (MM-LLMs) have made exciting strides, they mostly fall prey to the limitation of only input-side multimodal understanding, without the ability to produce content in multiple modalities. As we…

Artificial Intelligence · Computer Science 2024-06-26 Shengqiong Wu , Hao Fei , Leigang Qu , Wei Ji , Tat-Seng Chua

Generating realistic human motion from given action descriptions has experienced significant advancements because of the emerging requirement of digital humans. While recent works have achieved impressive results in generating motion…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yaqi Zhang , Di Huang , Bin Liu , Shixiang Tang , Yan Lu , Lu Chen , Lei Bai , Qi Chu , Nenghai Yu , Wanli Ouyang

The precise prediction of multi-scale traffic is a ubiquitous challenge in the urbanization process for car owners, road administrators, and governments. In the case of complex road networks, current and past traffic information from both…

Machine Learning · Computer Science 2024-05-13 Jinhui Ouyang , Yijie Zhu , Xiang Yuan , Di Wu

Traffic Signal Control (TSC) is a crucial component in urban traffic management, aiming to optimize road network efficiency and reduce congestion. Traditional TSC methods, primarily based on transportation engineering and reinforcement…

Artificial Intelligence · Computer Science 2024-12-18 Siqi Lai , Zhao Xu , Weijia Zhang , Hao Liu , Hui Xiong

The rapid rise of Large Language Models (LLMs) is transforming traffic and transportation research, with significant advancements emerging between the years 2023 and 2025 -- a period marked by the inception and swift growth of adopting and…

Computational Engineering, Finance, and Science · Computer Science 2025-03-28 Yimo Yan , Yejia Liao , Guanhao Xu , Ruili Yao , Huiying Fan , Jingran Sun , Xia Wang , Jonathan Sprinkle , Ziyan An , Meiyi Ma , Xi Cheng , Tong Liu , Zemian Ke , Bo Zou , Matthew Barth , Yong-Hong Kuo

We present an approach to neural machine translation (NMT) that supports multiple domains in a single model and allows switching between the domains when translating. The core idea is to treat text domains as distinct languages and use…

Computation and Language · Computer Science 2018-05-08 Sander Tars , Mark Fishel

With the rapid progress of large language models (LLMs), multimodal frameworks that unify understanding and generation have become promising, yet they face increasing complexity as the number of modalities and tasks grows. We observe that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Bingfan Zhu , Biao Jiang , Sunyi Wang , Shixiang Tang , Tao Chen , Linjie Luo , Youyi Zheng , Xin Chen

Traffic prediction, an essential component for intelligent transportation systems, endeavours to use historical data to foresee future traffic features at specific locations. Although existing traffic prediction models often emphasize…

Machine Learning · Computer Science 2024-07-09 Chenxi Liu , Sun Yang , Qianxiong Xu , Zhishuai Li , Cheng Long , Ziyue Li , Rui Zhao

The fields of generative AI and transfer learning have experienced remarkable advancements in recent years especially in the domain of Natural Language Processing (NLP). Transformers have been at the heart of these advancements where the…

Computation and Language · Computer Science 2024-02-28 Majd Saleh , Stéphane Paquelet

One of the most challenging topics in Natural Language Processing (NLP) is visually-grounded language understanding and reasoning. Outdoor vision-and-language navigation (VLN) is such a task where an agent follows natural language…

Computation and Language · Computer Science 2021-02-05 Wanrong Zhu , Xin Eric Wang , Tsu-Jui Fu , An Yan , Pradyumna Narayana , Kazoo Sone , Sugato Basu , William Yang Wang

Large Language Models (LLMs) offer significant promise for intelligent traffic management; however, current chain-based systems like TrafficGPT are hindered by sequential task execution, high token usage, and poor scalability, making them…

Artificial Intelligence · Computer Science 2025-07-21 Nabil Abdelaziz Ferhat Taleb , Abdolazim Rezaei , Raj Atulkumar Patel , Mehdi Sookhak

This groundbreaking study explores the expanse of Large Language Models (LLMs), such as Generative Pre-Trained Transformer (GPT) and Bidirectional Encoder Representations from Transformers (BERT) across varied domains ranging from…

Computation and Language · Computer Science 2024-02-27 Pravneet Kaur , Gautam Siddharth Kashyap , Ankit Kumar , Md Tabrez Nafis , Sandeep Kumar , Vikrant Shokeen

Pre-trained large language models (LLM) are starting to be widely used in many applications. In this work, we explore the use of these models in interactive machine translation (IMT) environments. In particular, we have chosen mBART…

Computation and Language · Computer Science 2024-07-10 Angel Navarro , Francisco Casacuberta

We present a simple yet effective approach that can transform the OpenAI GPT-3.5 model into a reliable motion planner for autonomous vehicles. Motion planning is a core challenge in autonomous driving, aiming to plan a driving trajectory…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Jiageng Mao , Yuxi Qian , Junjie Ye , Hang Zhao , Yue Wang

Large language models have significantly advanced Multilingual Machine Translation (MMT), yet scaling to many languages while keeping quality robust across directions remains challenging. In this paper, we identify a failure mode of…

Computation and Language · Computer Science 2026-04-27 Yingfeng Luo , Ziqiang Xu , Yuxuan Ouyang , Murun Yang , Dingyang Lin , Kaiyan Chang , Tong Zheng , Bei Li , Peinan Feng , Quan Du , Tong Xiao , Jingbo Zhu

Building a general model capable of analyzing human trajectories across different geographic regions and different tasks becomes an emergent yet important problem for various applications. However, existing works suffer from the…

Multimedia · Computer Science 2025-09-03 Shuo Liu , Di Yao , Yan Lin , Gao Cong , Jingping Bi

Recent integration of Natural Language Processing (NLP) and multimodal models has advanced the field of sports analytics. This survey presents a comprehensive review of the datasets and applications driving these innovations post-2020. We…

Computation and Language · Computer Science 2024-06-19 Haotian Xia , Zhengbang Yang , Yun Zhao , Yuqing Wang , Jingxi Li , Rhys Tracy , Zhuangdi Zhu , Yuan-fang Wang , Hanjie Chen , Weining Shen

The forecasting of entity trajectories at future points in time is a critical capability gap in applications across both Commercial and Defense sectors. Transformers, and specifically Generative Pre-trained Transformer (GPT) networks have…

Machine Learning · Computer Science 2024-02-02 Nicholas Stroh

Traffic forecasting is crucial for intelligent transportation systems. It has experienced significant advancements thanks to the power of deep learning in capturing latent patterns of traffic data. However, recent deep-learning…

Machine Learning · Computer Science 2026-01-19 Xusen Guo , Qiming Zhang , Junyue Jiang , Mingxing Peng , Meixin Zhu , Hao , Yang