中文
相关论文

相关论文: Efficient Temporal Tokenization for Mobility Predi…

200 篇论文

Tokenization is an understudied and often neglected component of modern LLMs. Most published works use a single tokenizer for all experiments, often borrowed from another model, without performing ablations or analysis to optimize…

计算与语言 · 计算机科学 2024-02-08 Gautier Dagan , Gabriel Synnaeve , Baptiste Rozière

Reasoning is critical for large language models (LLMs) to excel in a wide range of tasks. While methods like Chain-of-Thought (CoT) reasoning and enhance LLM performance by decomposing problems into intermediate steps, they also incur…

计算与语言 · 计算机科学 2025-06-03 Tingxu Han , Zhenting Wang , Chunrong Fang , Shiyu Zhao , Shiqing Ma , Zhenyu Chen

Large language model (LLM) tokenizers act as structured compressors: by mapping text to discrete token sequences, they determine token count (and thus compute and context usage) and the statistical structure seen by downstream models.…

信息论 · 计算机科学 2026-01-15 Mete Erdogan , Abhiram Gorle , Shubham Chandak , Mert Pilanci , Tsachy Weissman

Long-range tasks demand reasoning over long inputs. However, existing solutions are limited, e.g., long-context models require large compute budgets, parameter-efficient fine-tuning (PEFT) needs training data, and retrieval-augmented…

人工智能 · 计算机科学 2025-08-26 Dulhan Jayalath , James Bradley Wendt , Nicholas Monath , Sandeep Tata , Beliz Gunel

Large language models (LLMs) have recently attracted considerable interest for their ability to perform complex reasoning tasks, such as chain-of-thought (CoT) reasoning. However, most of the existing approaches to enhance this ability rely…

计算与语言 · 计算机科学 2024-08-08 Xinyi Wang , Lucas Caccia , Oleksiy Ostapenko , Xingdi Yuan , William Yang Wang , Alessandro Sordoni

In this paper, we address the unexplored question of temporal sentence localization in human motions (TSLM), aiming to locate a target moment from a 3D human motion that semantically corresponds to a text query. Considering that 3D human…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Sheng Yan , Mengyuan Liu , Yong Wang , Yang Liu , Chen Chen , Hong Liu

Multimodal large language models (MLLMs) have made remarkable strides, largely driven by their ability to process increasingly long and complex contexts, such as high-resolution images, extended video sequences, and lengthy audio input.…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Kele Shao , Keda Tao , Kejia Zhang , Sicheng Feng , Mu Cai , Yuzhang Shang , Haoxuan You , Can Qin , Yang Sui , Huan Wang

Temporally localizing user-queried events through natural language is a crucial capability for video models. Recent methods predominantly adapt video LLMs to generate event boundary timestamps for temporal localization tasks, which struggle…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Zongshang Pang , Mayu Otani , Yuta Nakashima

Large audio language models are increasingly used for complex audio understanding tasks, but they struggle with temporal tasks that require precise temporal grounding, such as word alignment and speaker diarization. The standard approach,…

机器学习 · 计算机科学 2026-02-12 Joesph An , Phillip Keung , Jiaqi Wang , Orevaoghene Ahia , Noah A. Smith

We study an emerging and intriguing problem of multimodal temporal event forecasting with large language models. Compared to using text or graph modalities, the investigation of utilizing images for temporal event forecasting has not been…

多媒体 · 计算机科学 2024-08-09 Haoxuan Li , Zhengmao Yang , Yunshan Ma , Yi Bin , Yang Yang , Tat-Seng Chua

Online ride-hailing platforms aim to deliver efficient mobility-on-demand services, often facing challenges in balancing dynamic and spatially heterogeneous supply and demand. Existing methods typically fall into two categories:…

人工智能 · 计算机科学 2025-10-28 Yi Zhang , Yushen Long , Yun Ni , Liping Huang , Xiaohong Wang , Jun Liu

Test-Time Scaling (TTS) has emerged as an effective paradigm for improving the reasoning performance of large language models (LLMs). However, existing methods -- most notably majority voting and heuristic token-level scoring -- treat…

计算与语言 · 计算机科学 2026-02-03 Kai Zhang , Jiayi Liao , Chengpeng Li , Ziyuan Xie , Sihang Li , Xiang Wang

Large Language Models (LLMs) have excelled in various tasks but perform better in high-resource scenarios, which presents challenges in low-resource scenarios. Data scarcity and the inherent difficulty of adapting LLMs to specific tasks…

计算与语言 · 计算机科学 2024-04-02 Yuanhao Zeng , Min Wang , Yihang Wang , Yingxia Shao

Reasoning about time is essential for Large Language Models (LLMs) to understand the world. Previous works focus on solving specific tasks, primarily on time-sensitive question answering. While these methods have proven effective, they…

计算与语言 · 计算机科学 2024-08-20 Zhaochen Su , Jun Zhang , Tong Zhu , Xiaoye Qu , Juntao Li , Min Zhang , Yu Cheng

Large Language Models (LLMs) have exhibited exceptional performance across a spectrum of natural language processing tasks. However, their substantial sizes pose considerable challenges, particularly in computational demands and inference…

计算与语言 · 计算机科学 2025-06-03 Guoxuan Chen , Han Shi , Jiawei Li , Yihang Gao , Xiaozhe Ren , Yimeng Chen , Xin Jiang , Zhenguo Li , Weiyang Liu , Chao Huang

Traffic flow forecasting aims to predict future traffic flows based on the historical traffic conditions and the road network. It is an important problem in intelligent transportation systems, with a plethora of methods been proposed.…

机器学习 · 计算机科学 2025-08-04 Yusheng Zhao , Xiao Luo , Haomin Wen , Zhiping Xiao , Wei Ju , Ming Zhang

This paper proposes MotionVerse, a unified framework that harnesses the capabilities of Large Language Models (LLMs) to comprehend, generate, and edit human motion in both single-person and multi-person scenarios. To efficiently represent…

计算机视觉与模式识别 · 计算机科学 2025-09-30 Ruibing Hou , Mingshuang Luo , Hongyu Pan , Hong Chang , Shiguang Shan

Time series analysis provides essential insights for real-world system dynamics and informs downstream decision-making, yet most existing methods often overlook the rich contextual signals present in auxiliary modalities. To bridge this…

机器学习 · 计算机科学 2026-03-24 Yushan Jiang , Wenchao Yu , Geon Lee , Dongjin Song , Kijung Shin , Wei Cheng , Yanchi Liu , Haifeng Chen

Autonomous navigation in unfamiliar environments often relies on geometric mapping and planning strategies that overlook rich semantic cues such as signs, room numbers, and textual labels. We propose a novel semantic navigation framework…

机器人学 · 计算机科学 2026-01-13 Jing Cao , Nishanth Kumar , Aidan Curtis

Human Activity Recognition (HAR) is a core task in pervasive computing systems, where models must operate under strict computational constraints while remaining robust to heterogeneous and evolving deployment conditions. Recent advances…

机器学习 · 计算机科学 2026-05-13 Aleksandr Bredikhin , Philippe Lalanda , German Vega