English
Related papers

Related papers: S2SServiceBench: A Multimodal Benchmark for Last-M…

200 papers

Recent advances in large language models (LLMs) have fundamentally reshaped speech-to-speech (S2S) systems, enabling increasingly natural spoken interaction. However, existing benchmarks still rely heavily on text-based evaluation and…

Computation and Language · Computer Science 2026-05-11 Feng Jiang , Zhiyu Lin , Yiyang Liu , Liumeng Xue , Fan Bu , Yuhao Du , Xiangying Chen , Benyou Wang , Haizhou Li

With the increasing integration of visual and textual content in Social Networking Services (SNS), evaluating the multimodal capabilities of Large Language Models (LLMs) is crucial for enhancing user experience, content understanding, and…

Computation and Language · Computer Science 2025-12-16 Hongcheng Guo , Zheyong Xie , Shaosheng Cao , Boyang Wang , Weiting Liu , Anjie Le , Lei Li , Zhoujun Li

Vision--language models (VLMs) achieve strong performance on many multimodal benchmarks but remain brittle on spatial reasoning tasks that require aligning abstract overhead representations with egocentric views. We introduce m2sv, a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yosub Shin , Michael Buriek , Igor Molybog

It is largely agreed that subseasonal-to-seasonal (S2S) predictability arises from the atmospheric initial state during early lead times and from the land and ocean during intermediate and late lead times. We test this hypothesis for the…

Atmospheric and Oceanic Physics · Physics 2025-01-14 Jhayron S. Pérez-Carrasquilla , Maria J. Molina

The increasing demand for efficient last-mile delivery in smart logistics underscores the role of autonomous robots in enhancing operational efficiency and reducing costs. Traditional navigation methods, which depend on high-precision maps,…

Robotics · Computer Science 2025-02-14 Junhui Wang , Dongjie Huo , Zehui Xu , Yongliang Shi , Yimin Yan , Yuanxin Wang , Chao Gao , Yan Qiao , Guyue Zhou

User experience is a critical factor Large Language Model (LLM) serving systems must consider, where service level objectives (SLOs) considering the experience of individual requests and system level metrics (SLMs) considering the overall…

Machine Learning · Computer Science 2025-10-30 Zhibin Wang , Shipeng Li , Yuhang Zhou , Xue Li , Zhonghui Zhang , Nguyen Cam-Tu , Rong Gu , Chen Tian , Guihai Chen , Sheng Zhong

Multimodal Large Language Models (MLLMs) have significantly advanced the landscape of embodied AI, yet transitioning to synchronized bimanual coordination introduces formidable challenges in multi-stream multimodal integration. We introduce…

Robotics · Computer Science 2026-04-07 Xin Wu , Zhixuan Liang , Yue Ma , Mengkang Hu , Zhiyuan Qin , Xiu Li

Large language models (LLMs) demonstrate strong potential as agents for tool invocation due to their advanced comprehension and planning capabilities. Users increasingly rely on LLM-based agents to solve complex missions through iterative…

Artificial Intelligence · Computer Science 2025-04-17 Peijie Yu , Yifan Yang , Jinjian Li , Zelong Zhang , Haorui Wang , Xiao Feng , Feng Zhang

Empathetic interaction is a cornerstone of human-machine communication, due to the need for understanding speech enriched with paralinguistic cues and generating emotional and expressive responses. However, the most powerful empathetic…

Computation and Language · Computer Science 2025-10-28 Chen Wang , Tianyu Peng , Wen Yang , Yinan Bai , Guangfu Wang , Jun Lin , Lanpeng Jia , Lingxiang Wu , Jinqiao Wang , Chengqing Zong , Jiajun Zhang

Climate-Eval is a comprehensive benchmark designed to evaluate natural language processing models across a broad range of tasks related to climate change. Climate-Eval aggregates existing datasets along with a newly developed news…

Computation and Language · Computer Science 2025-05-27 Murathan Kurfalı , Shorouq Zahra , Joakim Nivre , Gabriele Messori

Forecasting from atmospheric soundings is a fundamental task in operational meteorology, often requiring structured visual reasoning over Skew-T log-P diagrams by human forecasters. While recent advances in Vision-Language Models (VLMs)…

Atmospheric and Oceanic Physics · Physics 2025-08-19 ChangJae Lee , Heecheol Yang , Jonghak Choi

Large Language Models (LLMs) based autonomous agents demonstrate multifaceted capabilities to contribute substantially to economic production. However, existing benchmarks remain focused on single agentic capability, failing to capture…

Artificial Intelligence · Computer Science 2026-04-24 Keyu Li , Junhao Shi , Yang Xiao , Mohan Jiang , Jie Sun , Yunze Wu , Dayuan Fu , Shijie Xia , Xiaojie Cai , Tianze Xu , Weiye Si , Wenjie Li , Dequan Wang , Pengfei Liu

Recent advances in multimodal large language models (MLLMs) have accelerated progress in domain-oriented AI, yet their development in geoscience and remote sensing (RS) remains constrained by distinctive challenges: wide-ranging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Aoran Xiao , Shihao Cheng , Yonghao Xu , Yexian Ren , Hongruixuan Chen , Naoto Yokoya

Geoenergy projects (CO2 storage, geothermal, subsurface H2 generation/storage, critical minerals from subsurface fluids, or nuclear waste disposal) increasingly follow a petroleum-style funnel from screening and appraisal to operations,…

Disordered Systems and Neural Networks · Physics 2026-03-17 Hannah P. Menke , Ahmed H. Elsheikh , Lingli Wei , Nanzhe Wang , Andreas Busch

Evaluating how Large Language Models (LLMs) handle complex, specialized knowledge remains a critical challenge. We address this through the lens of climate change by introducing CLINB, a benchmark that assesses models on open-ended,…

Human-level agentic intelligence extends beyond low-level geometric perception, evolving from recognizing where things are to understanding what they are for. While existing benchmarks effectively evaluate the geometric perception…

Weather prediction is one of the greatest scientific and technical successes of the last century. Today, National Meteorological Services routinely produce forecasts that have a major positive impact across society and many economic…

Physics and Society · Physics 2020-05-05 Alberto Arribas , Nial H. Robinson , Phil Evans

Integrated sensing, communication, and computation (ISCC) is emerging as a unified design paradigm for future vehicular networks that require joint environment perception, safety-critical information exchange, and latency-sensitive task…

Information Theory · Computer Science 2026-05-26 Indulekha K. P. , T. G. Venkatesh

Multimodal large language models (MLLMs), building upon the foundation of powerful large language models (LLMs), have recently demonstrated exceptional capabilities in generating not only texts but also images given interleaved multimodal…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Bohao Li , Yuying Ge , Yixiao Ge , Guangzhi Wang , Rui Wang , Ruimao Zhang , Ying Shan

A well-performing prediction model is vital for a recommendation system suggesting actions for energy-efficient consumer behavior. However, reliable and accurate predictions depend on informative features and a suitable model design to…

Machine Learning · Computer Science 2022-12-20 Alona Zharova , Antonia Scherz