English
Related papers

Related papers: Bridging Temporal and Textual Modalities: A Multim…

200 papers

By leveraging large clusters of commodity hardware, the Cloud offers great opportunities to optimize the operative costs of software systems, but impacts significantly on the reliability of software applications. The lack of control of…

Software Engineering · Computer Science 2018-03-02 Leonardo Mariani , Cristina Monni , Mauro Pezzé , Oliviero Riganelli , Rui Xin

This paper investigates the problem of temporally interpolating dynamic 3D point clouds with large non-rigid deformation. We formulate the problem as estimation of point-wise trajectories (i.e., smooth curves) and further reason that…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Yiming Zeng , Yue Qian , Qijian Zhang , Junhui Hou , Yixuan Yuan , Ying He

This manuscript explores multimodal alignment, translation, fusion, and transference to enhance machine understanding of complex inputs. We organize the work into five chapters, each addressing unique challenges in multimodal machine…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Gorjan Radevski

The explosion of big social data has created a scalability trap for traditional qualitative research, as manual coding remains labor-intensive and conventional topic models often suffer from semantic thinning and a lack of domain awareness.…

Computers and Society · Computer Science 2026-04-15 Zhenke Duan , Xin Li

Multimodal large language models (MLLMs) promise enhanced reasoning by integrating diverse inputs such as text, vision, and audio. Yet cross-modal reasoning remains underexplored, with conflicting reports on whether added modalities help or…

Computation and Language · Computer Science 2026-05-01 Yucheng Wang , Yifan Hou , Aydin Javadov , Mubashara Akhtar , Mrinmaya Sachan

Scaling large multimodal models (LMMs) to 3D understanding poses unique challenges: point cloud data is sparse and irregular, existing models rely on fragmented architectures with modality-specific encoders, and training pipelines often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yongyuan Liang , Xiyao Wang , Yuanchen Ju , Jianwei Yang , Furong Huang

Temporal grounding aims to localize a video moment which is semantically aligned with a given natural language query. Existing methods typically apply a detection or regression pipeline on the fused representation with the research focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-12-16 Zhenzhi Wang , Limin Wang , Tao Wu , Tianhao Li , Gangshan Wu

Background: As of 2026, Large Language Models (LLMs) demonstrate expert-level medical knowledge. However, deploying them as autonomous "Clinical Agents" remains limited. Current Electronic Medical Records (EMRs) and standards like FHIR are…

Artificial Intelligence · Computer Science 2026-05-26 Takahito Nakajima

This report investigates enhancing semantic caching effectiveness by employing specialized, fine-tuned embedding models. Semantic caching relies on embedding similarity rather than exact key matching, presenting unique challenges in…

Detecting and analyzing complex patterns in multivariate time-series data is crucial for decision-making in urban and environmental system operations. However, challenges arise from the high dimensionality, intricate complexity, and…

Machine Learning · Computer Science 2024-12-25 Haowen Xu , Ali Boyaci , Jianming Lian , Aaron Wilson

Fault diagnosis is critical for the safe operation of industrial systems. Conventional diagnosis models typically produce abstract outputs such as anomaly scores or fault categories, failing to answer critical operational questions like…

Artificial Intelligence · Computer Science 2026-03-10 Baoxue Li , Chunhui Zhao

Semantic caching enhances the efficiency of large language model (LLM) systems by identifying semantically similar queries, storing responses once, and serving them for subsequent equivalent requests. However, existing semantic caching…

Machine Learning · Computer Science 2025-07-10 Shervin Ghaffari , Zohre Bahranifard , Mohammad Akbari

Grammatical error detection (GED) in non-native writing requires systems to identify a wide range of errors in text written by language learners. Error detection as a purely supervised task can be challenging, as GED datasets are limited in…

Computation and Language · Computer Science 2020-05-04 Samuel Bell , Helen Yannakoudakis , Marek Rei

Today's cloud-hosted applications and services are complex systems, and a performance or functional instability can have dozens or hundreds of potential root causes. Our hypothesis is that by combining the pattern matching capabilities of…

Artificial Intelligence · Computer Science 2025-05-29 Yifan Wang , Kenneth P. Birman

Topic modeling is a powerful technique to discover hidden topics and patterns within a collection of documents without prior knowledge. Traditional topic modeling and clustering-based techniques encounter challenges in capturing contextual…

Computation and Language · Computer Science 2024-10-04 Melkamu Abay Mersha , Mesay Gemeda yigezu , Jugal Kalita

Large Language Models (LLMs) are democratizing access to personalized tutoring; however, their effectiveness is hindered by challenges in processing multimodal content, which limits AI's potential to provide equitable, high-quality STEM…

Tokenization plays a critical role in language modeling, yet existing approaches such as Byte-Pair Encoding (BPE) or WordPiece operate purely on frequency statistics, ignoring the underlying semantic structure of text. This leads to…

Computation and Language · Computer Science 2025-08-22 Dong Liu , Yanxuan Yu

Modern cloud services are prone to failures due to their complex architecture, making diagnosis a critical process. Site Reliability Engineers (SREs) spend hours leveraging multiple sources of data, including the alerts, error logs, and…

Software Engineering · Computer Science 2023-09-15 Sarthak Chakraborty , Shubham Agarwal , Shaddy Garg , Abhimanyu Sethia , Udit Narayan Pandey , Videh Aggarwal , Shiv Saini

Deep learning (e.g., Transformer) has been widely and successfully used in multivariate time series forecasting (MTSF). Unlike existing methods that focus on training models from a single modal of time series input, large language models…

Machine Learning · Computer Science 2025-04-09 Peiyuan Liu , Hang Guo , Tao Dai , Naiqi Li , Jigang Bao , Xudong Ren , Yong Jiang , Shu-Tao Xia

AI models, including both time-series-specific and general-purpose Foundation Models (FMs), have demonstrated strong potential in time-series forecasting across sectors like finance. However, these models are highly sensitive to input…