English
Related papers

Related papers: Multi-Scale Manifold Alignment for Interpreting La…

200 papers

Time-series data is critical across many scientific and industrial domains, including environmental analysis, agriculture, transportation, and finance. However, mining insights from this data typically requires deep domain expertise, a…

Latent representation alignment has become a foundational technique for constructing multimodal large language models (MLLM) by mapping embeddings from different modalities into a shared space, often aligned with the embedding space of…

Machine Learning · Computer Science 2025-03-06 Dong Shu , Bingbing Duan , Kai Guo , Kaixiong Zhou , Jiliang Tang , Mengnan Du

We show that large language models (LLMs) are remarkably good at working with interpretable models that decompose complex outcomes into univariate graph-represented components. By adopting a hierarchical approach to reasoning, LLMs can…

Cross-lingual alignment, the meaningful similarity of representations across languages in multilingual language models, has been an active field of research in recent years. We survey the literature of techniques to improve cross-lingual…

Computation and Language · Computer Science 2024-06-12 Katharina Hämmerl , Jindřich Libovický , Alexander Fraser

This paper introduces a novel integration of Large Language Models (LLMs) with Conformal Geometric Algebra (CGA) to revolutionize controllable 3D scene editing, particularly for object repositioning tasks, which traditionally requires…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Prodromos Kolyvakis , Manos Kamarianakis , George Papagiannakis

Pointer analysis has been studied for over four decades. However, existing frameworks continue to suffer from the propagation of incorrect facts. A major limitation stems from their insufficient semantic understanding of code, resulting in…

Software Engineering · Computer Science 2025-09-01 Baijun Cheng , Kailong Wang , Ling Shi , Haoyu Wang , Yao Guo , Ding Li , Xiangqun Chen

This study investigates a downlink rate-splitting multiple access (RSMA) scenario in which multiple base stations (BSs), employing a coordinated multi-point (CoMP) transmission scheme, serve users equipped with movable antenna (MA)…

Signal Processing · Electrical Eng. & Systems 2025-02-25 Ali Amhaz , Shreya Khisa , Mohamed Elhattab , Chadi Assi , Sanaa Sharafeddine

Large language models (LLMs) have shown remarkable proficiency in human-level reasoning and generation capabilities, which encourages extensive research on their application in mathematical problem solving. However, current work has been…

Computation and Language · Computer Science 2025-08-21 Jiahui Gao , Renjie Pi , Jipeng Zhang , Jiacheng Ye , Wanjun Zhong , Yufei Wang , Lanqing Hong , Jianhua Han , Hang Xu , Zhenguo Li , Lingpeng Kong

Understanding how large language models (LLMs) acquire, retain, and apply knowledge remains an open challenge. This paper introduces a novel framework, K-(CSA)^2, which categorizes LLM knowledge along two dimensions: correctness and…

Computation and Language · Computer Science 2025-01-03 Yanbo Fang , Ruixiang Tang

Image matting is a long-standing problem in computer graphics and vision, mostly identified as the accurate estimation of the foreground in input images. We argue that the foreground objects can be represented by different-level…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Yu Qiao , Yuhao Liu , Qiang Zhu , Xin Yang , Yuxin Wang , Qiang Zhang , Xiaopeng Wei

We investigate the geometry of predictive information across the layers of large language models (LLMs). We repurpose representation lenses-learned affine maps trained to predict the next token from intermediate residual streams-as…

Machine Learning · Computer Science 2026-05-12 Gianfranco Lombardo , Giuseppe Trimigno , Stefano Cagnoni

We assess how multilingual language models maintain a shared multilingual representation space while still encoding language-sensitive information in each language. Using XLM-R as a case study, we show that languages occupy similar linear…

Computation and Language · Computer Science 2022-10-25 Tyler A. Chang , Zhuowen Tu , Benjamin K. Bergen

Domain adaptation is an essential task in transfer learning to leverage data in one domain to bolster learning in another domain. In this paper, we present a new semi-supervised manifold alignment technique based on a two-step approach of…

Machine Learning · Computer Science 2020-11-12 Stefan Dernbach , Don Towsley

Multimodal Large Language Models (MLLMs) have achieved remarkable progress but continue to struggle with geometric reasoning, primarily due to the perception bottleneck regarding fine-grained visual elements. While formal languages have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Peijie Wang , Ming-Liang Zhang , Jun Cao , Chao Deng , Dekang Ran , Hongda Sun , Pi Bu , Xuan Zhang , Yingyao Wang , Jun Song , Bo Zheng , Fei Yin , Cheng-Lin Liu

Representational similarity analysis (RSA) has been shown to be an effective framework to characterize brain-activity profiles and deep neural network activations as representational geometry by computing the pairwise distances of the…

Neurons and Cognition · Quantitative Biology 2019-07-30 Baihan Lin , Marieke Mur , Tim Kietzmann , Nikolaus Kriegeskorte

There has been growing interest in Multimodal Aspect-Based Sentiment Analysis (MABSA) in recent years. Existing methods predominantly rely on pre-trained small language models (SLMs) to collect information related to aspects and sentiments…

Computation and Language · Computer Science 2025-05-27 Jun Cao , Jiyi Li , Ziwei Yang , Renjie Zhou

Large Language Models (LLMs) have demonstrated remarkable progress in instruction following and general-purpose reasoning. However, achieving high-quality alignment with human intent and safety norms without human annotations remains a…

Artificial Intelligence · Computer Science 2025-07-24 Haoran Sun , Zekun Zhang , Shaoning Zeng

Why do language models from different architecture families respond so differently to the same perturbation? We argue that the answer is not scale, but \emph{how architecture shapes information compression}. Analyzing eight Transformer…

Computation and Language · Computer Science 2026-05-07 Yukin Zhang , Qi Dong , Kemu Xu

Multimodal large language models (MLLMs) have shown satisfactory effects in many autonomous driving tasks. In this paper, MLLMs are utilized to solve joint semantic scene understanding and risk localization tasks, while only relying on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Jiaqi Fan , Jianhua Wu , Jincheng Gao , Jianhao Yu , Yafei Wang , Hongqing Chu , Bingzhao Gao

Multilingual automatic speech recognition (ASR) systems have garnered attention for their potential to extend language coverage globally. While self-supervised learning (SSL) models, like MMS, have demonstrated their effectiveness in…

Computation and Language · Computer Science 2024-04-30 Hongfei Xue , Qijie Shao , Kaixun Huang , Peikun Chen , Jie Liu , Lei Xie