English
Related papers

Related papers: Lifting Manifolds to Mitigate Pseudo-Alignment in …

200 papers

Test-time Scaling (TTS) has been demonstrated to significantly enhance the reasoning capabilities of Large Language Models (LLMs) during the inference phase without altering model parameters. However, existing TTS methods are largely…

Computation and Language · Computer Science 2025-09-30 Guibin Zhang , Fanci Meng , Guancheng Wan , Zherui Li , Kun Wang , Zhenfei Yin , Lei Bai , Shuicheng Yan

Time series forecasting (TSF) is a fundamental and widely studied task, spanning methods from classical statistical approaches to modern deep learning and multimodal language modeling. Despite their effectiveness, these methods often follow…

Machine Learning · Computer Science 2025-12-23 Mingyue Cheng , Jiahao Wang , Daoyu Wang , Xiaoyu Tao , Qi Liu , Enhong Chen

The proliferation of time series foundation models has created a landscape where no single method achieves consistent superiority, framing the central challenge not as finding the best model, but as orchestrating an optimal ensemble with…

Artificial Intelligence · Computer Science 2025-12-19 Defu Cao , Michael Gee , Jinbo Liu , Hengxuan Wang , Wei Yang , Rui Wang , Yan Liu

Internal representations within deep neural architectures encode high-dimensional abstractions of linguistic structures, yet they often exhibit inefficiencies in feature distribution, limiting expressiveness and adaptability. Contextual…

Computation and Language · Computer Science 2025-03-27 Alistair Wren , Beatrice Loxley , Hamish Cadwallader , Simon Beckwith , Fabian Pargeter , James Blades

The proposed method in this paper is designed to address the problem of time series forecasting. Although some exquisitely designed models achieve excellent prediction performances, how to extract more useful information and make accurate…

Artificial Intelligence · Computer Science 2023-02-01 Yuanpeng He

The proliferation of edge devices has generated an unprecedented volume of time series data across different domains, motivating various well-customized methods. Recently, Large Language Models (LLMs) have emerged as a new paradigm for time…

Machine Learning · Computer Science 2025-05-06 Chenxi Liu , Shaowen Zhou , Qianxiong Xu , Hao Miao , Cheng Long , Ziyue Li , Rui Zhao

As scaled language models (LMs) approach human-level reasoning capabilities, self-improvement emerges as a solution to synthesizing high-quality data corpus. While previous research has identified model collapse as a risk in…

Computation and Language · Computer Science 2025-10-28 Xiangchi Yuan , Chunhui Zhang , Zheyuan Liu , Dachuan Shi , Leyan Pan , Soroush Vosoughi , Wenke Lee

Deep learning (DL) approaches are being increasingly used for time-series forecasting, with many efforts devoted to designing complex DL models. Recent studies have shown that the DL success is often attributed to effective data…

Human-Computer Interaction · Computer Science 2023-07-28 Jianing Hao , Qing Shi , Yilin Ye , Wei Zeng

Fine-tuning pretrained language models (LMs) without making any architectural changes has become a norm for learning various language downstream tasks. However, for non-language downstream tasks, a common practice is to employ task-specific…

Time-series anomaly detection (TSAD) increasingly demands explanations that articulate not only if an anomaly occurred, but also what pattern it exhibits and why it is anomalous. Leveraging the impressive explanatory capabilities of Large…

Machine Learning · Computer Science 2025-11-12 Tian Lan , Hao Duong Le , Jinbo Li , Wenjun He , Meng Wang , Chenghao Liu , Chen Zhang

Large Audio Language Models (LALMs) are increasingly applied to audio understanding and multimodal reasoning, yet their ability to locate when events occur remains underexplored. We present the first systematic study of temporal bias in…

Computation and Language · Computer Science 2025-10-15 Jiayu Yao , Shenghua Liu , Yiwei Wang , Rundong Cheng , Lingrui Mei , Baolong Bi , Zhen Xiong , Xueqi Cheng

Large language models (LLMs) have emerged as powerful tools for addressing a wide range of general inquiries and tasks. Despite this, fine-tuning aligned LLMs on smaller, domain-specific datasets, critical to adapting them to specialized…

Artificial Intelligence · Computer Science 2025-02-04 Guanlin Li , Kangjie Chen , Shangwei Guo , Jie Zhang , Han Qiu , Chao Zhang , Guoyin Wang , Tianwei Zhang , Jiwei Li

Mixup is a data-dependent regularization technique that consists in linearly interpolating input samples and associated outputs. It has been shown to improve accuracy when used to train on standard machine learning datasets. However,…

Machine Learning · Computer Science 2022-01-13 Raphael Baena , Lucas Drumetz , Vincent Gripon

Forecasting in the real world requires integrating structured time-series data with unstructured textual information, but existing methods are architecturally limited by fixed input/output horizons and are unable to model or quantify…

Machine Learning · Computer Science 2025-10-27 Sungjun Cho , Changho Shin , Suenggwan Jo , Xinya Yan , Shourjo Aditya Chaudhuri , Frederic Sala

Large language models (LLMs) form implicit beliefs (posteriors over latent variables) from prompts, but we lack a mechanistic account of how these beliefs are encoded in representation space, how they update with new evidence, and how…

Large language models (LLMs) have demonstrated their effectiveness in multivariate time series classification (MTSC). Effective adaptation of LLMs for MTSC necessitates informative data representations. Existing LLM-based methods directly…

Artificial Intelligence · Computer Science 2025-10-29 Jiahao Wang , Mingyue Cheng , Qingyang Mao , Yitong Zhou , Daoyu Wang , Qi Liu , Feiyang Xu , Xin Li

Contextual adaptation in token embeddings plays a central role in determining how well language models maintain coherence and retain semantic relationships over extended text sequences. Static embeddings often impose constraints on lexical…

Computation and Language · Computer Science 2025-03-27 Koinis Vassilis , Godfrey Milbourne , Harriet Featherstone , Xanthe Peverell , Yorick Bletchley , Zachary Montford

Despite advances in large language models (LLMs) on reasoning and instruction-following tasks, it is unclear whether they can reliably produce outputs aligned with a variety of user goals, a concept called steerability. Two gaps in current…

Computation and Language · Computer Science 2026-01-21 Trenton Chang , Tobias Schnabel , Adith Swaminathan , Jenna Wiens

We study nearly-linear time approximation algorithms for non-preemptive scheduling problems in two settings: the unrelated machine setting, and the identical machine with job precedence constraints setting, under the well-studied objectives…

Data Structures and Algorithms · Computer Science 2023-06-06 Shi Li

Pretraining corpora contain extensive discourse about AI systems, yet the causal influence of this discourse on downstream alignment remains poorly understood. If prevailing descriptions of AI behaviour are predominantly negative, LLMs may…

Computation and Language · Computer Science 2026-02-23 Cameron Tice , Puria Radmard , Samuel Ratnam , Andy Kim , David Africa , Kyle O'Brien