English
Related papers

Related papers: On the Spectral Flattening of Quantized Embeddings

200 papers

Contextual adaptation in token embeddings plays a central role in determining how well language models maintain coherence and retain semantic relationships over extended text sequences. Static embeddings often impose constraints on lexical…

Computation and Language · Computer Science 2025-03-27 Koinis Vassilis , Godfrey Milbourne , Harriet Featherstone , Xanthe Peverell , Yorick Bletchley , Zachary Montford

Projecting intermediate representations onto the vocabulary is an increasingly popular interpretation tool for transformer-based LLMs, also known as the logit lens. We propose a quantitative extension to this approach and define spectral…

Artificial Intelligence · Computer Science 2024-02-15 Nicola Cancedda

Large Language Models (LLMs) have demonstrated impressive performance across a wide range of applications; however, assessing their reasoning capabilities remains a significant challenge. In this paper, we introduce a framework grounded in…

Computation and Language · Computer Science 2024-09-06 Shima Imani , Hamid Palangi

Recent advancements in Large Language Models (LLMs) have demonstrated impressive capabilities as their scale expands to billions of parameters. Deploying these large-scale models on resource-constrained platforms presents significant…

Hardware Architecture · Computer Science 2025-05-15 Keran Zheng , Yinting Huang , Zhewen Yu , Christos-Savvas Bouganis

Deep vision models degrade sharply in low-data regimes, particularly in medical imaging where labeled samples are scarce. We show this arises not merely from overfitting but from a geometric failure: finite-sample noise corrupts the…

Large language models (LLMs) have demonstrated state-of-the-art performance across various tasks. However, the latency of inference and the large GPU memory consumption of LLMs restrict their deployment performance. Recently, there have…

Machine Learning · Computer Science 2024-02-29 Yi Zhang , Fei Yang , Shuang Peng , Fangyu Wang , Aimin Pan

Large Language Models have demonstrated the ability to generalize well at many levels across domains, modalities, and even shown in-context learning capabilities. This enables research questions regarding how they can be used to encode…

Computation and Language · Computer Science 2025-11-19 Kiera McCormick , Rafael Martínez-Galarza

Neural scaling laws approximate a language model's loss as a power-law function of parameter count $N$ and token count $D$. Following Chinchilla-style compute-optimal training, many studies fit scaling laws from runs performed under a fixed…

Machine Learning · Computer Science 2026-05-14 Joshua Shay Kricheli , Alexander Lawrence Reid , Soumajyoti Sarkar , Venkata Gandikota , Paulo Shakarian

Large language models (LLMs) represent a new paradigm for processing unstructured data, with applications across an unprecedented range of domains. In this paper, we address, through two arguments, whether the development and application of…

Methodology · Statistics 2026-02-03 Weijie Su

Ensuring large language model (LLM) reliability requires distinguishing objective unsolvability (inherent contradictions) from subjective capability limitations (tasks exceeding model competence). Current LLMs often conflate these…

Computation and Language · Computer Science 2026-02-03 Dengyun Peng , Qiguang Chen , Bofei Liu , Jiannan Guan , Libo Qin , Zheng Yan , Jinhao Liu , Jianshu Zhang , Wanxiang Che

Data-driven machine learning models are being increasingly employed in several important inference problems in biology, chemistry, and physics which require learning over combinatorial spaces. Recent empirical evidence (see, e.g., [1], [2],…

Machine Learning · Statistics 2022-10-07 Amirali Aghazadeh , Nived Rajaraman , Tony Tu , Kannan Ramchandran

We introduce harmonization, an ensembling method that combines several "noisy" decoders to generate highly accurate decoding predictions. Harmonized ensembles of MWPM-based decoders achieve lower logical error rates than their individual…

Quantum Physics · Physics 2024-03-18 Noah Shutty , Michael Newman , Benjamin Villalonga

Large language models (LLMs) are known to exhibit brittle behavior under adversarial prompts and jailbreak attacks, even after extensive alignment and fine-tuning. This fragility reflects a broader challenge of modern neural language…

Computation and Language · Computer Science 2026-02-04 Patrick Cooper , Alireza Nadali , Ashutosh Trivedi , Alvaro Velasquez

Large Language Models (LLMs) exhibit a significant "embodiment gap", where their text-based representations fail to align with human sensorimotor experiences. This study systematically investigates whether and how task-specific fine-tuning…

Computation and Language · Computer Science 2026-03-05 Minghua Wu , Javier Conde , Pedro Reviriego , Marc Brysbaert

The scaling law of Large Language Models (LLMs) reveals a power-law relationship, showing diminishing return on performance as model scale increases. While training LLMs from scratch is resource-intensive, fine-tuning a pre-trained model…

Computation and Language · Computer Science 2025-05-22 Yiyun Zhou , Chang Yao , Jingyuan Chen

Scaling laws for language model training traditionally characterize how performance scales with model size and dataset volume. Prior work has explored architecture variants and data treatments such as dataset filtering and noise injection…

Machine Learning · Computer Science 2026-02-24 Anirudh Subramanyam , Yuxin Chen , Robert L. Grossman

While Large Language Models (LLMs) exhibit remarkable capabilities in zero-shot and few-shot scenarios, they often require computationally prohibitive sizes. Conversely, smaller Masked Language Models (MLMs) like BERT and RoBERTa achieve…

Computation and Language · Computer Science 2024-10-18 Ahmed Elshabrawy , Yongxin Huang , Iryna Gurevych , Alham Fikri Aji

Ensuring that deep learning models are well-calibrated in terms of their predictive uncertainty is essential in maintaining their trustworthiness and reliability, yet despite increasing advances in foundation model research, the…

Computation and Language · Computer Science 2026-01-06 Jerry Huang , Peng Lu , Qiuhao Zeng , Yusuke Iwasawa , Yutaka Matsuo , Sarath Chandar , Edison Marrese-Taylor , Irene Li

We explore efficient strategies to fine-tune decoder-only Large Language Models (LLMs) for downstream text classification under resource constraints. Two approaches are investigated: (1) attaching a classification head to a pretrained…

Computation and Language · Computer Science 2026-05-26 Amirhossein Yousefiramandi , Ciaran Cooney

With the growing adoption of Large Language Models (LLMs) for open-ended tasks, accurately assessing epistemic uncertainty, which reflects a model's lack of knowledge, has become crucial to ensuring reliable outcomes. However, quantifying…

Computation and Language · Computer Science 2025-10-10 Xinyi Liu , Weiguang Wang , Hangfeng He