English
Related papers

Related papers: Estimating Tail Risks in Language Model Output Dis…

200 papers

The paper suggests a simple method of deriving minimax lower bounds to the accuracy of statistical inference on heavy tails. A well-known result by Hall and Welsh (Ann. Statist. 12 (1984) 1079-1084) states that if $\hat{\alpha}_n$ is an…

Statistics Theory · Mathematics 2014-03-14 S. Y. Novak

Considerable research efforts have been devoted to ensuring that large language models (LLMs) align with human values and generate safe text. However, an excessive focus on sensitivity to certain topics can compromise the model's robustness…

Computation and Language · Computer Science 2023-08-29 Huachuan Qiu , Shuai Zhang , Anqi Li , Hongliang He , Zhenzhong Lan

Tail risk measures are fully determined by the distribution of the underlying loss beyond its quantile at a certain level, with Value-at-Risk, Expected Shortfall and Range Value-at-Risk being prime examples. They are induced by law-based…

Statistical Finance · Quantitative Finance 2025-11-07 Tobias Fissler , Fangda Liu , Ruodu Wang , Linxiao Wei

Fine-tuning large language models (LLMs) on additional datasets is often necessary to optimize them for specific downstream tasks. However, existing safety alignment measures, which restrict harmful behavior during inference, are…

Computation and Language · Computer Science 2024-10-15 Minjun Zhu , Linyi Yang , Yifan Wei , Ningyu Zhang , Yue Zhang

Imitation learning algorithms learn viable policies by imitating an expert's behavior when reward signals are not available. Generative Adversarial Imitation Learning (GAIL) is a state-of-the-art algorithm for learning policies when the…

Reinforcement Learning (RL) for Large Language Models (LLMs) faces a fundamental tension: the numerical divergence between high-throughput inference engines and numerically precise training engines. Although these systems share the same…

Machine Learning · Computer Science 2026-02-09 Yingru Li , Jiawei Xu , Jiacai Liu , Yuxuan Tong , Ziniu Li , Tianle Cai , Ge Zhang , Qian Liu , Baoxiang Wang

As large language models (LLMs) transition from research prototypes to production systems, practitioners often need reliable methods to verify model outputs and characterize tail risk for safe deployment. While sampling-based estimates…

Artificial Intelligence · Computer Science 2026-05-11 Tarun Suresh , Nalin Wadhwa , Debangshu Banerjee , Gagandeep Singh

The increasing penetration of embedded renewables makes forecasting net-load, consumption less embedded generation, a significant and growing challenge. Here a framework for producing probabilistic forecasts of net-load is proposed with…

Applications · Statistics 2022-10-06 Jethro Browell , Matteo Fasiolo

For purposes of Value-at-Risk estimation, we consider several multivariate families of heavy-tailed distributions, which can be seen as multidimensional versions of Paretian stable and Student's t distributions allowing different marginals…

Risk Management · Quantitative Finance 2011-12-20 Carlo Marinelli , Stefano d'Addona , Svetlozar T. Rachev

As Large Language Models (LLMs) continue to advance in understanding and generating long sequences, new safety concerns have been introduced through the long context. However, the safety of LLMs in long-context tasks remains under-explored,…

Computation and Language · Computer Science 2025-02-25 Yida Lu , Jiale Cheng , Zhexin Zhang , Shiyao Cui , Cunxiang Wang , Xiaotao Gu , Yuxiao Dong , Jie Tang , Hongning Wang , Minlie Huang

Predicting user behavior is essential for intelligent assistant services, yet deep learning models often struggle to capture long-tailed behaviors. Large language models (LLMs), with their pretraining on vast corpora containing rich…

Computation and Language · Computer Science 2026-04-14 Fanjin Meng , Jingtao Ding , Jiahui Gong , Chen Yang , Hong Chen , Zuojian Wang , Haisheng Lu , Yong Li

To ensure that real-world infrastructure is safe and durable, systems are designed to not fail for any but the most rarely occurring parameter values. By only happening deep in the tails of the parameter distribution, failure probabilities…

Methodology · Statistics 2025-05-27 Promit Chakroborty , Michael D. Shields

Recent breakthroughs in Large Language Models (LLMs) have led to their adoption across a wide range of tasks, ranging from code generation to machine translation and sentiment analysis, etc. Red teaming/Safety alignment efforts show that…

Computation and Language · Computer Science 2024-09-25 Essa Jan , Nouar AlDahoul , Moiz Ali , Faizan Ahmad , Fareed Zaffar , Yasir Zaki

The contribution of this paper is to introduce change of measure based techniques for the rare-event analysis of heavy-tailed stochastic processes. Our changes-of-measure are parameterized by a family of distributions admitting a mixture…

Probability · Mathematics 2010-06-15 Jose Blanchet , Jingchen Liu

For a risk vector $V$, whose components are shared among agents by some random mechanism, we obtain asymptotic lower and upper bounds for the individual agents' exposure risk and the aggregated risk in the market. Risk is measured by…

Risk Management · Quantitative Finance 2016-04-12 Oliver Kley , Claudia Kluppelberg

Large language models (LLMs) have emerged as powerful tools for addressing a wide range of general inquiries and tasks. Despite this, fine-tuning aligned LLMs on smaller, domain-specific datasets, critical to adapting them to specialized…

Artificial Intelligence · Computer Science 2025-02-04 Guanlin Li , Kangjie Chen , Shangwei Guo , Jie Zhang , Han Qiu , Chao Zhang , Guoyin Wang , Tianwei Zhang , Jiwei Li

The safety alignment of current Large Language Models (LLMs) is vulnerable. Relatively simple attacks, or even benign fine-tuning, can jailbreak aligned models. We argue that many of these vulnerabilities are related to a shared underlying…

Cryptography and Security · Computer Science 2024-06-11 Xiangyu Qi , Ashwinee Panda , Kaifeng Lyu , Xiao Ma , Subhrajit Roy , Ahmad Beirami , Prateek Mittal , Peter Henderson

Climate extremes such as floods, storms, and heatwaves have caused severe economic and human losses across Europe in recent decades. To support the European Union's climate resilience efforts, we propose a statistical framework for…

Applications · Statistics 2025-05-26 Carlotta Pacifici , Simone A. Padoan , Jaroslav Mysiak

Recently, the concept of tail dependence has been discussed in financial applications related to market or credit risk. The multivariate extreme value theory is a proper tool to measure and model dependence, for example, of large loss…

Applications · Statistics 2011-09-27 Marta Ferreira

With the rapid advancement of artificial intelligence, Large Language Models (LLMs) have shown remarkable capabilities in Natural Language Processing (NLP), including content generation, human-computer interaction, machine translation, and…

Computation and Language · Computer Science 2025-10-31 Songyang Liu , Chaozhuo Li , Jiameng Qiu , Xi Zhang , Feiran Huang , Litian Zhang , Yiming Hei , Philip S. Yu