English
Related papers

Related papers: Optimizing Temperature for Language Models with Mu…

200 papers

Large Language Models (LLMs) generate text by sampling the next token from a probability distribution over the vocabulary at each decoding step. Popular sampling methods like top-p (nucleus sampling) often struggle to balance quality and…

Computation and Language · Computer Science 2025-11-21 Minh Nhat Nguyen , Andrew Baker , Clement Neo , Allen Roush , Andreas Kirsch , Ravid Shwartz-Ziv

With the rapid development of natural language processing technology, large-scale language models (LLM) have achieved remarkable results in a variety of tasks. However, how to effectively train these huge models and improve their…

Artificial Intelligence · Computer Science 2024-12-09 Jiajing Chen , Bingying Liu , Xiaoxuan Liao , Jia Gao , Hongye Zheng , Yue Li

Currently, the issue that concerns the world leaders most is climate change for its effect on agriculture, environment and economies of daily life. So, to combat this, temperature prediction with strong accuracy is vital. So far, the most…

Machine Learning · Computer Science 2023-09-26 Wasiou Jaharabi , MD Ibrahim Al Hossain , Rownak Tahmid , Md. Zuhayer Islam , T. M. Saad Rayhan

By virtue of its great utility in solving real-world problems, optimization modeling has been widely employed for optimal decision-making across various sectors, but it requires substantial expertise from operations research professionals.…

The performance of finetuned large language models (LLMs) hinges critically on the composition of the training mixture. However, selecting an optimal blend of task datasets remains a largely manual, heuristic driven process, with…

Monitoring the magnet temperature in permanent magnet synchronous motors (PMSMs) for automotive applications is a challenging task for several decades now, as signal injection or sensor-based methods still prove unfeasible in a commercial…

Machine Learning · Computer Science 2021-01-27 Wilhelm Kirchgässner , Oliver Wallscheid , Joachim Böcker

As large language models (LLMs) scale in size and adoption, their computational and environmental costs continue to rise. Prior benchmarking efforts have primarily focused on latency reduction in idealized settings, often overlooking the…

Computation and Language · Computer Science 2025-04-25 Jared Fernandez , Clara Na , Vashisth Tiwari , Yonatan Bisk , Sasha Luccioni , Emma Strubell

Reinforcement Learning from Verifiable Rewards (RLVR) trains large language models (LLMs) from sampled trajectories, making decoding strategy a core component of learning rather than a purely inference-time choice. Sampling temperature…

Machine Learning · Computer Science 2026-02-16 Yixiao Zhou , Yang Li , Dongzhou Cheng , Hehe Fan , Yu Cheng

Large language models (LLMs) have significant potential to improve operational efficiency in operations management. Deploying these models requires specifying a policy that governs response quality, shapes user experience, and influences…

Machine Learning · Computer Science 2026-04-13 Mingjie Hu , Siyang Gao , Jian-qiang Hu , Enlu Zhou

In-context learning can help Large Language Models (LLMs) to adapt new tasks without additional training. However, this performance heavily depends on the quality of the demonstrations, driving research into effective demonstration…

Computation and Language · Computer Science 2024-10-31 Dong Shu , Mengnan Du

Thermal management in the hyper-scale cloud data centers is a critical problem. Increased host temperature creates hotspots which significantly increases cooling cost and affects reliability. Accurate prediction of host temperature is…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-17 Shashikant Ilager , Kotagiri Ramamohanarao , Rajkumar Buyya

Temperature is a major source of inaccuracy in high-sensitivity accelerometers and gravimeters. Active thermal control systems require power and may not be ideal in some contexts such as airborne or spaceborne applications. We propose a…

Modern large language model (LLM) inference engines optimize throughput and latency under fixed decoding rules, treating generation as a linear progression in token time. We propose a fundamentally different paradigm: entropic\-time…

Computation and Language · Computer Science 2026-03-05 Andrew Kiruluta

The effectiveness of large language models (LLMs) is not only measured by their ability to generate accurate outputs but also by their calibration-how well their confidence scores reflect the probability of their outputs being correct.…

Machine Learning · Computer Science 2024-10-01 Johnathan Xie , Annie S. Chen , Yoonho Lee , Eric Mitchell , Chelsea Finn

Thermal errors in machine tools significantly impact machining precision and productivity. Traditional thermal error correction/compensation methods rely on measured temperature-deformation fields or on transfer functions. Most existing…

Machine Learning · Computer Science 2025-10-07 C. Coelho , M. Hohmann , D. Fernández , L. Penter , S. Ihlenfeldt , O. Niggemann

Increasingly large datasets of robot actions and sensory observations are being collected to train ever-larger neural networks. These datasets are collected based on tasks and while these tasks may be distinct in their descriptions, many…

Robotics · Computer Science 2025-10-23 Basavasagar Patil , Sydney Belt , Jayjun Lee , Nima Fazeli , Bernadette Bucher

While Large Language Models (LLMs) have exhibited remarkable emergent capabilities through extensive pre-training, they still face critical limitations in generalizing to specialized domains and handling diverse linguistic variations, known…

Computation and Language · Computer Science 2025-05-28 Jinwu Hu , Zhitian Zhang , Guohao Chen , Xutao Wen , Chao Shuai , Wei Luo , Bin Xiao , Yuanqing Li , Mingkui Tan

This paper addresses the challenges of thermal sensor allocation and full-chip temperature reconstruction in multi-core systems by leveraging an entropy-based sensor placement strategy and an adaptive compressive sensing approach. By…

Systems and Control · Electrical Eng. & Systems 2026-01-13 Kun-Chih , Chen , Chia-Hsin Chen , Lei-Qi Wang , Chun-Chieh Wang

Best-of-N selection is a key technique for improving the reasoning performance of Large Language Models (LLMs) through increased test-time computation. Current state-of-the-art methods often employ computationally intensive reward models…

Computation and Language · Computer Science 2025-12-15 Zhewei Kang , Xuandong Zhao , Dawn Song

The rapid advancement of large language model (LLM) technology has led to diverse applications, many of which inherently require randomness, such as stochastic decision-making, gaming, scheduling, AI agents, and cryptography-related tasks.…

Artificial Intelligence · Computer Science 2025-10-15 Rabimba Karanjai , Yang Lu , Ranjith Chodavarapu , Lei Xu , Weidong Shi