English
Related papers

Related papers: SEALing the Gap: A Reference Framework for LLM Inf…

200 papers

Large Language Models (LLMs) demonstrate remarkable capabilities in leveraging comprehensive world knowledge and sophisticated reasoning mechanisms for recommendation tasks. However, a notable limitation lies in their inability to…

Information Retrieval · Computer Science 2025-04-15 Zihan Wang , Jinghao Lin , Xiaocui Yang , Yongkang Liu , Shi Feng , Daling Wang , Yifei Zhang

Large language models (LLMs) have revolutionized the field of AI, demonstrating unprecedented capacity across various tasks. However, the inference process for LLMs comes with significant computational costs. In this paper, we propose an…

Computation and Language · Computer Science 2023-05-30 Zangwei Zheng , Xiaozhe Ren , Fuzhao Xue , Yang Luo , Xin Jiang , Yang You

In-context learning (ICL) allows large models to adapt to tasks using a few examples, yet its extension to vision-language models (VLMs) remains fragile. Our analysis reveals that the fundamental limitation lies in an inductive gap, models…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Haoyu Wang , Haonan Wang , Yuyan Chen , Jun Chen , Gang Liu , Qian Wang , Jiahong Yan , Yanghua Xiao

Large language models have become central to many AI applications, but their growing energy consumption raises serious sustainability concerns. A key limitation in current AI deployments is the reliance on a one-size-fits-all inference…

In long structured document retrieval, existing methods typically fine-tune pre-trained language models (PLMs) using contrastive learning on datasets lacking explicit structural information. This practice suffers from two critical issues:…

Information Retrieval · Computer Science 2025-09-03 Xinhao Huang , Zhibo Ren , Yipeng Yu , Ying Zhou , Zulong Chen , Zeyi Wen

Large Language Models (LLMs) are rapidly becoming ubiquitous both as stand-alone tools and as components of current and future software systems. To enable usage of LLMs in the high-stake or safety-critical systems of 2030, they need to…

Software Engineering · Computer Science 2024-06-13 Sinclair Hudson , Sophia Jit , Boyue Caroline Hu , Marsha Chechik

Recent advances in large language models (LLMs) have accelerated progress toward artificial general intelligence, with inference-time scaling emerging as a key technique. Contemporary approaches leverage either sequential reasoning…

Computation and Language · Computer Science 2025-07-10 Zenan Xu , Zexuan Qiu , Guanhua Huang , Kun Li , Siheng Li , Chenchen Zhang , Kejiao Li , Qi Yi , Yuhao Jiang , Bo Zhou , Fengzong Lian , Zhanhui Kang

Evaluating how Large Language Models (LLMs) handle complex, specialized knowledge remains a critical challenge. We address this through the lens of climate change by introducing CLINB, a benchmark that assesses models on open-ended,…

The rapid adoption of large language models (LLMs) has led to significant energy consumption and carbon emissions, posing a critical challenge to the sustainability of generative AI technologies. This paper explores the integration of…

Machine Learning · Computer Science 2026-04-14 Tahniat Khan , Soroor Motie , Sedef Akinli Kocak , Shaina Raza

Fact-seeking question answering with large language models (LLMs) remains unreliable when answers depend on up-to-date or conflicting information. Although retrieval-augmented and tool-using LLMs reduce hallucinations, they often rely on…

Computation and Language · Computer Science 2026-03-17 Auksarapak Kietkajornrit , Jad Tarifi , Nima Asgharbeygi

Large language models (LLMs) are prone to generating factually incorrect outputs. Recent work has applied conformal prediction to provide uncertainty estimates and statistical guarantees for the factuality of LLM generations. However,…

Computation and Language · Computer Science 2026-04-16 Aleksandr Rubashevskii , Dzianis Piatrashyn , Preslav Nakov , Maxim Panov

In-context learning with large language models (LLMs) excels at adapting to various tasks rapidly. However, its success hinges on carefully selecting demonstrations, which remains an obstacle in practice. Current approaches to this problem…

Computation and Language · Computer Science 2024-01-15 Shangqing Xu , Chao Zhang

Word sense plausibility rating requires predicting the human-perceived plausibility of a given word sense on a 1-5 scale in the context of short narrative stories containing ambiguous homonyms. This paper systematically compares three…

Computation and Language · Computer Science 2026-05-11 Tong Wu , Thanet Markchom , Huizhi Liang

Large Language Models (LLMs) are widely used in software engineering to generate, complete, translate, and fix code, improving developer productivity. While most research focuses on the energy consumption and carbon emissions of model…

Software Engineering · Computer Science 2026-04-15 Sabiya Banu Masthan Ali , Oussema Kirmani , Aroosa Hameed , Syed Muhammad Danish , Gautam Srivastava

Speculative decoding is a powerful technique that accelerates Large Language Model (LLM) inference by leveraging a lightweight speculative draft model. However, existing designs suffers in performance due to misalignment between training…

Computation and Language · Computer Science 2025-05-27 Yepeng Weng , Dianwen Mei , Huishi Qiu , Xujie Chen , Li Liu , Jiang Tian , Zhongchao Shi

Spatio-temporal sequence forecasting is one of the fundamental tasks in spatio-temporal data mining. It facilitates many real world applications such as precipitation nowcasting, citywide crowd flow prediction and air pollution forecasting.…

Machine Learning · Computer Science 2020-05-20 Hong-Bin Liu , Ickjai Lee

Causal inference has shown potential in enhancing the predictive accuracy, fairness, robustness, and explainability of Natural Language Processing (NLP) models by capturing causal relationships among variables. The emergence of generative…

Computation and Language · Computer Science 2025-03-24 Xiaoyu Liu , Paiheng Xu , Junda Wu , Jiaxin Yuan , Yifan Yang , Yuhang Zhou , Fuxiao Liu , Tianrui Guan , Haoliang Wang , Tong Yu , Julian McAuley , Wei Ai , Furong Huang

Large language models (LLMs) are systematically overconfident: they routinely express high certainty on questions they often answer incorrectly. Existing calibration methods either require labeled validation data, degrade under distribution…

Computation and Language · Computer Science 2026-04-14 Mohamed Rissal Hedna , Jan Strich , Martin Semmann , Chris Biemann

Estimating treatment effects (TE) from observational data is a critical yet complex task in many fields, from healthcare and economics to public policy. While recent advances in machine learning and causal inference have produced powerful…

Machine Learning · Computer Science 2025-08-15 Jeroen Berrevoets , Julianna Piskorz , Robert Davis , Harry Amad , Jim Weatherall , Mihaela van der Schaar

Large Language Models (LLMs) are becoming integral to daily life, showcasing their vast potential across various Natural Language Processing (NLP) tasks. Beyond NLP, LLMs are increasingly used in software development tasks, such as code…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-03-24 Shashikant Ilager , Lukas Florian Briem , Ivona Brandic