中文
相关论文

相关论文: Context-Aware Testing: A New Paradigm for Model Te…

200 篇论文

Autonomous control systems face significant challenges in performing complex tasks in the presence of latent risks. To address this, we propose an integrated framework that combines Large Language Models (LLMs), numerical optimization, and…

系统与控制 · 电气工程与系统科学 2025-05-08 Xiyu Deng , Quan Khanh Luu , Anh Van Ho , Yorie Nakahira

Large language models (LLMs) process entire input contexts indiscriminately, which is inefficient when the information required to answer a query is localized within the context. We present dynamic context cutoff, a novel method enabling…

计算与语言 · 计算机科学 2026-02-10 Roy Xie , Junlin Wang , Paul Rosu , Chunyuan Deng , Bolun Sun , Zihao Lin , Bhuwan Dhingra

Psychometric tests, traditionally used to assess humans, are now being applied to Large Language Models (LLMs) to evaluate their behavioral traits. However, existing studies follow a context-free approach, answering each question in…

计算与语言 · 计算机科学 2025-08-29 Jivnesh Sandhan , Fei Cheng , Tushar Sandhan , Yugo Murawaki

With in-context learning ability, the performance of large language models can be significantly boosted when provided with appropriate context. However, existing in-context learning methods mainly rely on human-provided contexts, such as…

机器学习 · 计算机科学 2024-08-21 Jinghan Yang , Shuming Ma , Furu Wei

Understanding context is key to understanding human language, an ability which Large Language Models (LLMs) have been increasingly seen to demonstrate to an impressive extent. However, though the evaluation of LLMs encompasses various…

Automation systems are increasingly being used in dynamic and various operating conditions. With higher flexibility demands, they need to promptly respond to surrounding dynamic changes by adapting their operation. Context information…

软件工程 · 计算机科学 2022-07-12 Nada Sahlab , Nasser Jazdi , Michael Weyrich

While existing strategies to execute deep learning-based classification on low-power platforms assume the models are trained on all classes of interest, this paper posits that adopting context-awareness i.e. narrowing down a classification…

计算机视觉与模式识别 · 计算机科学 2023-12-05 Mohammad Mehdi Rastikerdar , Jin Huang , Shiwei Fang , Hui Guan , Deepak Ganesan

Large language models such as Open AI's Generative Pre-trained Transformer (GPT) models are proficient at answering questions, but their knowledge is confined to the information present in their training data. This limitation renders them…

计算与语言 · 计算机科学 2023-08-24 Saba Rahimi , Tucker Balch , Manuela Veloso

Large Language Models (LLMs) have demonstrated impressive capabilities, yet their deployment in high-stakes domains is hindered by inherent limitations in trustworthiness, including hallucinations, instability, and a lack of transparency.…

计算与语言 · 计算机科学 2025-10-21 David Peer , Sebastian Stabinger

The accurate diagnosis of machine breakdowns is crucial for maintaining operational safety in smart manufacturing. Despite the promise shown by deep learning in automating fault identification, the scarcity of labeled training data,…

机器学习 · 计算机科学 2024-12-05 Jinze Wang , Jiong Jin , Tiehua Zhang , Boon Xian Chai , Adriano Di Pietro , Dimitrios Georgakopoulos

Despite significant improvements in enhancing the quality of translation, context-aware machine translation (MT) models underperform in many cases. One of the main reasons is that they fail to utilize the correct features from context when…

计算与语言 · 计算机科学 2024-05-01 Huy Hien Vu , Hidetaka Kamigaito , Taro Watanabe

Large Language Models (LLMs) have achieved remarkable performance across a wide range of mathematical benchmarks. However, concerns remain as to whether these successes reflect genuine reasoning or superficial pattern recognition. Existing…

人工智能 · 计算机科学 2026-04-21 Yujie Hou , Mei Wang , Yaoyao Zhong , Ting Zhang , Xuetao Ma , Hua Huang

Large language models (LLMs) have shown great promise in machine translation, but they still struggle with contextually dependent terms, such as new or domain-specific words. This leads to inconsistencies and errors that are difficult to…

计算与语言 · 计算机科学 2024-10-29 Meiqi Chen , Fandong Meng , Yingxue Zhang , Yan Zhang , Jie Zhou

Goal-oriented dialogue systems face a trade-off between fluent language generation and task-specific control. While supervised learning with large language models is capable of producing realistic text, how to steer such responses towards…

计算与语言 · 计算机科学 2022-04-25 Charlie Snell , Mengjiao Yang , Justin Fu , Yi Su , Sergey Levine

External test-time reasoning enhances large language models (LLMs) by decoupling generation and selection. At inference time, the model generates multiple reasoning paths, and an auxiliary process reward model (PRM) is used to score and…

机器学习 · 计算机科学 2025-05-26 Zeen Song , Wenwen Qiang , Siyu Zhao , Changwen Zheng , Gang Hua

Large Language Models (LLMs) have emerged as powerful tools for diverse applications. However, their uniform token processing paradigm introduces critical vulnerabilities in instruction handling, particularly when exposed to adversarial…

密码学与安全 · 计算机科学 2025-12-04 Tengyun Ma , Jiaqi Yao , Daojing He , Shihao Peng , Yu Li , Shaohui Liu , Zhuotao Tian

Large Language Models like ChatGPT demonstrate a remarkable capacity to learn new concepts during inference without any fine-tuning. However, visual models trained to detect new objects during inference have been unable to replicate this…

Test-time adaptation (TTA) has gained increasing popularity due to its efficacy in addressing ``distribution shift'' issue while simultaneously protecting data privacy. However, most prior methods assume that a paired source domain model…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Aiming Zhang , Tianyuan Yu , Liang Bai , Jun Tang , Yanming Guo , Yirun Ruan , Yun Zhou , Zhihe Lu

With state-of-the-art models achieving high performance on standard benchmarks, contemporary research paradigms continue to emphasize general intelligence as an enduring objective. However, this pursuit overlooks the fundamental disparities…

人工智能 · 计算机科学 2023-10-03 Nick DiSanto

Long-context language models now advertise context windows up to millions of tokens, yet evaluations typically report a single length or a narrow task family, masking two failure modes: performance can collapse as length grows, and strong…