中文
相关论文

相关论文: Improving LLM Performance Through Black-Box Online…

200 篇论文

Instruction tuning improves the reasoning abilities of large language models (LLMs), with data quality and scalability being the crucial factors. Most instruction tuning data come from human crowd-sourcing or GPT-4 distillation. We propose…

计算与语言 · 计算机科学 2024-05-24 Xiang Yue , Tuney Zheng , Ge Zhang , Wenhu Chen

As large language models (LLMs) continue to advance, the need for up-to-date and well-organized benchmarks becomes increasingly critical. However, many existing datasets are scattered, difficult to manage, and make it challenging to perform…

机器学习 · 计算机科学 2025-06-03 Eunsu Kim , Haneul Yoo , Guijin Son , Hitesh Patel , Amit Agarwal , Alice Oh

Safe deployment of Large Language Model (LLM) agents in autonomous settings requires reliable oversight mechanisms. A central challenge is detecting scheming, where agents covertly pursue misaligned goals. One approach to mitigating such…

计算与语言 · 计算机科学 2026-03-03 Simon Storf , Rich Barton-Cooper , James Peters-Gill , Marius Hobbhahn

Measuring innovation often relies on context-specific proxies and on expert evaluation. Hence, empirical innovation research is often limited to settings where such data is available. We investigate how large language models (LLMs) can be…

计算与语言 · 计算机科学 2025-08-05 Robin Nowak , Patrick Figge , Carolin Haeussler

In 2025, Large Language Model (LLM) services have launched a new feature -- AI video chat -- allowing users to interact with AI agents via real-time video communication (RTC), just like chatting with real people. Despite its significance,…

网络与互联网体系结构 · 计算机科学 2025-10-02 Jiayang Xu , Xiangjie Huang , Zijie Li , Zili Meng

The democratization of open-source Large Language Models (LLMs) allows users to fine-tune and deploy models on local infrastructure but exposes them to a First Mile deployment landscape. Unlike black-box API consumption, the reliability of…

软件工程 · 计算机科学 2026-01-21 Guangba Yu , Zirui Wang , Yujie Huang , Renyi Zhong , Yuedong Zhong , Yilun Wang , Michael R. Lyu

To facilitate the research on large language models (LLMs), this paper presents a comprehensive and unified library, LLMBox, to ease the development, use, and evaluation of LLMs. This library is featured with three main merits: (1) a…

Test-time scaling (TTS) methods have proven highly effective for LLMs, yet their application to vision-language models (VLMs) remains relatively underexplored. Existing VLM TTS methods largely require open-weight model access or expensive…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Kaihua Hou , Abhijith Varma Mudunuri , Jiaxing Qiu , Roxana Daneshjou , Thomas Hartvigsen , Ahmed Alaa

Personalized outfit recommendation remains a complex challenge, demanding both fashion compatibility understanding and trend awareness. This paper presents a novel framework that harnesses the expressive power of large language models…

信息检索 · 计算机科学 2024-09-19 Najmeh Forouzandehmehr , Nima Farrokhsiar , Ramin Giahi , Evren Korpeoglu , Kannan Achan

Large Language Models (LLMs) enable real-time function calling in edge AI systems but introduce significant computational overhead, leading to high power consumption and carbon emissions. Existing methods optimize for performance while…

The high costs of customizing large language models (LLMs) fundamentally limit their adaptability to user-specific needs. Consequently, LLMs are increasingly offered as cloud-based services, a paradigm that introduces critical limitations:…

计算与语言 · 计算机科学 2025-09-16 Jiaxuan Zhao , Naibin Gu , Yuchen Feng , Xiyu Liu , Peng Fu , Zheng Lin , Weiping Wang

Given a black-box AI system and a task, at what confidence level can a practitioner trust the system's output? We answer with a reliability level -- a single number per system-task pair, derived from self-consistency sampling and conformal…

机器学习 · 计算机科学 2026-02-26 Charafeddine Mouzouni

Recent advancements in large language models (LLMs) have prompted interest in deploying these models on mobile devices to enable new applications without relying on cloud connectivity. However, the efficiency constraints of deploying LLMs…

性能 · 计算机科学 2025-04-02 Xiao Yan , Yi Ding

Extremely large pre-trained language models (PTMs) such as GPT-3 are usually released as a service. It allows users to design task-specific prompts to query the PTMs through some black-box APIs. In such a scenario, which we call…

计算与语言 · 计算机科学 2022-06-28 Tianxiang Sun , Yunfan Shao , Hong Qian , Xuanjing Huang , Xipeng Qiu

Recent advances in Chain-of-Thought (CoT) prompting have substantially enhanced the reasoning capabilities of large language models (LLMs), enabling sophisticated problem-solving through explicit multi-step reasoning traces. However, these…

机器学习 · 计算机科学 2025-08-28 Xinyu Li , Tianjin Huang , Ronghui Mu , Xiaowei Huang , Gaojie Jin

Click-through rate (CTR) prediction is a fundamental task in modern recommender systems. In recent years, the integration of large language models (LLMs) has been shown to effectively enhance the performance of traditional CTR methods.…

信息检索 · 计算机科学 2026-01-29 Yu Cui , Feng Liu , Jiawei Chen , Xingyu Lou , Changwang Zhang , Jun Wang , Yuegang Sun , Xiaohu Yang , Can Wang

The recent boom of large language models (LLMs) has re-ignited the hope that artificial intelligence (AI) systems could aid medical diagnosis. Yet despite dazzling benchmark scores, LLM assistants have yet to deliver measurable improvements…

人工智能 · 计算机科学 2025-07-03 Matthew JY Kang , Wenli Yang , Monica R Roberts , Byeong Ho Kang , Charles B Malpas

The recent success of Large Language Models (LLMs) has garnered significant attention in both academia and industry. Prior research on LLMs has primarily focused on enhancing or leveraging their generalization capabilities in zero- and…

计算与语言 · 计算机科学 2024-04-01 Shulin Liu , Chengcheng Xu , Hao Liu , Tinghao Yu , Tao Yang

While large language models (LLMs) demonstrate reasonable zero-shot capability across many downstream tasks, fine-tuning is a common practice to improve their performance. However, a task's data efficiency--i.e., the number of fine-tuning…

机器学习 · 计算机科学 2026-01-01 Gyung Hyun Je , Colin Raffel

Adapting state-of-the-art Large Language Models (LLMs) like GPT-4 and Gemini for specific tasks is challenging. Due to the opacity in their parameters, embeddings, and even output probabilities, existing fine-tuning adaptation methods are…

计算与语言 · 计算机科学 2024-05-29 Haotian Sun , Yuchen Zhuang , Wei Wei , Chao Zhang , Bo Dai