中文
相关论文

相关论文: InFoBench: Evaluating Instruction Following Abilit…

200 篇论文

With the development and widespread application of large language models (LLMs), the new paradigm of "Model as Product" is rapidly evolving, and demands higher capabilities to address complex user needs, often requiring precise workflow…

计算与语言 · 计算机科学 2025-09-17 Tao Zou , Xinghua Zhang , Haiyang Yu , Minzheng Wang , Fei Huang , Yongbin Li

Large Language Models (LLMs) have demonstrated exceptional performance in code generation tasks and have become indispensable programming assistants for developers. However, existing code generation benchmarks primarily assess the…

软件工程 · 计算机科学 2025-11-25 Peiding Wang , Li Zhang , Fang Liu , Lin Shi , Minxiao Li , Bo Shen , An Fu

Human guidance in reinforcement learning (RL) is often impractical for large-scale applications due to high costs and time constraints. Large Language Models (LLMs) offer a promising alternative to mitigate RL sample inefficiency and…

机器学习 · 计算机科学 2024-11-25 Maryam Shoaeinaeini , Brent Harrison

Large language models (LLMs) have demonstrated strong instruction-following capabilities in text-based tasks. However, this ability often deteriorates in multimodal models after alignment with non-text modalities such as images or audio.…

计算与语言 · 计算机科学 2025-11-13 Yiming Gao , Bin Wang , Chengwei Wei , Shuo Sun , AiTi Aw

Efficient Service Function Chain (SFC) provisioning and Virtual Network Function (VNF) placement are critical for enhancing network performance in modern architectures such as Software-Defined Networking (SDN) and Network Function…

网络与互联网体系结构 · 计算机科学 2026-01-23 Parisa Fard Moshiri , Murat Arda Onsu , Poonam Lohan , Burak Kantarci , Emil Janulewicz

Instruction-following LLMs have recently allowed systems to discover hidden concepts from a collection of unstructured documents based on a natural language description of the purpose of the discovery (i.e., goal). Still, the quality of the…

Large language models (LLMs) have shown considerable promise in clinical natural language processing, yet few domain-specific datasets exist to rigorously evaluate their performance on radiology tasks. In this work, we introduce an…

计算与语言 · 计算机科学 2025-11-18 Namu Park , Giridhar Kaushik Ramachandran , Kevin Lybarger , Fei Xia , Ozlem Uzuner , Meliha Yetisgen , Martin Gunn

Large Language Models (LLMs) and generative search systems are increasingly used for information seeking by diverse populations with varying preferences for knowledge sourcing and presentation. While users can customize LLM behavior through…

人机交互 · 计算机科学 2025-12-12 Nicholas Clark , Ryan Bai , Tanu Mitra

Language models are trained to follow instructions, but they are also powerful pattern completers. What happens when these two objectives conflict? We construct conversations in which a user instruction to behave in a target way T (e.g.,…

计算与语言 · 计算机科学 2026-05-21 Carolina Camassa , Derek Shiller

Large Language Models (LLMs) exhibit impressive performance across various domains but still struggle with arithmetic reasoning tasks. Recent work shows the effectiveness of prompt design methods in enhancing reasoning capabilities.…

计算与语言 · 计算机科学 2024-10-11 Wenting Tan , Dongxiao Chen , Jieting Xue , Zihao Wang , Taijie Chen

Traditional Large Language Model (LLM) pretraining relies on autoregressive language modeling with randomly sampled data from web-scale datasets. Inspired by human learning techniques like spaced repetition, we hypothesize that random…

计算与语言 · 计算机科学 2025-01-30 Neha Prakriya , Jui-Nan Yen , Cho-Jui Hsieh , Jason Cong

The application scope of large language models (LLMs) is increasingly expanding. In practical use, users might provide feedback based on the model's output, hoping for a responsive model that can complete responses according to their…

计算与语言 · 计算机科学 2024-07-25 Jianhao Yan , Yun Luo , Yue Zhang

Existing deepfake analysis methods are primarily based on discriminative models, which significantly limit their application scenarios. This paper aims to explore interactive deepfake analysis by performing instruction tuning on multi-modal…

计算机视觉与模式识别 · 计算机科学 2025-01-03 Lixiong Qin , Ning Jiang , Yang Zhang , Yuhan Qiu , Dingheng Zeng , Jiani Hu , Weihong Deng

Instruction following is critical for LLMs deployed in enterprise and API-driven settings, where strict adherence to output formats, content constraints, and procedural requirements is essential for enabling reliable LLM-assisted workflows.…

计算与语言 · 计算机科学 2026-03-06 Yunfan Zhang , Yijie Bei , Jetashree Ravi , Pawel Garbacki

Large Language Models (LLMs) have become instrumental across various applications, with the customization of these models to specific scenarios becoming increasingly critical. System message, a fundamental component of LLMs, is consist of…

计算与语言 · 计算机科学 2024-10-23 Yanzhao Qin , Tao Zhang , Tao Zhang , Yanjun Shen , Wenjing Luo , Haoze Sun , Yan Zhang , Yujing Qiao , Weipeng Chen , Zenan Zhou , Wentao Zhang , Bin Cui

Digital Forensics and Incident Response (DFIR) involves analyzing digital evidence to support legal investigations. Large Language Models (LLMs) offer new opportunities in DFIR tasks such as log analysis and memory forensics, but their…

密码学与安全 · 计算机科学 2025-05-27 Bilel Cherif , Tamas Bisztray , Richard A. Dubniczky , Aaesha Aldahmani , Saeed Alshehhi , Norbert Tihanyi

Large language models (LLMs) exhibit degraded performance under prompt compression, but the mechanisms remain poorly understood. We introduce the Compression-Decay Comprehension Test (CDCT), a benchmark that independently measures…

计算与语言 · 计算机科学 2025-12-23 Rahul Baxi

Large Language Models (LLMs) have shown considerable potential in automating decision logic within knowledge-intensive processes. However, their effectiveness largely depends on the strategy and quality of prompting. Since decision logic is…

人工智能 · 计算机科学 2025-09-05 Shaghayegh Abedi , Amin Jalali

Recent advancements in Large Language Models (LLMs) have garnered wide attention and led to successful products such as ChatGPT and GPT-4. Their proficiency in adhering to instructions and delivering harmless, helpful, and honest (3H)…

机器学习 · 计算机科学 2023-10-11 Hao Sun

We propose TraceRL, a trajectory-aware reinforcement learning framework for diffusion language models (DLMs) that incorporates preferred inference trajectory into post-training, and is applicable across different architectures. Equipped…

计算与语言 · 计算机科学 2025-09-09 Yinjie Wang , Ling Yang , Bowen Li , Ye Tian , Ke Shen , Mengdi Wang