English
Related papers

Related papers: LatentRefusal: Latent-Signal Refusal for Unanswera…

200 papers

We introduce a method to reduce refusal rates of large language models (LLMs) on sensitive content without modifying model weights or prompts. Motivated by the observation that refusals in certain models were often preceded by the specific…

Computation and Language · Computer Science 2025-06-02 Harvey Dam , Jonas Knochelmann , Vinu Joseph , Ganesh Gopalakrishnan

Video Temporal Grounding (VTG) aims to localize a temporal segment in a video corresponding to a natural language query. However, existing VTG models assume that a relevant segment always exists, causing them to always predict a target…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Jin-Seop Lee , SungJoon Lee , SeongJun Jung , Boyang Li , Jee-Hyong Lee

Generating step-by-step "chain-of-thought" rationales has proven effective for improving the performance of large language models on complex reasoning tasks. However, applying such techniques to structured tasks, such as text-to-SQL,…

Computation and Language · Computer Science 2025-02-20 Mingqian He , Yongliang Shen , Wenqi Zhang , Qiuying Peng , Jun Wang , Weiming Lu

Augmenting large language models (LLMs) with auxiliary tokens has emerged as a promising strategy for enhancing model performance. In this work, we introduce a lightweight method termed latent tokens; these are dummy tokens that may be…

Machine Learning · Computer Science 2025-05-20 Yuchang Sun , Yanxi Chen , Yaliang Li , Bolin Ding

Large Language Models (LLMs), despite their remarkable capabilities, are prone to generating hallucinated or outdated content due to their static internal knowledge. While Retrieval-Augmented Generation (RAG) integrated with Reinforcement…

Computation and Language · Computer Science 2026-01-14 Zhiwen Tan , Jiaming Huang , Qintong Wu , Hongxuan Zhang , Chenyi Zhuang , Jinjie Gu

Abstention Ability (AA) is a critical aspect of Large Language Model (LLM) reliability, referring to an LLM's capability to withhold responses when uncertain or lacking a definitive answer, without compromising performance. Although…

Computation and Language · Computer Science 2024-09-25 Nishanth Madhusudhan , Sathwik Tejaswi Madhusudhan , Vikas Yadav , Masoud Hashemi

It is increasingly important to evaluate how text generation systems based on large language models (LLMs) behave, such as their tendency to produce harmful output or their sensitivity to adversarial inputs. Such evaluations often rely on a…

Computation and Language · Computer Science 2025-11-17 Rachel Longjohn , Shang Wu , Saatvik Kher , Catarina Belém , Padhraic Smyth

Large Language Models (LLMs) have demonstrated impressive performance on multiple-choice question answering (MCQA) benchmarks, yet they remain highly vulnerable to minor input perturbations. In this paper, we introduce and evaluate Token…

Computation and Language · Computer Science 2025-06-12 Jui-Ming Yao , Hao-Yuan Chen , Zi-Xian Tang , Bing-Jia Tan , Sheng-Wei Peng , Bing-Cheng Xie , Shun-Feng Su

Text-to-SQL, which maps natural language to SQL queries, has benefited greatly from recent advances in Large Language Models (LLMs). While LLMs offer various paradigms for this task, including prompting and supervised fine-tuning (SFT), SFT…

Computation and Language · Computer Science 2025-09-24 Jinwang Song , Hongying Zan , Kunli Zhang , Lingling Mu , Yingjie Han , Haobo Hua , Min Peng

LLMs when used with Retrieval Augmented Generation (RAG), are greatly improving the SOTA of translating natural language queries to structured and correct SQL. Unlike previous reviews, this survey provides a comprehensive study of the…

Computation and Language · Computer Science 2025-02-05 Ali Mohammadjafari , Anthony S. Maida , Raju Gottumukkala

Large language models (LLMs) with in-context learning have demonstrated remarkable capability in the text-to-SQL task. Previous research has prompted LLMs with various demonstration-retrieval strategies and intermediate reasoning steps to…

Computation and Language · Computer Science 2023-11-28 Shuaichen Chang , Eric Fosler-Lussier

Auto-regressive speech-text models pre-trained on interleaved text tokens and discretized speech tokens demonstrate strong speech understanding and generation, yet remain substantially less compute-efficient than text LLMs, partly due to…

Computation and Language · Computer Science 2026-03-11 Yen-Ju Lu , Yashesh Gaur , Wei Zhou , Benjamin Muller , Jesus Villalba , Najim Dehak , Luke Zettlemoyer , Gargi Ghosh , Mike Lewis , Srinivasan Iyer , Duc Le

Large Language Models (LLMs) have demonstrated strong performance on various tasks. To unleash their power on the Text-to-SQL task, we propose $R^3$ (Review-Rebuttal-Revision), a consensus-based multi-agent system for Text-to-SQL tasks.…

Computation and Language · Computer Science 2024-07-12 Hanchen Xia , Feng Jiang , Naihao Deng , Cunxiang Wang , Guojiang Zhao , Rada Mihalcea , Yue Zhang

Maintaining the safety of large language models (LLMs) is crucial as they are increasingly deployed in real-world applications. Existing safety guardrails typically rely on single-pass classification or, more recently, distilled reasoning.…

Artificial Intelligence · Computer Science 2026-05-29 Siddharth Sai , Xiaofei Wen , Muhao Chen

Single-step retrieval-augmented generation (RAG) provides an efficient way to incorporate external information for simple question answering tasks but struggles with complex questions. Agentic RAG extends this paradigm by replacing…

Computation and Language · Computer Science 2026-05-08 Yijia Zheng , Marcel Worring

Existing text-to-SQL semantic parsers are typically designed for particular settings such as handling queries that span multiple tables, domains or turns which makes them ineffective when applied to different settings. We present UniSAr…

Computation and Language · Computer Science 2022-04-14 Longxu Dou , Yan Gao , Mingyang Pan , Dingzirui Wang , Wanxiang Che , Dechen Zhan , Jian-Guang Lou

Retrieval-Augmented Generation (RAG) mitigates LLM hallucinations but introduces a critical vulnerability: corpus integrity. We present SilentRetrieval, a two-stage data poisoning attack that hijacks RAG systems through adversarially…

Cryptography and Security · Computer Science 2026-05-28 Jiachen Qian

Safety-aligned large language models (LLMs) sometimes falsely refuse pseudo-harmful prompts, like "how to kill a mosquito," which are actually harmless. Frequent false refusals not only frustrate users but also provoke a public backlash…

Computation and Language · Computer Science 2025-06-12 Bang An , Sicheng Zhu , Ruiyi Zhang , Michael-Andrei Panaitescu-Liess , Yuancheng Xu , Furong Huang

Large Reasoning Models (LRMs) have demonstrated promising performance in complex tasks. However, the resource-consuming reasoning processes may be exploited by attackers to maliciously occupy the resources of the servers, leading to a…

Cryptography and Security · Computer Science 2025-11-25 Zhenhao Zhu , Yue Liu , Zhiwei Xu , Yingwei Ma , Hongcheng Gao , Nuo Chen , Yanpei Guo , Wenjie Qu , Huiying Xu , Zifeng Kang , Xinzhong Zhu , Jiaheng Zhang

Military Large Language Models (LLMs) must provide accurate information to the warfighter in time-critical and dangerous situations. However, today's LLMs are imbued with safety behaviors that cause the LLM to refuse many legitimate queries…