中文
相关论文

相关论文: Training Deliberative Monitors for Black-Box Schem…

200 篇论文

Agentic multimodal large language models (MLLMs) (e.g., OpenAI o3 and Gemini Agentic Vision) achieve remarkable reasoning capabilities through iterative visual tool invocation. However, the cascaded perception, reasoning, and tool-calling…

计算机视觉与模式识别 · 计算机科学 2026-03-25 Haoyu Huang , Jinfa Huang , Zhongwei Wan , Xiawu Zheng , Rongrong Ji , Jiebo Luo

AI assistants will occasionally respond deceptively to user queries. Recently, linear classifiers (called "deception probes") have been trained to distinguish the internal activations of a language model during deceptive versus honest…

人工智能 · 计算机科学 2026-01-21 Avi Parrack , Carlo Leonardo Attubato , Stefan Heimersheim

We propose a model-agnostic approach for mitigating the prediction bias of a black-box decision-maker, and in particular, a human decision-maker. Our method detects in the feature space where the black-box decision-maker is biased and…

机器学习 · 计算机科学 2020-11-18 Tong Wang , Maytal Saar-Tsechansky

Foundation models, i.e. large neural networks pre-trained on large text corpora, have revolutionized NLP. They can be instructed directly (e.g. (arXiv:2005.14165)) - this is called hard prompting - and they can be tuned using very little…

计算与语言 · 计算机科学 2023-06-13 Sid Mittal , Vineet Gupta , Frederick Liu , Mukund Sundararajan

Sampling-based search, a simple paradigm for utilizing test-time compute, involves generating multiple candidate responses and selecting the best one -- typically by having models self-verify each response for correctness. In this paper, we…

机器学习 · 计算机科学 2025-02-21 Eric Zhao , Pranjal Awasthi , Sreenivas Gollapudi

Artificially intelligent (AI) co-scientists must be able to sift through research literature cost-efficiently while applying nuanced scientific reasoning. We evaluate Small Language Models (SLMs, <= 8B parameters) for classifying medical…

Reliable human-machine discrimination is becoming increasingly important as large language models and autonomous agents are deployed in online settings. Existing approaches evaluate whether a system can produce behavior or responses…

人工智能 · 计算机科学 2026-05-12 Milena Rmus , Mathew D. Hardy , Thomas L. Griffiths , Mayank Agrawal

Activation monitoring, which probes a model's internal states using lightweight classifiers, is an emerging tool for AI safety. However, its worst-case robustness under a misalignment threat model--where a model might learn to actively…

机器学习 · 计算机科学 2025-12-16 Max McGuinness , Alex Serrano , Luke Bailey , Scott Emmons

Large Language Models (LLMs) can reason over natural-language inputs, but their role in intrusion detection without fine-tuning remains uncertain. This study evaluates a prompt-only approach on UNSW-NB15 by converting each network flow to a…

密码学与安全 · 计算机科学 2025-10-28 Mohammad Abdul Rehman , Syed Imad Ali Shah , Abbas Anwar , Noor Islam

We present Apriel-1.5-15B-Thinker, a 15-billion parameter open-weights multimodal reasoning model that achieves frontier-level performance through training design rather than sheer scale. Starting from Pixtral-12B, we apply a progressive…

We study offline model-based optimization to maximize a black-box objective function with a static dataset of designs and scores. These designs encompass a variety of domains, including materials, robots and DNA sequences. A common approach…

计算工程、金融与科学 · 计算机科学 2023-10-11 Can Chen , Christopher Beckham , Zixuan Liu , Xue Liu , Christopher Pal

Reasoning language models improve performance on complex tasks by generating long chains of thought (CoTs), but this process can also increase harmful outputs in adversarial settings. In this work, we ask whether the long CoTs can be…

计算与语言 · 计算机科学 2025-10-08 Yik Siu Chan , Zheng-Xin Yong , Stephen H. Bach

Input-output robustness appears in various different forms in the literature, such as robustness of AI models to adversarial or semantic perturbations and individual fairness of AI models that make decisions about humans. We propose runtime…

人工智能 · 计算机科学 2025-06-03 Ashutosh Gupta , Thomas A. Henzinger , Konstantin Kueffner , Kaushik Mallik , David Pape

As AI tools become increasingly integrated into educational contexts, questions arise about both their stability over time and their responsiveness to prompt engineering techniques. This longitudinal study focused on different AI tools'…

人工智能 · 计算机科学 2026-05-29 Danielle S. Fox , Brenda L. Robles , Elizabeth DiPietro Brovey , Christian D. Schunn

We introduce Vibe Reasoning, a human-AI collaborative paradigm for solving complex mathematical problems. Our key insight is that frontier AI models already possess the knowledge required to solve challenging problems -- they simply do not…

人工智能 · 计算机科学 2025-12-23 Jiaao Wu , Xian Zhang , Fan Yang , Yinpeng Dong

Objective To develop soft prompt-based learning algorithms for large language models (LLMs), examine the shape of prompts, prompt-tuning using frozen/unfrozen LLMs, transfer learning, and few-shot learning abilities. Methods We developed a…

计算与语言 · 计算机科学 2024-04-16 Cheng Peng , Xi Yang , Kaleb E Smith , Zehao Yu , Aokun Chen , Jiang Bian , Yonghui Wu

Humans are known to have an internal "world model" that enables us to carry out action planning based on world states. AI agents need to have such a world model for action planning as well. It is not clear how current AI models, especially…

计算机视觉与模式识别 · 计算机科学 2025-06-06 Delong Chen , Willy Chung , Yejin Bang , Ziwei Ji , Pascale Fung

Direct prompt-based editing often fails on complex transformations because vague and subjective prompts often require nuanced understanding of what should be changed in the image. Our core intuition is that leveraging compositional image…

As large-scale language models increasingly impact safety-critical domains, ensuring their reliable adherence to well-defined principles remains a fundamental challenge. We introduce Deliberative Alignment, a new paradigm that directly…

Generative models based on neural networks present a substantial challenge within deep learning. As it stands, such models are primarily limited to the domain of artificial neural networks. Spiking neural networks, as the third generation…

神经与进化计算 · 计算机科学 2023-05-22 Linghao Feng , Dongcheng Zhao , Yi Zeng