English
Related papers

Related papers: Open-Domain Safety Policy Construction

200 papers

Training a robust policy is critical for policy deployment in real-world systems or dealing with unknown dynamics mismatch in different dynamic systems. Domain Randomization~(DR) is a simple and elegant approach that trains a conservative…

Machine Learning · Computer Science 2023-05-23 Kang Xu , Yan Ma , Wei Li

We study an approach to policy selection for large relational Markov Decision Processes (MDPs). We consider a variant of approximate policy iteration (API) that replaces the usual value-function learning step with a learning step in policy…

Artificial Intelligence · Computer Science 2011-09-13 A. Fern , R. Givan , S. Yoon

This paper firstly considers the research problem of fairness in collaborative deep learning, while ensuring privacy. A novel reputation system is proposed through digital tokens and local credibility to ensure fairness, in combination with…

Cryptography and Security · Computer Science 2020-07-21 Lingjuan Lyu , Yitong Li , Karthik Nandakumar , Jiangshan Yu , Xingjun Ma

The widespread integration of Large Language Models (LLMs) necessitates rigorous and systematic safety evaluation. Existing paradigms either rely on constructed benchmarks to assess safety from predefined perspectives, or employ dynamic…

Artificial Intelligence · Computer Science 2026-05-26 Xiaoyue Lu , Xianglin Yang , Haijun Liu , Jiahao Liu , Kuntai Cai , Yan Xiao , Jin Song Dong

Generative search engines and deep research LLM agents promise trustworthy, source-grounded synthesis, yet users regularly encounter overconfidence, weak sourcing, and confusing citation practices. We introduce DeepTRACE, a novel…

Computation and Language · Computer Science 2025-09-08 Pranav Narayanan Venkit , Philippe Laban , Yilun Zhou , Kung-Hsiang Huang , Yixin Mao , Chien-Sheng Wu

Internet users highly rely on and trust web search engines, such as Google, to find relevant information online. However, scholars have documented numerous biases and inaccuracies in search outputs. To improve the quality of search results,…

Computers and Society · Computer Science 2023-10-06 Aleksandra Urman , Aniko Hannak , Mykola Makhortykh

As Large Language Models (LLMs) grow increasingly powerful, ensuring their safety and alignment with human values remains a critical challenge. Ideally, LLMs should provide informative responses while avoiding the disclosure of harmful or…

Computation and Language · Computer Science 2024-10-04 Lingrui Mei , Shenghua Liu , Yiwei Wang , Baolong Bi , Ruibin Yuan , Xueqi Cheng

Enterprise deep research often fails to produce decision-ready reports due to uneven information coverage, context explosion, and premature stopping. We propose a scalable Enterprise Deep Research (EDR) architecture to address these…

Computation and Language · Computer Science 2026-04-29 Prafulla Kumar Choubey , Kung-Hsiang Huang , Pranav Narayanan Venkit , Jiaxin Zhang , Vaibhav Vats , Yu Li , Xiangyu Peng , Chien-Sheng Wu

Retrieval-Augmented Generation (RAG) is widely used to ground large language models in external knowledge sources. However, when applied to heterogeneous corpora and multi-step queries, Naive RAG pipelines often degrade in quality due to…

Information Retrieval · Computer Science 2026-04-10 Valeriy Kovalskiy , Nikita Belov , Nikita Miteyko , Igor Reshetnikov , Max Maximov

Access control is a security mechanism designed to ensure that only authorized users can access specific resources. Cross-domain access control involves access to resources across different organizations, institutions, or applications.…

Cryptography and Security · Computer Science 2025-12-01 Aiyao Zhang , Xiaodong Lee , Zhixian Zhuang , Jiuqi Wei , Yufan Fu , Botao Peng

Process Reward Models (PRMs) have achieved remarkable success in augmenting the reasoning capabilities of Large Language Models (LLMs) within static domains such as mathematics. However, their potential in dynamic data analysis tasks…

Computation and Language · Computer Science 2026-04-28 Zhisong Qiu , Shuofei Qiao , Kewei Xu , Yuqi Zhu , Lun Du , Ningyu Zhang , Huajun Chen

Deep-research agents, i.e., systems that rely on multi-agent pipelines to iteratively retrieve, synthesize, and cite Web content in order to produce structured reports, are rapidly replacing traditional search for both routine and complex…

Cryptography and Security · Computer Science 2026-05-26 Tingwei Zhang , Harold Triedman , Vitaly Shmatikov

The capacity for highly complex, evidence-based, and strategically adaptive persuasion remains a formidable great challenge for artificial intelligence. Previous work, like IBM Project Debater, focused on generating persuasive speeches in…

Computation and Language · Computer Science 2025-11-25 Allen Roush , Devin Gonier , John Hines , Judah Goldfeder , Philippe Martin Wyder , Sanjay Basu , Ravid Shwartz Ziv

Recent years have witnessed the rapid accumulation of massive electronic medical records (EMRs), which highly support the intelligent medical services such as drug recommendation. However, prior arts mainly follow the traditional…

Information Retrieval · Computer Science 2021-02-09 Zhi Zheng , Chao Wang , Tong Xu , Dazhong Shen , Penggang Qin , Baoxing Huai , Tongzhu Liu , Enhong Chen

Research on children's online experience and computer interaction often overlooks the relationship children have with hidden algorithms that control the content they encounter. Furthermore, it is not only about how children interact with…

Human-Computer Interaction · Computer Science 2024-06-13 Belén Saldías

Domain randomization (DR) enables sim-to-real transfer by training controllers on a distribution of simulated environments, with the goal of achieving robust performance in the real world. Although DR is widely used in practice and is often…

Systems and Control · Electrical Eng. & Systems 2025-04-01 Tesshu Fujinami , Bruce D. Lee , Nikolai Matni , George J. Pappas

Differential privacy (DP) is a privacy-enhancement technology (PET) that receives prominent attention from the academia, industry, and government. One main development over the past decade has been the decentralization of DP, including…

Cryptography and Security · Computer Science 2025-09-08 Zhou Li , Yu Zheng , Tianhao Wang , Sang-Woo Jun

Planning in a text-based environment continues to be a major challenge for AI systems. Recent approaches have used language models to predict a planning domain definition (e.g., PDDL) but have only been evaluated in closed-domain simulated…

Computation and Language · Computer Science 2024-07-03 Tianyi Zhang , Li Zhang , Zhaoyi Hou , Ziyu Wang , Yuling Gu , Peter Clark , Chris Callison-Burch , Niket Tandon

Deep research systems, agentic AI that solve complex, multi-step tasks by coordinating reasoning, search across the open web and user files, and tool use, are moving toward hierarchical deployments with a Planner, Coordinator, and…

Artificial Intelligence · Computer Science 2025-11-06 Wenjun Li , Zhi Chen , Jingru Lin , Hannan Cao , Wei Han , Sheng Liang , Zhi Zhang , Kuicai Dong , Dexun Li , Chen Zhang , Yong Liu

Content moderation plays a critical role in shaping safe and inclusive online environments, balancing platform standards, user expectations, and regulatory frameworks. Traditionally, this process involves operationalising policies into…