English
Related papers

Related papers: SafeProtein: Red-Teaming Framework and Benchmark f…

200 papers

A critical yet frequently overlooked challenge in the field of deepfake detection is the lack of a standardized, unified, comprehensive benchmark. This issue leads to unfair performance comparisons and potentially misleading results.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Zhiyuan Yan , Yong Zhang , Xinhang Yuan , Siwei Lyu , Baoyuan Wu

The accurate screening of candidate drug ligands against target proteins through computational approaches is of prime interest to drug development efforts. Such virtual screening depends in part on methods to predict the binding affinity…

Machine Learning · Computer Science 2024-10-22 Ho-Joon Lee , Prashant S. Emani , Mark B. Gerstein

Proteins are macromolecules responsible for essential functions in almost all living organisms. Designing reasonable proteins with desired functions is crucial. A protein's sequence and structure are strongly correlated and they together…

Machine Learning · Computer Science 2024-01-10 Zhenqiao Song , Yunlong Zhao , Wenxian Shi , Yang Yang , Lei Li

Large Language Model (LLM) safeguards, which implement request refusals, have become a widely adopted mitigation strategy against misuse. At the intersection of adversarial machine learning and AI safety, safeguard red teaming has…

Cryptography and Security · Computer Science 2025-06-10 Zifan Wang , Christina Q. Knight , Jeremy Kritz , Willow E. Primack , Julian Michael

Generative modeling has become a central paradigm in protein research, extending machine learning beyond structure prediction toward sequence design, backbone generation, inverse folding, and biomolecular interaction modeling. However, the…

Machine Learning · Computer Science 2026-03-30 Senura Hansaja Wanasekara , Minh-Duong Nguyen , Xiaochen Liu , Nguyen H. Tran , Ken-Tye Yong

Foundation models have emerged as pivotal tools, tackling many complex tasks through pre-training on vast datasets and subsequent fine-tuning for specific applications. The Segment Anything Model is one of the first and most well-known…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Krzysztof Jankowski , Bartlomiej Sobieski , Mateusz Kwiatkowski , Jakub Szulc , Michal Janik , Hubert Baniecki , Przemyslaw Biecek

Red teaming has evolved from its origins in military applications to become a widely adopted methodology in cybersecurity and AI. In this paper, we take a critical look at the practice of AI red teaming. We argue that despite its current…

Artificial Intelligence · Computer Science 2025-11-03 Subhabrata Majumdar , Brian Pendleton , Abhishek Gupta

Structure-based protein design has attracted increasing interest, with numerous methods being introduced in recent years. However, a universally accepted method for evaluation has not been established, since the wet-lab validation can be…

Quantitative Methods · Quantitative Biology 2023-12-04 Chuanrui Wang , Bozitao Zhong , Zuobai Zhang , Narendra Chaudhary , Sanchit Misra , Jian Tang

Red teaming has emerged as a critical practice in assessing the possible risks of AI models and systems. It aids in the discovery of novel risks, stress testing possible gaps in existing mitigations, enriching existing quantitative safety…

Computers and Society · Computer Science 2025-03-24 Lama Ahmad , Sandhini Agarwal , Michael Lampe , Pamela Mishkin

Although an ever-growing number of applications employ deep learning based systems for prediction, decision-making, or state estimation, almost no certification processes have been established that would allow such systems to be deployed in…

Machine Learning · Computer Science 2024-03-25 Romeo Valentin

In contrast to their remarkable performance on general knowledge QA, the true abilities of Large Language Models (LLMs) in tasks demanding deep, specialized reasoning, such as in protein biology, have yet to be thoroughly investigated.…

Quantitative Methods · Quantitative Biology 2025-12-30 Dingyi Rong , Zijian Chen , Qi Jia , Kaiwei Zhang , Haotian Lu , Guangtao Zhai , Ning Liu

A concern about cutting-edge or "frontier" AI foundation models is that an adversary may use the models for preparing chemical, biological, radiological, nuclear, (CBRN), cyber, or other attacks. At least two methods can identify foundation…

Cryptography and Security · Computer Science 2024-05-21 Anthony M. Barrett , Krystal Jackson , Evan R. Murphy , Nada Madkour , Jessica Newman

Proteins are miniature machines whose function depends on their three-dimensional (3D) structure. Determining this structure computationally remains an unsolved grand challenge. A major bottleneck involves selecting the most accurate…

Quantitative Methods · Quantitative Biology 2020-11-30 Stephan Eismann , Patricia Suriana , Bowen Jing , Raphael J. L. Townshend , Ron O. Dror

Proteins are macromolecules that perform essential functions in all living organisms. Designing novel proteins with specific structures and desired functions has been a long-standing challenge in the field of bioengineering. Existing…

Biomolecules · Quantitative Biology 2023-03-03 Chence Shi , Chuanrui Wang , Jiarui Lu , Bozitao Zhong , Jian Tang

We are now witnessing significant progress of deep learning methods in a variety of tasks (or datasets) of proteins. However, there is a lack of a standard benchmark to evaluate the performance of different methods, which hinders the…

Machine Learning · Computer Science 2022-09-20 Minghao Xu , Zuobai Zhang , Jiarui Lu , Zhaocheng Zhu , Yangtian Zhang , Chang Ma , Runcheng Liu , Jian Tang

Protein complex formation is a central problem in biology, being involved in most of the cell's processes, and essential for applications, e.g. drug design or protein engineering. We tackle rigid body protein-protein docking, i.e.,…

Artificial Intelligence · Computer Science 2022-03-16 Octavian-Eugen Ganea , Xinyuan Huang , Charlotte Bunne , Yatao Bian , Regina Barzilay , Tommi Jaakkola , Andreas Krause

Artificial intelligence (AI) is being ubiquitously adopted to automate processes in science and industry. However, due to its often intricate and opaque nature, AI has been shown to possess inherent vulnerabilities which can be maliciously…

Cryptography and Security · Computer Science 2023-12-20 Mathew J. Walter , Aaron Barrett , Kimberly Tam

Rapid progress in deep learning has spurred its application to bioinformatics problems including protein structure prediction and design. In classic machine learning problems like computer vision, progress has been driven by standardized…

Biomolecules · Quantitative Biology 2019-02-04 Mohammed AlQuraishi

Disordered proteins play essential roles in myriad cellular processes, yet their structural characterization remains a major challenge due to their dynamic and heterogeneous nature. We here present a community-driven initiative to address…

Protein structure prediction is pivotal for understanding the structure-function relationship of proteins, advancing biological research, and facilitating pharmaceutical development and experimental design. While deep learning methods and…

Machine Learning · Computer Science 2024-12-30 Kaihui Cheng , Ce Liu , Qingkun Su , Jun Wang , Liwei Zhang , Yining Tang , Yao Yao , Siyu Zhu , Yuan Qi