English
Related papers

Related papers: Integrating experimental feedback improves generat…

200 papers

Generative models have proven to be very effective in generating synthetic medical images and find applications in downstream tasks such as enhancing rare disease datasets, long-tailed dataset augmentation, and scaling machine learning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Anurag Shandilya , Swapnil Bhat , Akshat Gautam , Subhash Yadav , Siddharth Bhatt , Deval Mehta , Kshitij Jadhav

Often the development of novel functional peptides is not amenable to high throughput or purely computational screening methods. Peptides must be synthesized one at a time in a process that does not generate large amounts of data. One way…

Biomolecules · Quantitative Biology 2020-12-14 Rainier Barrett , Andrew D. White

We explore a method for improving the performance of large language models through self-reflection and reinforcement learning. By incentivizing the model to generate better self-reflections when it answers incorrectly, we demonstrate that a…

Computation and Language · Computer Science 2025-06-02 Shelly Bensal , Umar Jamil , Christopher Bryant , Melisa Russak , Kiran Kamble , Dmytro Mozolevskyi , Muayad Ali , Waseem AlShikh

This study investigates the optimization of Generative AI (GenAI) systems through human feedback, focusing on how varying feedback mechanisms influence the quality of GenAI outputs. We devised a Human-AI training loop where 32 students,…

Human-Computer Interaction · Computer Science 2024-04-25 Jacob Sherson , Florent Vinchon

Deep generative models are able to suggest new organic molecules by generating strings, trees, and graphs representing their structure. While such models allow one to generate molecules with desirable properties, they give no guarantees…

Machine Learning · Computer Science 2019-12-05 John Bradshaw , Brooks Paige , Matt J. Kusner , Marwin H. S. Segler , José Miguel Hernández-Lobato

This paper presents a novel method to make statistical inferences for both the model support and regression coefficients in a high-dimensional logistic regression model. Our method is based on the repro samples framework, in which we…

Methodology · Statistics 2024-03-18 Xiaotian Hou , Linjun Zhang , Peng Wang , Min-ge Xie

Credit scoring models based on accepted applications may be biased and their consequences can have a statistical and economic impact. Reject inference is the process of attempting to infer the creditworthiness status of the rejected…

Computational Finance · Quantitative Finance 2021-09-27 Rogelio A. Mancisidor , Michael Kampffmeyer , Kjersti Aas , Robert Jenssen

In this work we introduce RITA: a suite of autoregressive generative models for protein sequences, with up to 1.2 billion parameters, trained on over 280 million protein sequences belonging to the UniRef-100 database. Such generative models…

Quantitative Methods · Quantitative Biology 2022-07-18 Daniel Hesslow , Niccoló Zanichelli , Pascal Notin , Iacopo Poli , Debora Marks

Inference-time computation is a powerful paradigm to enhance the performance of large language models (LLMs), with Best-of-N sampling being a widely used technique. However, this method is computationally expensive, requiring both (1) an…

Computation and Language · Computer Science 2024-10-04 Rohin Manvi , Anikait Singh , Stefano Ermon

Ultra high-throughput sequencing of transcriptomes (RNA-Seq) has enabled the accurate estimation of gene expression at individual isoform level. However, systematic biases introduced during the sequencing and mapping processes as well as…

Methodology · Statistics 2013-10-02 Hui Jiang , Julia Salzman

Reward Models (RMs) are critical components in the Reinforcement Learning from Human Feedback (RLHF) pipeline, directly determining the alignment quality of Large Language Models (LLMs). Recently, Generative Reward Models (GRMs) have…

Artificial Intelligence · Computer Science 2026-04-21 Kai Qin , Liangxin Liu , Yu Liang , Longzheng Wang , Yan Wang , Yueyang Zhang , Long Xia , Zhiyuan Sun , Houde Liu , Daiting Shi

Despite being trained on vast amounts of data, most LLMs are unable to reliably generate well-designed UIs. Designer feedback is essential to improving performance on UI generation; however, we find that existing RLHF methods based on…

Human-Computer Interaction · Computer Science 2026-02-18 Jason Wu , Amanda Swearngin , Arun Krishna Vajjala , Alan Leung , Jeffrey Nichols , Titus Barik

Biopharmaceutical manufacturing faces critical challenges, including complexity, high variability, lengthy lead time, and limited historical data and knowledge of the underlying system stochastic process. To address these challenges, we…

Machine Learning · Computer Science 2020-06-18 Hua Zheng , Wei Xie , Mingbin Ben Feng

RNA design, the task of finding a sequence that folds into a target secondary structure, has broad biological and biomedical impact but remains computationally challenging due to the exponentially large sequence space and exponentially many…

Machine Learning · Computer Science 2026-02-16 Milan Gautam , Ning Dai , Tianshuo Zhou , Bowen Xie , David Mathews , Liang Huang

RNA function is intimately related to its structural dynamics. Molecular dynamics simulations are useful for exploring biomolecular flexibility but are severely limited by the accessible timescale. Enhanced sampling methods allow this…

Biomolecules · Quantitative Biology 2018-02-06 Vojtěch Mlýnský , Giovanni Bussi

Large language models (LLMs) exhibit remarkable performance across various NLP tasks. However, they often generate incorrect or hallucinated information, which hinders their practical applicability in real-world scenarios. Human feedback…

Computation and Language · Computer Science 2023-05-24 Wenhao Yu , Zhihan Zhang , Zhenwen Liang , Meng Jiang , Ashish Sabharwal

The design and implementation of regulation motifs ensuring robust perfect adaptation are challenging problems in synthetic biology. Indeed, the design of high-yield robust metabolic pathways producing, for instance, drug precursors and…

Optimization and Control · Mathematics 2021-12-21 Corentin Briat , Christoph Zechner , Mustafa Khammash

Generative models capable of capturing nuanced clinical features in medical images hold great promise for facilitating clinical data sharing, enhancing rare disease datasets, and efficiently synthesizing annotated medical images at scale.…

Image and Video Processing · Electrical Eng. & Systems 2023-06-23 Shenghuan Sun , Gregory M. Goldgof , Atul Butte , Ahmed M. Alaa

The linking genotype to phenotype is the fundamental aim of modern genetics. We focus on study of links between gene expression data and phenotype data through integrative analysis. We propose three approaches. 1) The inherent complexity of…

Quantitative Methods · Quantitative Biology 2015-06-30 Min Xu

Simulated nucleotide sequences are widely used in theoretical and empirical molecular evolution studies. Conventional simulators generally use fixed parameter time-homogeneous Markov model for sequence evolution. In this work, we use the…

Populations and Evolution · Quantitative Biology 2009-12-14 Sheng Guo , Li-San Wang , Junhyong Kim