English
Related papers

Related papers: ProtIR: Iterative Refinement between Retrievers an…

200 papers

Many applications require statistically valid inference across many related tasks, while using only a handful of high-quality labels per hypothesis. In AI evaluation, these tasks may correspond to model behaviors across prompts, subgroups,…

Machine Learning · Statistics 2026-05-29 Nicolas Emmenegger , Ellery Stahler , Chara Podimata

Ranking consistently emerges as a primary focus in information retrieval research. Retrieval and ranking models serve as the foundation for numerous applications, including web search, open domain QA, enterprise domain QA, and text-based…

Information Retrieval · Computer Science 2024-12-16 Hansa Meghwani

Contrastive learning based vision-language joint pre-training has emerged as a successful representation learning strategy. In this paper, we present a prototype representation learning framework incorporating both global and local…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Pujin Cheng , Li Lin , Junyan Lyu , Yijin Huang , Wenhan Luo , Xiaoying Tang

Preference-based reinforcement learning (PbRL) has emerged as a promising paradigm for teaching robots complex behaviors without reward engineering. However, its effectiveness is often limited by two critical challenges: the reliance on…

Robotics · Computer Science 2025-12-02 Ruiqi Wang , Dezhong Zhao , Ziqin Yuan , Tianyu Shao , Guohua Chen , Dominic Kao , Sungeun Hong , Byung-Cheol Min

The prediction of protein interactions (CPIs) is crucial for the in-silico screening step in drug discovery. Recently, many end-to-end representation learning methods using deep neural networks have achieved significantly better performance…

Quantitative Methods · Quantitative Biology 2020-11-30 Jingtao Wang , Xi Li , Hua Zhang

Deep neural networks, particularly Transformers, have been widely adopted for predicting the functional properties of proteins. In this work, we focus on exploring whether Protein Transformers can capture biological intelligence among…

Machine Learning · Computer Science 2025-06-10 Fudong Lin , Wanrou Du , Jinchan Liu , Tarikul Milon , Shelby Meche , Wu Xu , Xiaoqi Qin , Xu Yuan

Proteins are miniature machines whose function depends on their three-dimensional (3D) structure. Determining this structure computationally remains an unsolved grand challenge. A major bottleneck involves selecting the most accurate…

Quantitative Methods · Quantitative Biology 2020-11-30 Stephan Eismann , Patricia Suriana , Bowen Jing , Raphael J. L. Townshend , Ron O. Dror

We introduce MIM (Masked Image Modeling)-Refiner, a contrastive learning boost for pre-trained MIM models. MIM-Refiner is motivated by the insight that strong representations within MIM models generally reside in intermediate layers.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Benedikt Alkin , Lukas Miklautz , Sepp Hochreiter , Johannes Brandstetter

Protein activity is a significant characteristic for recombinant proteins which can be used as biocatalysts. High activity of proteins reduces the cost of biocatalysts. A model that can predict protein activity from amino acid sequence is…

Quantitative Methods · Quantitative Biology 2018-07-23 X. Han , X. Wang , K. Zhou

Understanding protein structure-function relationships is a key challenge in computational biology, with applications across the biotechnology and pharmaceutical industries. While it is known that protein structure directly impacts protein…

Biomolecules · Quantitative Biology 2020-11-02 Nicolas Swenson , Aditi S. Krishnapriyan , Aydin Buluc , Dmitriy Morozov , Katherine Yelick

Personalized image preference assessment aims to evaluate an individual user's image preferences by relying only on a small set of reference images as prior information. Existing methods mainly focus on general preference assessment,…

Artificial Intelligence · Computer Science 2026-02-12 Shengqi Xu , Xinpeng Zhou , Yabo Zhang , Ming Liu , Tao Liang , Tianyu Zhang , Yalong Bai , Zuxuan Wu , Wangmeng Zuo

We present PROGRESSOR, a novel framework that learns a task-agnostic reward function from videos, enabling policy training through goal-conditioned reinforcement learning (RL) without manual supervision. Underlying this reward is an…

Robotics · Computer Science 2024-11-28 Tewodros Ayalew , Xiao Zhang , Kevin Yuanbo Wu , Tianchong Jiang , Michael Maire , Matthew R. Walter

A biological experiment is the most reliable way of assigning function to a protein. However, in the era of high-throughput sequencing, scientists are unable to carry out experiments to determine the function of every single gene product.…

Quantitative Methods · Quantitative Biology 2016-01-07 Iddo Friedberg , Predrag Radivojac

With increasing reliance on the outcomes of black-box models in critical applications, post-hoc explainability tools that do not require access to the model internals are often used to enable humans understand and trust these models. In…

Every data selection method inherently has a target. In practice, these targets often emerge implicitly through benchmark-driven iteration: researchers develop selection strategies, train models, measure benchmark performance, then refine…

Retrieval-augmented language models (LMs) have received much attention recently. However, typically the retriever is not trained jointly as a native component of the LM, but added post-hoc to an already-pretrained LM, which limits the…

Computation and Language · Computer Science 2024-07-23 Ohad Rubin , Jonathan Berant

Augmenting pretrained language models with retrievers has shown promise in effectively solving common NLP problems, such as language modeling and question answering. In this paper, we evaluate the strengths and weaknesses of popular…

Computation and Language · Computer Science 2023-11-06 Parishad BehnamGhader , Santiago Miret , Siva Reddy

Recent advances in de novo protein binder design have enabled increasing experimental validation, yet reported in silico metrics remain difficult to interpret or compare across studies due to non-standardized evaluation protocols. We…

Quantitative Methods · Quantitative Biology 2026-05-25 Cong Liu , Milong Ren , Jiaqi Guan , Chengyue Gong , Jinyuan Sun , Xinshi Chen , Wenzhi Xiao

Learning useful representations with little or no supervision is a key challenge in artificial intelligence. We provide an in-depth review of recent advances in representation learning with a focus on autoencoder-based models. To organize…

Machine Learning · Computer Science 2018-12-13 Michael Tschannen , Olivier Bachem , Mario Lucic

Lightweight inference is critical for biomolecular structure prediction and downstream tasks, enabling efficient real-world deployment and inference-time scaling for large-scale applications. While AF3 and its variants (e.g., Protenix,…

Quantitative Methods · Quantitative Biology 2025-10-17 Bo Qiang , Chengyue Gong , Xinshi Chen , Yuxuan Zhang , Wenzhi Xiao