English
Related papers

Related papers: Wisteria: A Unified Multi-Scale Feature Learning F…

200 papers

We propose a learning system in which language is grounded in visual percepts without specific pre-defined categories of terms. We present a unified generative method to acquire a shared semantic/visual embedding that enables the learning…

Computation and Language · Computer Science 2021-08-02 Nisha Pillai , Cynthia Matuszek , Francis Ferraro

Identification of causal genes and pathways is a critical step for understanding the genetic underpinnings of rare diseases. We propose novel approaches to gene prioritization and pathway identification using DNA language model, graph…

Quantitative Methods · Quantitative Biology 2024-11-12 Ali Saadat , Jacques Fellay

Deep learning models have been very successful in computer vision and image processing applications. Since its inception, Many top-performing methods for image segmentation are based on deep CNN models. However, deep CNN models fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Ranju Mandal , Basim Azam , Brijesh Verma , Mengjie Zhang

Large Language Models (LLMs) are increasingly adopted as conversational assistants in genomics, where they are mainly used to reason over biological knowledge, annotations, and analysis outputs through natural language interfaces. However,…

Genomics · Quantitative Biology 2026-04-08 Weicai Long , Yusen Hou , Junning Feng , Houcheng Su , Shuo Yang , Donglin Xie , Yanlin Zhang

Recent advancements in State Space Models, notably Mamba, have demonstrated superior performance over the dominant Transformer models, particularly in reducing the computational complexity from quadratic to linear. Yet, difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Fei Xie , Weijia Zhang , Zhongdao Wang , Chao Ma

Pre-trained large language models demonstrate potential in extracting information from DNA sequences, yet adapting to a variety of tasks and data modalities remains a challenge. To address this, we propose DNAGPT, a generalized DNA…

Genomics · Quantitative Biology 2023-09-01 Daoan Zhang , Weitong Zhang , Yu Zhao , Jianguo Zhang , Bing He , Chenchen Qin , Jianhua Yao

The explosive growth of large language models (LLMs) has created a vast but opaque landscape: millions of models exist, yet their evolutionary relationships through fine-tuning, distillation, or adaptation are often undocumented or unclear,…

Machine Learning · Computer Science 2026-05-04 Zhaomin Wu , Haodong Zhao , Ziyang Wang , Jizhou Guo , Qian Wang , Bingsheng He

Large language models (LLMs) have demonstrated remarkable advancements, primarily due to their capabilities in modeling the hidden relationships within text sequences. This innovation presents a unique opportunity in the field of life…

Genomics · Quantitative Biology 2024-12-25 Cong Li , Qingqing Long , Yuanchun Zhou , Meng Xiao

This work explores the use of a monolingual Deep Neural Network (DNN) model as an universal background model (UBM) to address the problem of Language Recognition (LR) in I-vector framework. A Time Delay Deep Neural Network (TDDNN)…

Audio and Speech Processing · Electrical Eng. & Systems 2018-04-16 Mousmita Sarma , Kandarpa Kumar Sarma , Nagendra Kumar Goel

Grasp detection is a fundamental robotic task critical to the success of many industrial applications. However, current language-driven models for this task often struggle with cluttered images, lengthy textual descriptions, or slow…

Robotics · Computer Science 2024-09-24 Huy Hoang Nguyen , An Vuong , Anh Nguyen , Ian Reid , Minh Nhat Vu

The goal of language modeling techniques is to capture the statistical and structural properties of natural languages from training corpora. This task typically involves the learning of short range dependencies, which generally model the…

Computation and Language · Computer Science 2017-08-23 Youssef Oualil , Mittul Singh , Clayton Greenberg , Dietrich Klakow

Large-scale pretraining is fast becoming the norm in Vision-Language (VL) modeling. However, prevailing VL approaches are limited by the requirement for labeled data and the use of complex multi-step pretraining objectives. We present MAGMA…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Constantin Eichenberg , Sidney Black , Samuel Weinbach , Letitia Parcalabescu , Anette Frank

We introduce MMaDA, a novel class of multimodal diffusion foundation models designed to achieve superior performance across diverse domains such as textual reasoning, multimodal understanding, and text-to-image generation. The approach is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Ling Yang , Ye Tian , Bowen Li , Xinchen Zhang , Ke Shen , Yunhai Tong , Mengdi Wang

Recent multi-modal contrastive learning models have demonstrated the ability to learn an embedding space suitable for building strong vision classifiers, by leveraging the rich information in large-scale image-caption datasets. Our work…

Machine Learning · Computer Science 2023-02-09 Yuhui Zhang , Jeff Z. HaoChen , Shih-Cheng Huang , Kuan-Chieh Wang , James Zou , Serena Yeung

Prompt learning has emerged as an effective and data-efficient technique in large Vision-Language Models (VLMs). However, when adapting VLMs to specialized domains such as remote sensing and medical imaging, domain prompt learning remains…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Qinglong Cao , Zhengqin Xu , Yuntian Chen , Chao Ma , Xiaokang Yang

Deep generative models (DGMs) and their conditional counterparts provide a powerful ability for general-purpose generative modeling of data distributions. However, it remains challenging for existing methods to address advanced conditional…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Yuxiao Li , Santiago Mazuelas , Yuan Shen

We propose a probabilistic model for interpreting gene expression levels that are observed through single-cell RNA sequencing. In the model, each cell has a low-dimensional latent representation. Additional latent variables account for…

Machine Learning · Computer Science 2017-10-18 Romain Lopez , Jeffrey Regier , Michael Cole , Michael Jordan , Nir Yosef

Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data.…

Computation and Language · Computer Science 2024-05-30 Tomasz Limisiewicz , David Mareček , Tomáš Musil

The Interspeech 2025 URGENT Challenge aimed to advance universal, robust, and generalizable speech enhancement by unifying speech enhancement tasks across a wide variety of conditions, including seven different distortion types and five…

Sound · Computer Science 2025-10-01 Rong Chao , Rauf Nasretdinov , Yu-Chiang Frank Wang , Ante Jukić , Szu-Wei Fu , Yu Tsao

Motivation: Prediction of the interaction affinity between proteins and compounds is a major challenge in the drug discovery process. WideDTA is a deep-learning based prediction model that employs chemical and biological textual sequence…

Quantitative Methods · Quantitative Biology 2019-02-13 Hakime Öztürk , Elif Ozkirimli , Arzucan Özgür