English
Related papers

Related papers: One Embedder, Any Task: Instruction-Finetuned Text…

200 papers

Word embeddings represent a transformative technology for analyzing text data in social work research, offering sophisticated tools for understanding case notes, policy documents, research literature, and other text-based materials. This…

Computation and Language · Computer Science 2024-11-12 Brian E. Perron , Kelley A. Rivenburgh , Bryan G. Victor , Zia Qi , Hui Luan

Recent advances in generative diffusion models have enabled text-controlled synthesis of realistic and diverse images with impressive quality. Despite these remarkable advances, the application of text-to-image generative models in computer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yulu Gan , Sungwoo Park , Alexander Schubert , Anthony Philippakis , Ahmed M. Alaa

Task embeddings are low-dimensional representations that are trained to capture task properties. In this paper, we propose MetaEval, a collection of $101$ NLP tasks. We fit a single transformer to all MetaEval tasks jointly while…

Computation and Language · Computer Science 2021-12-13 Damien Sileo , Marie-Francine Moens

We present QZhou-Embedding, a general-purpose contextual text embedding model with exceptional text representation capabilities. Built upon the Qwen2.5-7B-Instruct foundation model, we designed a unified multi-task framework comprising…

Computation and Language · Computer Science 2025-09-01 Peng Yu , En Xu , Bin Chen , Haibiao Chen , Yinfei Xu

Embeddings mapping high-dimensional discrete input to lower-dimensional continuous vector spaces have been widely adopted in machine learning applications as a way to capture domain semantics. Interviewing 13 embedding users across…

Human-Computer Interaction · Computer Science 2022-03-07 Angie Boggust , Brandon Carter , Arvind Satyanarayan

Image processing, including image restoration, image enhancement, etc., involves generating a high-quality clean image from a degraded input. Deep learning-based methods have shown superior performance for various image processing tasks in…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Huiyu Duan , Xiongkuo Min , Sijing Wu , Wei Shen , Guangtao Zhai

This work in the field of developmental cognitive robotics aims to devise a new domain bridging between reinforcement learning and imitation learning, with a model of the intrinsic motivation for learning agents to learn with guidance from…

Artificial Intelligence · Computer Science 2024-12-31 Sao Mai Nguyen

Personalizing text-to-image models using a limited set of images for a specific object has been explored in subject-specific image generation. However, existing methods often face challenges in aligning with text prompts due to overfitting…

Computer Vision and Pattern Recognition · Computer Science 2024-02-16 Daewon Chae , Nokyung Park , Jinkyu Kim , Kimin Lee

Instruction tuning commonly means finetuning a language model on instruction-response pairs. We discover two forms of adaptation (tuning) that are deficient compared to instruction tuning, yet still yield instruction following; we call this…

Computation and Language · Computer Science 2024-09-24 John Hewitt , Nelson F. Liu , Percy Liang , Christopher D. Manning

Intermediate task fine-tuning has been shown to culminate in large transfer gains across many NLP tasks. With an abundance of candidate datasets as well as pre-trained language models, it has become infeasible to run the cross-product of…

Computation and Language · Computer Science 2021-09-13 Clifton Poth , Jonas Pfeiffer , Andreas Rücklé , Iryna Gurevych

Generating textual descriptions for images has been an attractive problem for the computer vision and natural language processing researchers in recent years. Dozens of models based on deep learning have been proposed to solve this problem.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-01 Ahmad Asadi , Reza Safabakhsh

Embedding models, which learn latent representations of users and items based on user-item interaction patterns, are a key component of recommendation systems. In many applications, contextual constraints need to be applied to refine…

Information Retrieval · Computer Science 2019-07-04 Syrine Krichene , Mike Gartrell , Clement Calauzenes

Large language models (LLMs) have been widely explored for embedding generation. While recent studies show that in-context learning (ICL) effectively enhances the representational capability of LLMs by prepending a few task-related…

Computation and Language · Computer Science 2026-05-05 Ailiang Lin , Zhuoyun Li , Keyu Mao , Kotaro Funakoshi , Manabu Okumura

Medical text embedding models are foundational to a wide array of healthcare applications, ranging from clinical decision support and biomedical information retrieval to medical question answering, yet they remain hampered by two critical…

Computation and Language · Computer Science 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Hamidreza Mahyar

We introduce sub-sentence encoder, a contrastively-learned contextual embedding model for fine-grained semantic representation of text. In contrast to the standard practice with sentence embeddings, where the meaning of an entire sequence…

Computation and Language · Computer Science 2023-11-09 Sihao Chen , Hongming Zhang , Tong Chen , Ben Zhou , Wenhao Yu , Dian Yu , Baolin Peng , Hongwei Wang , Dan Roth , Dong Yu

Sentence embedding methods have made remarkable progress, yet they still struggle to capture the implicit semantics within sentences. This can be attributed to the inherent limitations of conventional sentence embedding methods that assign…

Computation and Language · Computer Science 2026-01-16 Kohei Oda , Po-Min Chuang , Kiyoaki Shirai , Natthawut Kertkeidkachorn

Incremental learning aims to learn new tasks sequentially without forgetting the previously learned ones. Most of the existing incremental learning methods for audio focus on training the model from scratch on the initial task, and the same…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-29 Manjunath Mulimani , Annamaria Mesaros

In this work, we propose an effective approach for training unique embedding representations by combining three simultaneous modalities: image and spoken and textual narratives. The proposed methodology departs from a baseline system that…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Benet Oriol , Jordi Luque , Ferran Diego , Xavier Giro-i-Nieto

Extensive evaluation on a large number of word embedding models for language processing applications is conducted in this work. First, we introduce popular word embedding models and discuss desired properties of word models and evaluation…

Computation and Language · Computer Science 2019-07-10 Bin Wang , Angela Wang , Fenxiao Chen , Yuncheng Wang , C. -C. Jay Kuo

The number of academic papers being published is increasing exponentially in recent years, and recommending adequate citations to assist researchers in writing papers is a non-trivial task. Conventional approaches may not be optimal, as the…

Information Retrieval · Computer Science 2020-01-09 Yang Zhang , Qiang Ma