中文
相关论文

相关论文: Gemini Embedding: Generalizable Embeddings from Ge…

200 篇论文

Word embeddings are widely used in Natural Language Processing, mainly due to their success in capturing semantic information from massive corpora. However, their creation process does not allow the different meanings of a word to be…

计算与语言 · 计算机科学 2017-06-22 Massimiliano Mancini , Jose Camacho-Collados , Ignacio Iacobacci , Roberto Navigli

This study evaluates the biases in Gemini 2.0 Flash Experimental, a state-of-the-art large language model (LLM) developed by Google, focusing on content moderation and gender disparities. By comparing its performance to ChatGPT-4o, examined…

计算与语言 · 计算机科学 2025-03-24 Roberto Balestri

Recently, numerous embedding models have been made available and widely used for various NLP tasks. The Massive Text Embedding Benchmark (MTEB) has primarily simplified the process of choosing a model that performs well for several tasks in…

计算与语言 · 计算机科学 2024-06-18 Mathieu Ciancone , Imene Kerboua , Marion Schaeffer , Wissam Siblini

This work introduces Gemma, a family of lightweight, state-of-the art open models built from the research and technology used to create Gemini models. Gemma models demonstrate strong performance across academic benchmarks for language…

计算与语言 · 计算机科学 2024-04-17 Gemma Team , Thomas Mesnard , Cassidy Hardin , Robert Dadashi , Surya Bhupatiraju , Shreya Pathak , Laurent Sifre , Morgane Rivière , Mihir Sanjay Kale , Juliette Love , Pouya Tafti , Léonard Hussenot , Pier Giuseppe Sessa , Aakanksha Chowdhery , Adam Roberts , Aditya Barua , Alex Botev , Alex Castro-Ros , Ambrose Slone , Amélie Héliou , Andrea Tacchetti , Anna Bulanova , Antonia Paterson , Beth Tsai , Bobak Shahriari , Charline Le Lan , Christopher A. Choquette-Choo , Clément Crepy , Daniel Cer , Daphne Ippolito , David Reid , Elena Buchatskaya , Eric Ni , Eric Noland , Geng Yan , George Tucker , George-Christian Muraru , Grigory Rozhdestvenskiy , Henryk Michalewski , Ian Tenney , Ivan Grishchenko , Jacob Austin , James Keeling , Jane Labanowski , Jean-Baptiste Lespiau , Jeff Stanway , Jenny Brennan , Jeremy Chen , Johan Ferret , Justin Chiu , Justin Mao-Jones , Katherine Lee , Kathy Yu , Katie Millican , Lars Lowe Sjoesund , Lisa Lee , Lucas Dixon , Machel Reid , Maciej Mikuła , Mateo Wirth , Michael Sharman , Nikolai Chinaev , Nithum Thain , Olivier Bachem , Oscar Chang , Oscar Wahltinez , Paige Bailey , Paul Michel , Petko Yotov , Rahma Chaabouni , Ramona Comanescu , Reena Jana , Rohan Anil , Ross McIlroy , Ruibo Liu , Ryan Mullins , Samuel L Smith , Sebastian Borgeaud , Sertan Girgin , Sholto Douglas , Shree Pandya , Siamak Shakeri , Soham De , Ted Klimenko , Tom Hennigan , Vlad Feinberg , Wojciech Stokowiec , Yu-hui Chen , Zafarali Ahmed , Zhitao Gong , Tris Warkentin , Ludovic Peran , Minh Giang , Clément Farabet , Oriol Vinyals , Jeff Dean , Koray Kavukcuoglu , Demis Hassabis , Zoubin Ghahramani , Douglas Eck , Joelle Barral , Fernando Pereira , Eli Collins , Armand Joulin , Noah Fiedel , Evan Senter , Alek Andreev , Kathleen Kenealy

Medical text embedding models are foundational to a wide array of healthcare applications, ranging from clinical decision support and biomedical information retrieval to medical question answering, yet they remain hampered by two critical…

计算与语言 · 计算机科学 2025-08-07 Mohammad Khodadad , Ali Shiraee Kasmaee , Mahdi Astaraki , Hamidreza Mahyar

Embeddings extracted by pre-trained Large Language Models (LLMs) have significant potential to improve information retrieval and search. Beyond the zero-shot setup in which they are being conventionally used, being able to take advantage of…

机器学习 · 计算机科学 2024-08-26 Jinsung Yoon , Sercan O Arik , Yanfei Chen , Tomas Pfister

We present GTE, a general-purpose text embedding model trained with multi-stage contrastive learning. In line with recent advancements in unifying various NLP tasks into a single format, we train a unified text embedding model by employing…

计算与语言 · 计算机科学 2023-08-08 Zehan Li , Xin Zhang , Yanzhao Zhang , Dingkun Long , Pengjun Xie , Meishan Zhang

We find that current text embedding models produce outputs with a consistent bias, i.e., each embedding vector $e$ can be decomposed as $\tilde{e} + \mu$, where $\mu$ is almost identical across all sentences. We propose a plug-and-play,…

计算与语言 · 计算机科学 2025-11-17 Xingyu Ren , Youran Sun , Haoyu Liang

Large Language models (LLMs) have demonstrated impressive performance on a wide range of tasks, including in multimodal settings such as speech. However, their evaluation is often limited to English and a few high-resource languages. For…

Text embedding methods have become increasingly popular in both industrial and academic fields due to their critical role in a variety of natural language processing tasks. The significance of universal text embeddings has been further…

信息检索 · 计算机科学 2024-06-21 Hongliu Cao

We introduce llama-embed-nemotron-8b, an open-weights text embedding model that achieves state-of-the-art performance on the Multilingual Massive Text Embedding Benchmark (MMTEB) leaderboard as of October 21, 2025. While recent models show…

计算与语言 · 计算机科学 2025-11-11 Yauhen Babakhin , Radek Osmulski , Ronay Ak , Gabriel Moreira , Mengyao Xu , Benedikt Schifferer , Bo Liu , Even Oldridge

Neural text classification models typically treat output labels as categorical variables which lack description and semantics. This forces their parametrization to be dependent on the label set size, and, hence, they are unable to scale to…

计算与语言 · 计算机科学 2019-01-31 Nikolaos Pappas , James Henderson

The blind application of machine learning runs the risk of amplifying biases present in data. Such a danger is facing us with word embedding, a popular framework to represent text data as vectors which has been used in many machine learning…

计算与语言 · 计算机科学 2016-07-25 Tolga Bolukbasi , Kai-Wei Chang , James Zou , Venkatesh Saligrama , Adam Kalai

Word embeddings -- distributed representations of words -- in deep learning are beneficial for many tasks in natural language processing (NLP). However, different embedding sets vary greatly in quality and characteristics of the captured…

计算与语言 · 计算机科学 2015-12-31 Wenpeng Yin , Hinrich Schütze

Semantic embeddings have advanced the state of the art for countless natural language processing tasks, and various extensions to multimodal domains, such as visual-semantic embeddings, have been proposed. While the power of visual-semantic…

机器学习 · 计算机科学 2021-02-23 Adam Dahlgren Lindström , Suna Bensch , Johanna Björklund , Frank Drewes

We introduce the multilingual Granite Embedding R2 models, a family of encoder-based embedding models for enterprise-scale dense retrieval across 200+ languages. Extending our English-focused R2 release, these models add enhanced support…

Massively multilingual sentence representation models, e.g., LASER, SBERT-distill, and LaBSE, help significantly improve cross-lingual downstream tasks. However, the use of a large amount of data or inefficient model architectures results…

计算与语言 · 计算机科学 2024-05-31 Zhuoyuan Mao , Chenhui Chu , Sadao Kurohashi

Advancements in deep learning have generated a large-scale interest in the development of foundational deep learning models. The development of Large Language Models (LLM) has evolved as a transformative paradigm in conversational tasks,…

计算与语言 · 计算机科学 2024-08-01 Nikil Sharan Prabahar Balasubramanian , Sagnik Dakshit

The rapid advancement of multimodal large language models (MLLMs) has profoundly impacted the document domain, creating a wide array of application scenarios. This progress highlights the need for a comprehensive benchmark to evaluate these…

The realization of Artificial General Intelligence (AGI) necessitates Embodied AI agents capable of robust spatial perception, effective task planning, and adaptive execution in physical environments. However, current large language models…