CodeGemma:基于 Gemma 的开放代码模型
计算与语言
2024-06-21 v2 人工智能
摘要
本文介绍了 CodeGemma,这是一个基于 Gemma 构建的专门化开放代码模型集合,能够执行多种代码和自然语言生成任务。我们发布了三个模型变体。CodeGemma 7B 预训练 (PT) 和指令微调 (IT) 变体具有非常稳健的自然语言理解能力,在数学推理方面表现出色,并且其代码能力与其他开放模型相当。CodeGemma 2B 是一个最先进的代码补全模型,专为在延迟敏感场景中进行快速代码填充和开放式生成而设计。
引用
@article{arxiv.2406.11409,
title = {CodeGemma: Open Code Models Based on Gemma},
author = {CodeGemma Team and Heri Zhao and Jeffrey Hui and Joshua Howland and Nam Nguyen and Siqi Zuo and Andrea Hu and Christopher A. Choquette-Choo and Jingyue Shen and Joe Kelley and Kshitij Bansal and Luke Vilnis and Mateo Wirth and Paul Michel and Peter Choy and Pratik Joshi and Ravin Kumar and Sarmad Hashmi and Shubham Agrawal and Zhitao Gong and Jane Fine and Tris Warkentin and Ale Jakse Hartman and Bin Ni and Kathy Korevec and Kelly Schaefer and Scott Huffman},
journal= {arXiv preprint arXiv:2406.11409},
year = {2024}
}
备注
v1: 11 pages, 4 figures, 5 tables. v2: Update metadata