# Hugging Face — CodeGemma - an official Google release for code LLMs

- Company: Hugging Face (huggingface.co)
- Announced: 2024-04-09T00:00:00+00:00
- Category: new-model
- Subject: Platform
- Open weights: yes
- Models affected: CodeGemma 2B, CodeGemma 7B, CodeGemma 7B Instruct
- Context window: 8K token context size
- Source: https://huggingface.co/blog/codegemma
- Record: https://forck.live/items/1912-codegemma-an-official-google-release-for-code-llms

Google released CodeGemma, a family of open-access code-specialist LLMs based on Gemma, trained on an additional 500 billion tokens, with three variants: 2B base, 7B base, and 7B instruct, all with 8K context size, integrated into the Hugging Face ecosystem.

## Evidence

Verbatim from https://huggingface.co/blog/codegemma:

> CodeGemma is a family of code-specialist LLM models by Google, based on the pre-trained 2B and 7B Gemma checkpoints. CodeGemma are further trained on an additional 500 billion tokens of primarily English language data, mathematics, and code to improve on logical and mathematical reasoning, and are suitable for code completion and generation. CodeGemma 2B was trained exclusively on Code Infilling and is meant for fast code completion and generation, especially in settings where latency and/or privacy are crucial. CodeGemma 7B training mix includes code infilling data (80%) and natural language. It can be used for code completion, as well as code and language understanding and generation. CodeGemma 7B Instruct was fine-tuned for instruction following on top of CodeGemma 7B. It’s meant for conversational use, especially around code, programming, or mathematical reasoning topics. All the models have the same 8K token context size as their predecessors.

---

Record: https://forck.live/items/1912-codegemma-an-official-google-release-for-code-llms
Catalogue: https://forck.live/llms.txt
Feed: https://forck.live/feed.md