From the source
Meta released Code Llama, a family of open-access code-specialized models based on Llama 2, with sizes 7B, 13B, and 34B parameters, including base, Python specialist, and instruct variants, trained on 500B tokens of code data, with a 16k context window (extrapolatable to 100k), and integrated into the
Hugging Face ecosystem.





