From the source
From the source
Hugging Face and ServiceNow's BigCode collaboration introduces StarCoder and StarCoderBase, 15B parameter open Code LLMs trained on permissively licensed GitHub data with an 8,000+ token context window.
StarCoder is a Python-fine-tuned version that outperforms existing open models and matches closed models like code-cushman-001.
Released under the BigCode OpenRAIL-M v1 license with safety measures.
From the source
StarCoder and StarCoderBase are Large Language Models for Code (Code LLMs) trained on permissively licensed data from GitHub, including from 80+ programming languages, Git commits, GitHub issues, and Jupyter notebooks. Similar to LLaMA, we trained a ~15B parameter model for 1 trillion tokens. We fine-tuned StarCoderBase model for 35B Python tokens, resulting in a new model that we call StarCoder.
huggingface.co
