Constitutional AI with Open LLMs

Summary by forck

Hugging Face presents an end-to-end recipe for Constitutional AI using open models, releasing a new tool called llm-swarm for scalable synthetic data generation on GPU Slurm clusters, along with datasets and fine-tuned Mistral-7B models based on Anthropic's and Grok's constitutions.