# Hugging Face — Training a coding model to paint watercolours with TRL and OpenEnv

- Company: Hugging Face (huggingface.co)
- Announced: 2026-09-03
- Category: not stated
- Coverage: not counted
- Announcement: no
- Group: routine
- Source: https://huggingface.co/blog/train-to-paint-with-code
- Record: https://forck.live/items/7556-training-a-coding-model-to-paint-watercolours-with-trl-and-openenv
- Subject: Platform

A project reproduced an idea to train a coding model to paint watercolours using TRL and OpenEnv. The reference pool dataset, RL environment, training scripts, and trained models were released openly. Three reward mixes were trained and compared, using HPSv3 and a pairwise judge.

## Evidence

Verbatim from https://huggingface.co/blog/train-to-paint-with-code:

> The reference pool dataset, the RL environment, the training scripts and the trained models, all open.

---

Record: https://forck.live/items/7556-training-a-coding-model-to-paint-watercolours-with-trl-and-openenv
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md