Learning to play Minecraft with Video PreTraining

OpenAI trained a neural network to play Minecraft using Video PreTraining (VPT) on a large unlabeled video dataset of human play, with minimal labeled data.

After fine-tuning, the model can craft diamond tools, a task that typically takes humans over 20 minutes.