# Hugging Face — Instruction-tuning Stable Diffusion with InstructPix2Pix

- Company: Hugging Face (huggingface.co)
- Announced: 2023-05-23
- Category: research-paper
- Coverage: not counted
- Announcement: yes
- Group: announcements
- Source: https://huggingface.co/blog/instruction-tuning-sd
- Record: https://forck.live/items/2058-instruction-tuning-stable-diffusion-with-instructpix2pix
- Subject: Platform
- Models affected: Stable Diffusion, InstructPix2Pix

Instruction-tuning to teach Stable Diffusion to follow instructions to translate or process input images, extending the InstructPix2Pix training strategy to tasks like cartoonization and image deraining. It covers dataset preparation, training experiments, and results, and provides code, pre-trained models, and datasets.

## Evidence

Verbatim from https://huggingface.co/blog/instruction-tuning-sd:

> This post explores instruction-tuning to teach Stable Diffusion to follow instructions to translate or process input images.

---

Record: https://forck.live/items/2058-instruction-tuning-stable-diffusion-with-instructpix2pix
Catalogue: https://forck.live/llms.txt
Current issue: https://forck.live/feed.md