From the source
Instruction-tuning to teach Stable Diffusion to follow instructions to translate or process input images, extending the InstructPix2Pix training strategy to tasks like cartoonization and image deraining.
It covers dataset preparation, training experiments, and results, and provides code, pre-trained models, and datasets.
