From the source
nanoVLM is a lightweight toolkit for training Vision Language Models (VLMs) using pure PyTorch, inspired by nanoGPT.
It uses SigLIP as vision backbone and SmolLM2 as language backbone, with a modality projection module.
The entire codebase is minimal and readable, and training can be launched on a free Colab notebook.
