nanoVLM: The simplest repository to train your VLM in pure PyTorch

nanoVLM is a lightweight toolkit for training Vision Language Models (VLMs) using pure PyTorch, inspired by nanoGPT. It uses SigLIP as vision backbone and SmolLM2 as language backbone, with a modality projection module. The entire codebase is minimal and readable, and training can be launched on a free Colab notebook.