From the source
IBM, Princeton, CMU, and UIUC announce Bamba-9B, a hybrid Mamba2 model trained on 2.2T tokens with open data, demonstrating 2.5x throughput improvement and 2x latency speedup over standard transformers in vLLM, and released with support in transformers, vLLM, TRL, and llama.cpp.
