From the source
Today we’re releasing Hermes 4.3 ( 🤗 Hugging Face ), an update to our flagship Hermes series of models.
- Hermes 4.3 was trained with an extended context length (up to 512K) and nearly matches (and in some cases exceeds) the performance of Hermes 4 70B at half the parameter cost.
- Based on Seed-OSS-36B-Base , Hermes 4.3 is an excellent shape for consumer local inference or enterprise self-deployment.
- The GGUFs comfortably sit in the VRAM of off-the-shelf GPUs, offering a private, powerful, neutrally-aligned model to everyone.
- Hermes 4.3 is our first production model post-trained entirely on the Psyche network, our distributed training network that uses the DisTrO optimizer to efficiently communicate between training nodes spread out through data centers over the open internet and secured by the consensus of the Solana blockchain.
- By enabling nodes throughout the world to collaborate on a single training run, Psyche can dramatically reduce the cost of training frontier level models, leveling the playing field for open source AI model developers.
- …