Hugging FaceStory of the week

You could have designed state of the art positional encoding

The step-by-step discovery of state-of-the-art positional encoding in transformer models, iteratively improving the approach to arrive at RoPE, used in Llama 3.2 and modern transformers.