RoPE (Rotary Positional Embeddings)

A positional method that rotates queries/keys in complex space to encode relative positions, aiding long context.