So, I finally managed to get working:
This means I can start making a multiplayer game!

Because Game Center is strictly peer-to-peer out of the box, I'll try and implement a deterministic lockstep mechanism. Hopefully the Swift Decimal type is stable accross architectures.