Pushing The Limits Of The Double Copy