Group actions in arithmetic combinatorics