Berry phase in composite Fermi liquids