Study of Nonlinear Dynamics of Intense Charged Particle Beams in the Paul Trap Simulator Experiment