A lot of people just do what they want regardless of the animal in question.
It makes sense that a singular, territorial animal, that doesn't even like others of it's own species around is not going to appreciate being handled ... excessively or otherwise.
Every single chameleon (if given the choice) no matter what anyone says, would choose to be left alone.
-Brad