Mine just puffed up and hissed at my 5yo son this morning and all he was doing is walking into the room and saying good morning George LOL and he is the one that hand feeds him the super worms that he loves so much so I would think he would be rather fond of the little man.
my chameleon never minded being held till one day she put her foot down and hissed, scared the piss out of me and she's been like that since... i was sad but theres not much you can do, they are anti-social creatures.