Yup...nightmares it is! I'm reasonably sue that the majority of chameleon parasites wouldn't survive in a human since most are species specific and need certain living conditions to survive.
I treat all my reptiles like they have salmonella. That just means I always wash my hands after handling them and cleaning their cages. After seeing my friend in college get it and spend weeks in hospital I take it very seriously.