There is definately a risk of parasites, especially if you get them from a typical bait shop.
That said, Ive used earth worms before (ones from my worm bin, not from a bait shop). Worms are high in calcium, and you can sorta get them to clear their guts if you take some time. I found most of my chameleon werent interested in worms though.