Don't give up on him. :)
As others have stated, all chams are individuals and it takes time for any cham to get used to you.
The cham in my avatar, sitting on my head, was a super friendly MALE veiled. He went everywhere with me and would let anybody handle him. He did not start off...