First off, no, your cham isn't being an a**hole, your chameleon is in a new situation and afraid of everything. It takes time to settle in and understand what is a threat and what isn't. How long have you had him? The breeder can try to select for more social young but they can't guarantee it. No one can. Chams are smart enough to be individuals and their personalities shift with age too.
Give him time to settle into your home routine. Give him a cage that offers the correct temps, humidity, lighting, and give him the proper nutrition. Give him some hiding places in his cage so he can watch the activity around the cage without being seen. Limit the commotion around the cage at first too. Don't have kids crowding around watching him. That will make him more defensive at first. Once he's eating and drinking reliably, you can start teaching him to trust you. Put your cage-related chores on a routine so he learns what to expect. You can teach him that you are also a source of good things like favorite food treats. Offer them to him by hand or in a hand-held cup and let him come to YOU. Then you can start coaxing him to climb onto your hand or arm a little at a time.
The main thing is, understand why he's behaving the way he is and be patient with him, You are not going to force him into liking you so don't bother trying. It will just make him more defensive.