All my guyz rebel when I try to get them back in their cages.
By then, their body temp has droped quite a lot since when I let them out.
When they are cold, they are less able to flee from a predator and are likely to be defensive.
I let my guys out in the afternoon when their body temp is at it's highest and they never want to go back into their cage!!
It takes time for them to learn that you are not going to harm them, even though he lets you touch him at different times, when cold they are just more cautious.
He will get used to you 'escorting' him back home with repitition.
My Smidget is at the same stage.
When they puff up, sway back and forth, and snap at you, dont be intimadated, it's all just show.
I know it looks really mean and scary, but that what it's meant to do.
Your cham at that age can not harm you but the stress is not really very good if it's done all the time.
If he knows he can get rid of you so easy, he continue to do so.
So, when he gets grumpy outside his cage, and it's time to go home, just gently and slowly slide your hand under his and let him climb on it, you will likely need to use the other hand as well to either distract him, or to catch him if he decides to make a 'U' turn.
If you feel more comfortible, you can wear gloves.
But as mean as they look, and put on a grand show, I have never been bitten.