Sorry for the poor quality, the batteries on the old camera died, and the batteries in my mom's camera... well, also died.
Also don't normally handle him like that, he usually just sits on my arm for about 20 minutes and I let him relax.
How long did you hold him each time you pulled him out? About how many times did you have him out before he showed any significant changes in attitude.
Each day after I let him settle in, I would hold him 5-15 minutes, and let him calm down for a little while in his cage. After an hour or two I would get him again, I would do this a max of 3 times a day. I would get up early in the morning when he was active to get him out as well. He was the most bitey at those times. When I woke him up, he was less likely to bite me.
It took about 4 days before I saw any changes, once I stopped wearing gardening gloves, the attitude change was almost instant. I think the previous owner probably tortured him with gardening gloves.. the poor baby.