I agree that there are other issues (babies should be given loads and loads of food! regardless of species, they just need it to grow) I want to address your question.
You can be handling him now. I would suggest a very passive, patient approach. Try holding a cricket out for him to take. Once that is working, go "two hands" and put a finger down low near his feet with one hand and hold a cricket out a few inches in front of him...that should encourage him to get on your finger....