It can take a while for a new cham to settle down enough to want to eat. Is he drinking at all? Put the silkworms back in their container and leave your cham alone for a day or so. Then try again. He may never have seen silkworms before so not realize they are food.