Your going to get alot of stuck silk worms. They are not the brightest animals and will weave in the mesh, get bigger, and get stuck.
On the other hand if they are thicker than 1/4" and you are feeding them leaves, then go for it.
Or you can do 1/2" mesh 1/2" from the bottom of the cage. This is based on the technology of the silk worm/hornworm cup. You just have to rig up a way to get the little guys back on the mesh when they fall.