Yes they do cover the hole. They dig, lay then cover it back in again. They pack the soil/sand down really hard too! It can take a long time to complete the process. It's no wonder it's such hard work for them. Amazing creatures! You should wait until they have finished covering the hole and have gone back up into the branches before you remove the laying bin. Also don't let them see you watching or they may abandon digging and laying.