Worm castings only offer micronutrients to the plants, not the macros you need for growth and flowering. This is because the worms concentrate the nutrients of whatever they are eating, so if you just throw a worm in your pot it will not create any new nutrients that weren't already there...