Dbearden
Hi Deana,
It sounds like he may have been too young to be out of the nest.
I had one of those not too long ago, kept popping out of the nest too early, with me putting him back with his siblings, and him popping out again

.
Were the parents actively feeding this baby?
Two days out of the nest and being too young, they should have been feeding him quite often.
Here is a time line of Gouldian development:
As you can see, babies don't fledge untill around 20 to 23 days of age, baby fledglings don't wean untill around 6 weeks of age. Until that point the parents feed regularly, slowly cutting down on the feeding towards the 6 week mark. By around 5 weeks, you should be seeing the babies starting to sample soft foods, such as hard boiled eggs, chopped greens, spray millet, etc. They should also be starting to drink on their own.
They should not be removed from the parents until they are eating and drinking 100% on their own, and the parents have stopped feeding them.