
At that age they shouldn't need milk, normally stops before they leave the breeders, I give goats milk when weaning which I water down so by the time they leave me they are on pure water.
Provided he is still drinking water,eating his food, weeing and pooing then I wouldn't worry, as they mature and between growth spurts they tend to eat less then a week or 2 later will be acting half starved.