
As long as its not a communal yard and only used by your puppy I cant see any problem in him going outside .
The sooner you start a good toilet routine the better .
If you put him out every 20 min to half hour through the day using the word you have chosen for his toileting you will have him house trained in no time... persistence is the key.
good luck :)
~Roni