In the sense of Australia, 'Oz' is (probably) a backformation of Aussie (which goes to show how it's to be pronounced—OZ-ee (or /"Qzi/ in sampa)), using the logic that -y transforms words into adjectives, so therefore the unadjectivised form of 'Aussie' must be 'Oz'.