Don't forget that (male, of course) children wore the toga praetexta as well.
Graduating to the toga virilis ("toga of the man") was a rite of passage ceremony.
I've always wondered why elected officials reverted to the childhood toga...