Written by Orthodox Jews instead of he'. It's merely the letter before "he", followed by the apostrophe that would be used if it really were an abbreviation. The English equivalent would be to write "S.", instead of "T.".

Check out how we may avoid taking the Lord's name in vain:

Of course, what's really forbidden is to take an oath in the Lord's name! Everything else is just a safety precaution.