But what if I need to use a symbol from the nonstandard set? Am I screwed?

Certainly not!

Use these HTML 4 Standard codes instead of the symbols in the nonstandard set. (For the ones I don't have listed, I don't know what to tell you.)

€ -- € -- Euro currency symbol
, -- , -- elongated comma
ƒ -- ƒ -- middle-English lower-case S
„ -- „ -- double comma
… -- … -- broken underline
† -- † -- cross
‡ -- ‡ -- dagger
^ -- ^ -- caret
‰ -- ‰ -- permille
Š -- Š -- 20th letter of the Slovenian alphabet
< -- &#60; -- alternative rendering for &lt;
Œ -- &#338; -- upper-case ligature of O and E
‘ -- &#8216; -- right-facing quotation mark
’ -- &#8217; -- left-facing quotation mark
“ -- &#8220; -- right-facing double quotation marks
” -- &#8221; -- left-facing double quotation marks
• -- &#8226; -- alternate rendering of &bull;
– -- &#8211; -- simple dash
— -- &#8212; -- alternate rendering for &mdash;
~ -- &#126; -- simple tilde
™ -- &#8482; -- trademark symbol
š -- &#353; -- lower-case rendering of the 20th letter of the Slovenian alphabet
> -- &#62; -- alternative rendering for &gt;
æ -- &aelig; -- lower-case ligature of a and e
ÿ -- &#255; -- simple letter y with umlaut