A way of saying you're glad to be rid of something. Actually, this is the only phrase which contains the obsolete word riddance... except of course for the extended form good riddance to bad rubbish.