Often spelled shmatte. The American Heritage Dictionary thinks it comes from the Yiddish shmate , implying that schmatte is a full-fledged English word (American-Yiddish?). Before this, it came from the Polish szmata .
It means either a rag, or ragged clothing.