The Empire was in fact notorious for using slave labor. Most commonly the slaves would be conscripted from the 'lesser' species of nonhumans. Raids would be made against the homeworlds of some of these species, especially Kashyyyk, home planet of the Wookiees. Sometimes, though, humans, former citizens of the Empire, would be imprisoned for their political views and forced into slavery as well.