Frequently spoken ill of.
This term usually has the connotation of undeservedness. Like whatever is being so casually maligned doesn't quite deserve the ill treatment. Less commonly, the subject actually deserves every last bit of ill will that it gets.
"Jeez, they're not THAT bad!"