More than a surly retort, this phrase can hold a viable warning to the person to whom it is uttered. Although variations in usage are common (and not always appropriate), the speaker can potentially convey that the recipient had better be more powerful in some way if he/she chooses to pursue a matter further. Attitude is the key. It's all in the delivery.