The lower classes, the poor, the huddled masses, the bottom of the barrel. An attempt to politely describe people of lesser social rank. May be used relatively depending on context.
Conservatives might disagree to the expression and argue that success is a result of hard work and not good fortune.
Others may counter this by reasoning that possibilities are not equally distributed at birth, but also given by the resources of the environment and family, and thus to some degree are a result of luck.