I think the middle class is defined to be those people who have enough income that mere survival is not a daily concern, but do not have so much money they don't have to work.

That is, indeed, most people, which is why further divisions are useful, and so we talk of "lower-middle" and "upper-middle".