Much of what middle management does is justify its existence. Without being in the office, it is a whole lot harder to justify this existence for people who spend their days in meetings talking about what will happen in other meetings. You can significantly cut these roles out and gain productivity.