We actually have the architecture in place for that, it turns out it was completely unnecessary. (See: https://github.com/hummingbird-me/ansible-deploy)

The application layer is completely horizontally scalable, all I need to do is edit the config file to add or remove servers and run ansible.