Yup, that's how I make a build server: clean windows image, MSBuild, then copy the utils, build targets, reference assemblies etc over from a machine containing VS.

It's such a pain that a famous ex-Microsoftie started a connect request for it:

https://visualstudio.uservoice.com/forums/121579-visual-stud...