The builder is sandboxed, the whole model goes out the window otherwise.

Also, I really doubt Guix moves the needle much here. It can't make Julia magically more reproducible without effectively doing the same techniques you'd have to use in Nix.