You're just assuming that, though. All evidence is correlational. We observe phenomena, and build causal models. The particles move this way when near this bit of metal. Given this, what's "really" there? The magnetic field, or the magnetic potential field?

I don't think there's great cause to say that this is a seperate magisterium. We just have a paucity of data compared to what future beings will have. When everyone can spin up a hundred simulated copies of their brain and trace thought-patterns in realtime, it'll seem much less mysterious.