I realize that they probably have seen some bad things happen from contacts with the outside but I doubt they have an understanding of germ theory of disease yet. I assume they have stories they repeat to one another, maybe songs or warnings they provide to one another to encourage this ruthless xenophobia. I'd love to know what those things are.
It's not hard to make a connection between "a foreigner shows up" and "people suddenly start dying of weird unknown diseases" when the entire population is small enough for everyone to individually recognize everyone else.
