Without granting that your premise is either meaningful or coherent, racism in the population could easily explain it. The absence of group membership based laws doesn't impy the absence of group membership based attitudes that are implemented through individual decisions.