Add this to your login script:

  export FZF_DEFAULT_OPTS="--exact"

Or invoke it with one of these:

  fzf --exact
  fzf -e

Or if you start your search with a single quote ' it disables fuzz. (But maybe you already knew that, it sounds like you want the first option.)