Some of my relatives had told their toddler "we're going to granny of your grand-dad".

Yep, that's 5 generations at once. That particular sub-branch has children later so they are a full generation ahead of my own branch, so I've told.