the blog post details it but essentially to convert from PaliGemma tokens to bbox:

y0 / 1024 * h

x0 / 1024 * w

y1 / 1024 * h

x1 / 1024 * w

have not played with segmentation yet.