tinfoil doesn't seem to distinguish between cached and input tokens. I think tha... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		itemize123 19 hours ago \| parent \| context \| favorite \| on: GLM-5.2 – How to Run Locally tinfoil doesn't seem to distinguish between cached and input tokens. I think that would make it untenably expensive
		help

traceroute66 13 hours ago [–]

> tinfoil doesn't seem to distinguish between cached and input tokens.

Correct.

Privatemode correctly distinguish[1][2].

But with Tinfoil it appears to be a fundamental architectural limitation that they cannot.[3]

[1] https://www.privatemode.ai/pricing [2] https://www.privatemode.ai/blog/secure-prompt-caching [3] https://docs.tinfoil.sh/resources/caching

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact