Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I found that "Agentic Search" is generally useless in most LLMs since sites with useful data tend to block AI models.

The answer to "when is it cheaper to buy two singles rather than one return between Cambridge to London?" is available in sites such as BRFares, but no LLM can scrape it so it just makes up a generic useless answer.



My guess is that this is going to be the future for LLMs too. It will get harder or more expensive for AI companies to train their models on the latest information as most sites will block the scrapers or ask for a fee.

There might be a future where you’ll have to pay more for an up to date model vs a legacy (out of date) model


Is it still getting blocked when you give it a browser?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: