> Modern BERT with the extended context has solved natural language web search. ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

jampekka on April 12, 2025 | parent | context | favorite | on: Google is winning on every AI front

> Modern BERT with the extended context has solved natural language web search.

I doubt this. Embedding models are no panacea even with a lot simpler retrieval tasks like RAG.

noosphr on April 13, 2025 [–]

RAG is literally what Google Search is.

Unlike the natural language queries that RAG has to deal with, Google searches are (usually) atomic ideas and encoder-only models have a much easier time with them.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact