You are right about "LLM improving themselves" is impossible. In fact, LLM make themselves worse, it is called knowledge collapse [1].

[1] https://arxiv.org/abs/2404.03502