Arc AGI: – Ryan gets 71% accuracy on a set of examples where humans get 85% | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		Arc AGI: – Ryan gets 71% accuracy on a set of examples where humans get 85% (twitter.com/bshlgrs)
		1 point by obiefernandez on June 17, 2024 \| hide \| past \| favorite \| 1 comment

lawlessone on June 17, 2024 [–]

How many shots did he give LLMs at solving each question?

If you do it enough times I am sure you would eventually get 100% on these tests. but if you only get 100% every 10,000 tries it's probably not AGI..

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact