This is research, trying to understand the fundamentals of how these models work... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		numeri on March 28, 2024 \| parent \| context \| favorite \| on: LLMs use a surprisingly simple mechanism to retrie... This is research, trying to understand the fundamentals of how these models work. They weren't actually trying to find out where Bill Bradley went to university.

leobg on March 28, 2024 [–]

Of course. But weren’t they trying to find out whether or not that fact was represented in the model’s parameters?

wnoise on March 28, 2024 | [–]

No, they were trying to figure out if they had isolated where facts like that were represented.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact