Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
skyde
on Aug 3, 2024
|
parent
|
context
|
favorite
| on:
IsoFLOP curves of large language models are flat
But inside on epoch there is a lot of duplication already.
By duplication I mean if context length is N there is many sequence of N word that are not unique.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
By duplication I mean if context length is N there is many sequence of N word that are not unique.