really fun :) thanks!

it sounds like you described it pretty well!

~/.claude/projects is where the real fun is :)

What is your domain?

so we need to make some crazy llms...

there used to be https://default-filename-tv.neocities.org/ but it got taken down :/

The bitter lesson strikes again, I suppose!

Good questions! It's clear I need to gather more metrics from our next generated inference library.

Unfortunately it hasn't been open sourced. We're debating how / when to do this right now.

Confusing, since this is specific to an architecture that no one making money will use (8B is consumer space, not enterprise). The produced code shouldn't hold much interesting IP?

Yes, great question!

The system started without paged attention, and recreated its own paged attention implementation automatically once it realized it was a bottleneck.

Pretty cool!