Chosen expert (on each layer) depends on the input of previous layer. Not sure h... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

boroboro4 on April 6, 2025 | parent | context | favorite | on: The Llama 4 herd

Chosen expert (on each layer) depends on the input of previous layer. Not sure how you can preload the experts before forward pass.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact