Anyone know what the story is for running LLMs on apple hardware but using asahi... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

xrd 7 months ago | parent | context | favorite | on: Asahi Linux with Sway on the MacBook Air M2 (2024)

Anyone know what the story is for running LLMs on apple hardware but using asahi?

tarruda 7 months ago [–]

AFAIK MPS cannot be used on Asahi, so it has to be done using Vulkan which will definitely be much slower.

Consider applying for YC's Fall 2026 batch! Applications are open till July 27.
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact