I've been looking for a course like this! Especially great given how much of the recent progress in training large models is made possible with the aid of flash attention and fused kernels

Compilation is a horrible word for it. Especially when what it refers to is basically productizing / user-friendli(er) packaging.

It certainly also involves generating code(e.g. WebGPU, vulkan) that are more akin to traditionally compiler, and more like graph and memory optimization. So indeed more than packaging.

Please checkout the course if you are interested

Si

Todo