There are some very preliminary benchmarks on a very small model here: https://github.com/apple/tensorflow_macos/issues/10

It doesn't really prove much beyond that you can probably get enough speed on an M1 to debug your training loop. That's impressive but we need to see more to see if the "only 4x slower than a colab GPU (ie at least a K80)" numbers hold up.