>there was a desire to move towards byte level work rather than tokens

Yeah, latest work on this is from Meta a last month.[0] It showed good results.

[0] https://ai.meta.com/research/publications/byte-latent-transf... (https://news.ycombinator.com/item?id=42415122)