The chips are improving. They are adding dedicated AI co-processors/cores. Every major chip developer is moving towards providing functionality that supports running AI models locally on chip. Eventually all of these use cases will be run locally, fast, and power efficiently w/o network hops. Waiting until that happens to develop these features puts you ages behind everyone else. It's just another iteration of the thin-client to fat client product cycle, and for AI, it's very early.