It's less effective at the OS wide level because the context is incredibly important. Notepad is used very differently from word processing and other applications. Even in the context of notepad- you're using that app very differently when working in python vs a readme.

AI is best integrated at the application level because the application developers are best suited to tune the algorithm and determine which pieces of context are most relevant.