The tradeoff is security and privacy. Important things. If you click the eye icon next to a password, or paste a secret to an env var you are now exploitable. If you have something you want to keep private or shred this is another place to delete (or forget to do so). So there are plenty of anti-benefits to this superpower.
People already have traded privacy and a comprehensive personality profile for silly streams of video, photos and text on social media for the past 20 years. Imagine what happens, when you get something immensely useful out of it.
Today, nobody will work with you, if you are unable to manage E-Mail. In the future, nobody will work with you, if you can't properly use the time information dimension that this technology enables. You will simply look demented by comparison.
