Throughout most of human history "taking" meant that the thing is now yours and not theirs. If you had a book, I read it all and wrote my own copy, nobody would call that taking your book, it's copying your book. You can try to change the definition, but depriving something of ownership/use of something is qualitatively very different from making a copy of it, so it doesn't follow that the former should necessarily be treated the same as the latter.
Information has to be modelled differently. Where and how it is manifested is less relevant.
If I told your secrets after we agreed not to share them, it would be a moral violation, even if you still had the copy of the journal that you recorded the secrets in.
