I think most of my trouble is highlighting the part I want copied. Can't remember, and I now do most of my work in emacs. Such that I am now used to all of my editor buffer being treated the same.
I use emacs as well, but apple touchpads are good enough that frankly it's probably faster for me to just highlight text in iterm2 with the mouse (which is what I do). In emacs I use the standard C-spc shortcuts, though.
None of my work is particularly terminal-heavy, thankfully.
I suspect that I probably just notice the times in the terminal that it is hard for me. I also use a rollermouse. Which, I love, but I have found I am nowhere near as accurate with it as I probably should be.