Locally, sure. Can you do it to a C++ binary deployed at a customer?

Of course you can. You can attach gdbserver to a running process on the remote machine and connect to it via your local gdb.

Edit: Plus, if there was a crash, you can generally get a coredump, so you can inspect the exact state the program was in, again, with GDB.