You'll probably want to avoid outputting the sound on the TV or you'll get a feedback loop.
And there's going to be a slight delay, which might be annoying with a realtime conversation.
So it might not be a great idea from the start.