Updated command for clarity (might want to fullscreen your terminal with this):
$ DISPLAY= mplayer tv:// -tv driver=v4l2:width=640:height=480:device=/dev/video0 -fps 15 -vo caca
This also seems to work over ssh, though, which is cool.
Updated command for clarity (might want to fullscreen your terminal with this):