A good follow on from this is the Learning OpenCV book (O'Reilly), written by a couple of the lead developers. It goes into detail on the mathematics, but it's not heavy or verbose at all. I found it far more useful than a lot of introductory image processing books simply for its theoretical content.

Don't forget scikit-image and scipy.ndimage too.