Water is "actually" blue, as in due to the chemistry of its electronic configuration. A deep column of water has a blue color in a way that other liquids, such as benzene, do not. There was a cool picture of this demonstration in one of my old chemistry books.
Reflection of the sky accounts for much of the color of natural bodies of water, but it's cool to know that it's blue even in the absence of blue reflection.