Use it after downscaling not before.

If you have a good downscaling tool it will create a larger number of intermediate colors when you downscale and you'll actually end up with a larger image!