It depends on if you're trying to minimize damage to your car, or the passengers. For a light impact where you aren't going to sustain any injuries it might be optimal to let off the brake. But if the accelerations are going to cause injury, then you would want to apply the brakes to minimize the acceleration of the car.