Why should a company do affirmative action based on race? Isn't that kind of racist?

I hope we go back to the days where an individuals merits had more to say in a recruitment process than their skin color.