You should not pay the performance hit for features you don't need in a particular program.
In fact: It is reasonable for C++ programs to NOT use all language features.