It's a false dichotomy. You can have a good context engine and still benefit from being allowed to pick the model that works best for you. Aider is an example that has both.

IDEs would absolutely let users choose their preferred GC if a billion-dollar garbage collection algorithm space race were raging and a new challenger appeared every month.