Weight changes in one neuron can have dramatic and non linear or obviously predictable impact on the performance of a full model.