Training tends to require a lot more precision and hence memory than inference. I bet many of the tricks here won't work well for training.