It depends on the specifics, but in general if your settings are correct and the hardware isn't doing something whacky/buggy then it should be deterministic. The math itself is deterministic, the only randomness comes from temperature (intentional randomness introduced in software) and some bugginess with GPUs that weren't designed for this workload.