I suggest teaching them about the Problem of Induction [1].

Scientific thinking is not the same as mathematical thinking and it becomes quite wishy washy grey if you zoom in too far!

[1] https://plato.stanford.edu/entries/induction-problem/