I have similar experience while reading any other material as well or while watching a TV show like Billions. However, I currently believe that is part of the value and not majorly a distraction. That exploration leads me to discover directions which the author has not taken, tie the story to my own experiences, think about it further and internalize what I have read if it is important.