I'm not sure that the game would work without this restriction. If you kept grip of the ball regardless of if your finger was on the path none of the game's puzzles would work since you could just move your fingers wherever you wanted without losing the ball.