While the serotonin used in your gut doesn’t directly impact the brain, it does impact the enteric nervous system which communicates via the vagus nerve to your brain. So I don’t think it’s correct to say this doesn’t (or couldn’t) impact your mood (and indeed murine experiments demonstrate it does).