> 3) The entire history in the conversation disappearing after several minutes

Likely a natural consequence of using native voice mode. It is very probable that its context span is very short. Sesame for instance loses context after less than 20 minutes (not sure when exactly).