On your phone the GPS is just one input to determine its position. It's most likely also triangulating cell phone towers. Get an app that only shows GPS data and check if you see coordinates jumping around.