I agree and this is actually a common problem in philosophical discussions. People struggle to differentiate between two kinds of objectivity: the "total" objectivity of knowledge that is completely context-free and unstructured, and the objective modulo a given set of assumptions (e.g., "the human brain", or at least, the human way of structuring and understanding reality). Mathematical truths are objective with respect to the latter kind of objectivity, but not the former.