If you feel like someone isn't pulling their weight at all and your manager ignores that, either you're completely mistaken, your manager is incompetent or your manager doesn't care. In either case, you'll likely not become happy there by just continuing.

You can try to change your approach to work and adjust your performance accordingly, or look for a different team or a different job. I'm not sure if adjusting yourself is possible or desirable (could you go back if you switch jobs, or would you become that person and drag down the next team you work at?), so looking to work elsewhere is probably to easiest route.