I find it works fine with 6 and 4. You just need to modify the rules so that the captain can’t rapidly make moves on their own. Needing a second person to affirm their decision is critical. Otherwise they’ll inevitably focus on one task too much.