Go into the main extension settings of 'Firefox Multi-Account Containers' that lists your containers and click on 'Manage containers'. Select any container and the last option on the new page is 'Advanced Proxy Settings'. This setting is per container.