I find that it is specifically the 'net' tab in Firebug that causes the problem. If you have it enabled it will cause your browser memory to balloon since it is keeping track of everything the browser downloaded.