If one thread has to hit main memory but the other one can get what it needs from L1 cache they aren't competing for the same resources.