Just about the only think I use swap for on Linux, is not bombing out during the fork/exec (even for something like a system call) from large processes. Back when I last looked, it appeared they need enough backable virtual address space, even when they don't use it. The filesystem swap seems good enough for that.