The semester of my life that I coded everything in Common Lisp I was using vim to do it. Vim didn't make anything harder and some macros I had at the time and some extensions like vim-slime did everything I needed them to do just fine. Emacs has the whole "Emacs is also a Lisp" thing that gives it a lot of prominence as the editor/IDE of choice for most styles of Lisp, but some of that is just marketing.