If it’s what you desire, then yes, you should quit.

I’ve done it before and it’s a great experience. 100% worth it. Follow your dreams.

Just don’t delude yourself into thinking you will grow your side project into a full time income. You may. But don’t count on it.