Your regular reminder that you don't need ollama to get a quick chat engine on the command line, you can just do this with pretty much any major model on huggingface:

pip install transformers

transformers chat Qwen/Qwen2.5-0.5B-Instruct