I have 128GB, but something is weird with Ollama. Even though for the Ollama Doc... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		XCSme on March 27, 2024 \| parent \| context \| favorite \| on: DBRX: A new open LLM I have 128GB, but something is weird with Ollama. Even though for the Ollama Docker I only allow 90GB, it ends up using 128GB/128GB, so the system because very slow (mouse freezes).

InitEnabler on March 27, 2024 [–]

What docker flags are you running?

XCSme on March 27, 2024 | [–]

None? The default ones from their docs.

The Docker also shows minimal usage for the ollama server which is also strange.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact