64GB of ram is 550b *bits* of ram. That doesn't give you a lot of options on how...

		Lerc on Aug 16, 2024 \| parent \| context \| favorite \| on: Hermes 3: The First Fine-Tuned Llama 3.1 405B Mode... 64GB of ram is 550b bits of ram. That doesn't give you a lot of options on how many bits you want to keep per model parameter.