Thanks! Oh I did release 4bit quants, 5bit, 6bit etc all at https://huggingface....

		danielhanchen 6 months ago \| parent \| context \| favorite \| on: Run DeepSeek R1 Dynamic 1.58-bit Thanks! Oh I did release 4bit quants, 5bit, 6bit etc all at https://huggingface.co/unsloth/DeepSeek-R1-GGUF if that helps - they're not dynamic though but it should function fine :)