The 70b distill at 4bit quantize fits, so yes, and performance and quality seem ... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

api 89 days ago | parent | context | favorite | on: OpenAI says it has evidence DeepSeek used its mode...

The 70b distill at 4bit quantize fits, so yes, and performance and quality seem pretty good. I can't run the gigantic one.

azinman2 88 days ago [–]

Ok but that’s not deepseek-r1. Lots of people keep saying this for distills and it’s getting very confusing.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact