Wondering if Apple Silicon will bring arge amounts of unified main memory with h... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		MrBuddyCasino on June 23, 2022 \| parent \| context \| favorite \| on: YaLM-100B: Pretrained language model with 100B par... Wondering if Apple Silicon will bring arge amounts of unified main memory with high bandwidth to the masses? The Mac Studio maxes out at 128GB currently for around $5K, so 256GB isn't that far out and might work with the ~200GB Yandex says is required.

Havoc on June 23, 2022 [–]

Perhaps on quantity. Substantially slower though around ~3x from what I can tell…substantial roadblock if you’re training models that take weeks.

MrBuddyCasino on June 23, 2022 | [–]

I meant for inference, not training. People just want to run the magic genies locally and post funny AI content.

Havoc on June 23, 2022 | | [–]

ah right - gotcha

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact