You can (and someone will) fine tune it away. There are datasets which are foss ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		FergusArgyll on Feb 21, 2024 \| parent \| context \| favorite \| on: Gemma: New Open Models You can (and someone will) fine tune it away. There are datasets which are foss you can use on hugging face. Or you can just wait, it'll be done soon...

declaredapple on Feb 21, 2024 | [–]

You can but it'll never be the same as the base model.

That said it appears they also released the base checkpoints that aren't fine-tuned for alignment

joshelgar on Feb 21, 2024 | [–]

Could you give an example of these datasets?

FergusArgyll on Feb 21, 2024 | [–]

I think they should be easy to find (I never actually used one, but I keep on seeing references...) here's one

https://huggingface.co/datasets/cognitivecomputations/Wizard...

FergusArgyll on Feb 21, 2024 | | [–]

https://huggingface.co/datasets/Fredithefish/openassistant-g...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact