Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

You can easily fix this using a grammar constraint with llama.cpp. Add this to the command: --grammar "root ::= [^一-鿿ぁ-ゟァ-ヿ가-힣]*"

This will ban Chinese characters from the sampling process. Works for Yi and Qwen models.



Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: