Learnable parameters on activations *do* exist, look up parametric activation fu... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		beckhamc on Oct 4, 2024 \| parent \| context \| favorite \| on: Were RNNs all we needed? Learnable parameters on activations do exist, look up parametric activation functions.

quantadev on Oct 4, 2024 [–]

If course they do exist. A parameterized activation function is the most obvious thing to try in NN design, and has certainly been invented/studied by 1000s of researchers.

Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact