Where do people draw the line? Where they want to.
Some people choose to go closer to the metal than the others. It's just people's choice.
Some just write stuff in Python, some write CUDA kernel for themselves (some among them had to), a friend even wrote his own compiler and programming language for Deep Learning.
So it depends on your choice. And how much deep you want to go also depends on what you want to do- i.e. you choice of career, direction of research, etc.
Maybe I misread your comment.
Thanks for rewording.
Where do people draw the line? Where they want to.
Some people choose to go closer to the metal than the others. It's just people's choice.
Some just write stuff in Python, some write CUDA kernel for themselves (some among them had to), a friend even wrote his own compiler and programming language for Deep Learning.
So it depends on your choice. And how much deep you want to go also depends on what you want to do- i.e. you choice of career, direction of research, etc.