Fractions are nice when the numerator is always 1. They're a pain when it isn't; sorting drill bits or buying material from McMaster Carr, you constantly have to sort out whether 17/64 is larger or smaller than 3/8, and by how much, and it becomes quite burdensome.
It's not immediate like it would be with decimals, but ⅜ -> 6/16 -> 12/32 -> 24/64 is still something I find I can do (and track) in my head with ease. Yeah, doing it repeatedly on a task would get a little tiresome. Also, who knows where the numbered and lettered series drill bits fit in without a chart.
The fractional system isn't perfect for all use cases by any means. (My understanding is that a lot of machining just deals with decimal inches directly.) I just find it convenient for many everyday tasks. I'm also weird, I guess, in that arithmetic on fractions feels easier than on decimals.
Thinking more about my original statement, a lot of it has to do with halving (e.g. finding a center) being a common operation for many tasks. It also helps that most things are sold in those fractional increments too :)