A major portion of the problem is that schools aren't just about educating children; they're also about warehousing them as public daycare for workers. The hours matter for that.

If they hours didn't then it would be possible to have home-study for some time of the day and do all the bus transport mid 'school' day at various times for a massive reduction in resources.