It's impossible to say of course. But I think at the least we would have led more conventional lives.

For myself, maybe a darker outcome. I was struggling with peer pressure and getting into trouble. The family that owned our house before lost their daughter to overdose. She went to my school. I wonder sometimes how my life could have been had things been slightly different and we hadn't changed to homeschooling (after grade 6 for me, 3 for my brother.)

I suspect it would depend a lot on whether you were allowed to accelerate academically, and the answer would likely have been "no" or "not much". You might take a look at the following study, and see if it rings true to the school you did experience, or to what you've heard from others you've met:

"The considerable majority of [the subjects: young people with 160+ IQs in Australia] who have [skipped 2 or more grades in K-12] report high degrees of life satisfaction, have taken research degrees at leading universities, have professional careers, and report facilitative social and love relationships. Young people of equal abilities who accelerated by only 1 year or who have not been permitted acceleration have tended to enter less academically rigorous college courses, report lower levels of life satisfaction, and in many cases, experience significant difficulties with socialization. Several did not graduate from college or high school." https://files.eric.ed.gov/fulltext/EJ746290.pdf

I don't know if you're at the 160+ level, but SAT scores are something of a proxy for IQ, and the severity of the social and academic frustration due to mismatch with age-peers can be judged directly.

I am above average intelligence, but not 160 level. My hope when we started homeschooling was to complete the grades faster, but it was still school and didn't hold my interest enough for that. I ended up finishing later than normal, mostly because I got side tracked with my newfound passion for computer programming. I took two years before college to explore that, and went to college reluctantly. When I got there I soon realized I had gaps in my knowledge, but generally was ahead of the 4th year students assisting the professors. I didn't want to spend 4 years and a great deal of money pursuing just a piece of paper, and dropped out.

Community colleges can offer an alternative option, even in smaller suburban and semi-rural areas.

I hated high-school, but I took classes at the local community college every night, my high school accepted the credits, and I graduated high school a year-early with transferrable college credits.

My night-school experience gave me an opportunity to push my brain as far as I wanted, and it showed me what the 'real world' was like since my classmates were in their thirties, as opposed to the 'high-school world,' or whatever my eccentric parents would have cooked up.

The SATs have a ceiling well below four standard deviations above the mean. I’m skeptical that any test is properly calibrated at that level—-even with oversampling it’s very difficult to do properly.

Many IQ older IQ tests doesn't use 15 points per SD, so when you hear people talk about enormous IQ's like 160 it almost surely doesn't use a modern scale.

And in the past four years it has become government policy.