When I was reading the benchmarks and seeing how Gemini Ultra was outperforming GPT-4 I thought, "Finally, some competition for GPT4"!
But when I got to that part, that's when I realized that it could potentially be caught in release hell and not actually see the light of day or significant use. Google, for better or worse, has more of a brand reputation to maintain and is more risk averse, so even if Gemini Ultra can, in theory, outperform GPT4, users might not get a chance to access it for a while.
Absolutely I do. Internally they have some incredible stuff, but the leadership is terrified of letting normies try it out because of the (real or perceived I don't know) damage to the brand that would happen if it said something racist or misogynist, etc.
No way, that's what they want you to think. The idea that Google would be behind technologically would be an embarrassment they can't handle. The 3.5 level gemini pro is probably just as capable of saying racist or misogynist stuff so there's no reason why they're allowing that to be public while the "GPT-4 beating" Ultra is hidden if it's just because of that. More likely Ultra is just not as good as these benchmarks indicate and they still need some time to improve it.
Google can hardly put a picture of a white male on their website. They're so deep in the swamp of virtue signalling it's a miracle they haven't yet drowned.
When I was reading the benchmarks and seeing how Gemini Ultra was outperforming GPT-4 I thought, "Finally, some competition for GPT4"!
But when I got to that part, that's when I realized that it could potentially be caught in release hell and not actually see the light of day or significant use. Google, for better or worse, has more of a brand reputation to maintain and is more risk averse, so even if Gemini Ultra can, in theory, outperform GPT4, users might not get a chance to access it for a while.