Whenever I come across posts like this, I need to remind myself that it's actually a very small minority of people online who feel this way. Most people are perfectly happy with how the internet is right now and don't care for going back to things you used to do online a decade or two ago.
On social media: today it's no longer even about ordinary individuals sharing their ordinary lives online like they used to 15 years ago. It's about consuming content around your interests (which includes entertainment). Very few people on my instagram make personal posts anymore (myself included) and when they do, they're few and far in between. It's all brands and content creators. I also think people's mentality has shifted and they no longer care about sharing their lives online. It was a new concept to many between 2006-2014 to be able to do it, and so many did. Now they're past it. It was interesting in 2008 to see that Johnny is currently sipping on a latte in front of his window. Now nobody gives a fuck unless Johnny is a celebrity.
On scrolling TikTok-like feeds: not to glorify the concept but it makes it easier for the anti-social-medias to accept if you think of it as the equivalent of when your parents would get home, turn on the TV and start flipping through the channels trying to find something interesting to watch. TikTok and Reels put the TV in your pocket. 80% of the content on them is of no substance but occasionally a valuable post does come up and provide me with something I need/enjoy. The other day, I had a spontaneous date night because a reel showed up for my wife about some food truck nearby and she shared it with me (we went there an hour later and it turned out to be a good one - we're going again next week). P.S. it didn't even cross my mind to bother posting a snap of my meal as a story on IG :)
> I also think people's mentality has shifted and they no longer care about sharing their lives online.
I tend to disagree. I have a few hundred friends/people I follow on Instagram and I see people post stories and posts about their life all the time. People are generally trying to portray "Look at me! I have such a cool life!". This is how it is for young people.
As for TikTok, I find myself scrolling with no end in sight. I think the studies on the addiction level of shortform content and its long term effects is going to be extremely shocking.
I can watch an episode or two of a show, maybe 30m-1hr, and turn it off. But TikTok keeps me constantly stimulated and I can easily forget what I am watching and "doomscroll" for hours. With TV I make the conscious decision to watch it. With TikTok I have to make the conscious decision to not watch it or open the app. This may be a side effect of how my brain works, but a lot of young people have similar experiences.
I think the main difference in our experiences is a generational gap in how social media is used.
But why wouldn't the solution with TikTok just be to delete your account and the app? I am young like you and that works perfectly fine for me.
If friends want to share videos/tiktoks with me, they download them and then send them with another messaging app so I don't have to go to the platform. And that's not something I force on them but something they do because they really want me to see those videos I suppose.
And what is the content people scroll to? And how does one become a celebrity in the first place on IG or TikTok? And what teens do all day long? Yep, sharing their live.
I share your experience, but for me it is just the one of a millennial getting older.
What I wonder is how did Kobe know this was a sign that he was done. Why didn't he think he was just burned out and maybe just needed a break before returning to the game? How can you tell when you're burned out vs. just being completely done with it all?
I think because he was already 37 or 38 at that time, and was suffering from injuries, too. There was no point continuing if both his body and mind are not the way they used to be.
I think most devs can delay burnout/leaving the field if they begin viewing programming as a means to an end, e.g. "programming as a way to build their own business," or "using programming knowledge to mentor others," or "using programming knowledge in another domain they're interested in to great effect."
IIRC, GPT-4 would actually be a bit _smaller_ to visualize than GPT3. Details are not public, but from the leaks GPT-4 (at least, some by-now old version of it) was a mixture of expert, with every model having around 110B parameters [1]. So, while the total number of parameters is bigger than GPT-3 (1800B vs. 175B), it is "just" 16 copies of a smaller (110B) parameters model. So if you wanted to visualize it in any meaningful way, the plot wouldn't grow bigger - or it would, if you included all different experts, but they are just copies of the same architecture with different parameters, which is not all that useful for visualization purposes.
Mixture of Experts is not just 16 copies of a network, it's a single network where for the feed forward layers the tokens are routed to different experts, but the attention layers are still shared. Also there are interesting choices around how the routing works and I believe the exact details of what OpenAI is doing are not public.
In fact I believe someone making a visualization of that would dispell a ton of myths around what are MoEs and how they work
On social media: today it's no longer even about ordinary individuals sharing their ordinary lives online like they used to 15 years ago. It's about consuming content around your interests (which includes entertainment). Very few people on my instagram make personal posts anymore (myself included) and when they do, they're few and far in between. It's all brands and content creators. I also think people's mentality has shifted and they no longer care about sharing their lives online. It was a new concept to many between 2006-2014 to be able to do it, and so many did. Now they're past it. It was interesting in 2008 to see that Johnny is currently sipping on a latte in front of his window. Now nobody gives a fuck unless Johnny is a celebrity.
On scrolling TikTok-like feeds: not to glorify the concept but it makes it easier for the anti-social-medias to accept if you think of it as the equivalent of when your parents would get home, turn on the TV and start flipping through the channels trying to find something interesting to watch. TikTok and Reels put the TV in your pocket. 80% of the content on them is of no substance but occasionally a valuable post does come up and provide me with something I need/enjoy. The other day, I had a spontaneous date night because a reel showed up for my wife about some food truck nearby and she shared it with me (we went there an hour later and it turned out to be a good one - we're going again next week). P.S. it didn't even cross my mind to bother posting a snap of my meal as a story on IG :)