what are you trying to suggest? that they are doing to much already? and if they were to do less they would have time? wouldn't that then lead to the same situation, that they would like to work on some of the things they are working on now but could not because of lack of time?
also we don't choose all our commitments. family, work, friends, etc are commitments we can't just give up. it comes down to choice and priorities, and the problem is that we have more things we find interesting than we can focus on.
but i consider that a good thing. i know that whenever i retire or am unable to continue some of my interests there will be others that i can pick up instead. i know that i won't be bored...
Just a quick prompt for reflection. I do not suggest anything how people actually live their lives. But many have said that they got caught up in being too busy to actually enjoy life. Don't fall into that by accident!
GPU memory bandwidth is the limiting factor, not PCIe bandwidth.
The memory bandwidth is critical because the models rely on getting all the parameters from memory to do computation, and there is a low amount of computation per parameter, so memory tends to be the bottleneck.
Agreed, 12 GB does not seem useful. For coding LLM, it seems 128 GB is needed to be even close to the frontier models.
For generative image processing (not video), it looks like one can get started with 16GB.
The school shooter type seems to want to be present locally, to go out with a bang, and to do it somewhere they are connected to.
They are not aiming for maximal scalability nor chance to get away.
Of course, other threat actors might, like a Unabomber type or groups designed to destabilize society (perhaps foreign sponsored) by doing repeated actions etc.
You are helping the companies train better LLMs... Both by just paying for their expenses, but also they will use the training data.
That may or may not be something one considers a worthwhile contribution.
Certainly it is less valuable than helping a person grow their intellectual capacity.
War is not amusing. In this war several hundred thousands have been killed, over a million are injured for life, and many millions are terrorized by frequent random bombings of civilian targets.
For knowledge workers in western companies, 20 USD/month for ChatGPT style tool, seems like it is likely worth it for employers to front.
I think over time we will see this included in "standard office tools" like email/messaging/videoconf/documents. Which would make Microsoft and Google very well positioned.
But probably everyone will adopt it - so it may not give a competitive advantage to any given company.
reply