I think this discussion is silly in the context of a modern LLM. Nobody really understands how an LLM works, and you absolutely do not actually want to retrain Llama from scratch.
When I said "it's not really open source", I was referring to the fact that there are restrictions on who can use Llama.
Well that's a much deeper rabbit hole - we shouldn't be using such massive systems or throwing so many resources at them when no one even knows how they work.
When I said "it's not really open source", I was referring to the fact that there are restrictions on who can use Llama.