I’d take a model whose training data is open source and legitimately obtained. The only ones I know about are Apertus and OLMo, and they aren’t really competitive.
Unfortunately not yet, no, true FOSS models are likely many years away, but I would argue that that follows typical FOSS lifecycles. Emerging technology is typically outperformed by proprietary endeavors, which creates an audience, and then that audience undertakes a FOSS implementation that initially underperforms, then just about competes, then eventually overtakes (i.e, GNU/Linux).
Interesting point… In this case, I have a hunch that the requirements in terms of training data and hardware to run the training on would remain prohibitive, but I do wonder how much could be actually achieved using a distributed scheme of sorts.
I’d take a model whose training data is open source and legitimately obtained. The only ones I know about are Apertus and OLMo, and they aren’t really competitive.
Unfortunately not yet, no, true FOSS models are likely many years away, but I would argue that that follows typical FOSS lifecycles. Emerging technology is typically outperformed by proprietary endeavors, which creates an audience, and then that audience undertakes a FOSS implementation that initially underperforms, then just about competes, then eventually overtakes (i.e, GNU/Linux).
Interesting point… In this case, I have a hunch that the requirements in terms of training data and hardware to run the training on would remain prohibitive, but I do wonder how much could be actually achieved using a distributed scheme of sorts.