I’d like to see if it’s possible to train a model entirely on the public code documentation itself, and see if it can figure it out purely with self-learning loops without stealing others work. it would be awful since it’s only initial references of real code would be extremely simple examples and some pseudocode, but a self learning model given a framework to test and check, could figure out how to put it together eventually… It would be complete crap and/or unusably slow with the current tech but perhaps it’s possible in the future with something other than llm. I guess you would have to say that while the model wasn’t trained on stolen code, it would probably require you to agree that all code generated on the model (unless it were self hosted) would serve as reference to the model for other users… so it only steals from itself.
absolutely.
I’d like to see if it’s possible to train a model entirely on the public code documentation itself, and see if it can figure it out purely with self-learning loops without stealing others work. it would be awful since it’s only initial references of real code would be extremely simple examples and some pseudocode, but a self learning model given a framework to test and check, could figure out how to put it together eventually… It would be complete crap and/or unusably slow with the current tech but perhaps it’s possible in the future with something other than llm. I guess you would have to say that while the model wasn’t trained on stolen code, it would probably require you to agree that all code generated on the model (unless it were self hosted) would serve as reference to the model for other users… so it only steals from itself.