The cat's out of the bag now; see this article. It has become clear that:
ChatGPT is massively undertrained; and that you can in fact obtain better results with like 50% the amount of parameters, if not 25%.
Extracting valuable data from ChatGPT itself to train your own model is doable, has been done for less than 700 bucks, the files are out there now it's been done, and trying to keep it completely closed was never going to work.
Better models than GPT3 are available off the shelf now entirely self hosted and can be run on below-1k$ consumer computers.
Instructions say "download ggml-alpaca-7b-q4.bin", then there's no link
You need to request access
Or just see here
The cat's out of the bag now; see this article. It has become clear that:
ChatGPT is massively undertrained; and that you can in fact obtain better results with like 50% the amount of parameters, if not 25%.
Extracting valuable data from ChatGPT itself to train your own model is doable, has been done for less than 700 bucks, the files are out there now it's been done, and trying to keep it completely closed was never going to work.
Better models than GPT3 are available off the shelf now entirely self hosted and can be run on below-1k$ consumer computers.
Oh hell yeah, cloning that shit now