51·
2 years agoI use koboldcpp with the vicuna model. Reasonably fast generation (<1 minute) on a 4th gen i7, would probably be on par with chatgpt in terms of speed if you used a GPU.
- 0 Posts
- 2 Comments
Joined 2 years ago
Cake day: June 8th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Searxng is a meta search engine, how is that relevant to a large language model?