no its true. ChatGPT is confidently wrong all the time, but I find its wrong in ways I can learn from anyway. I ask the question. it gets the answer wrong. But its wrong in a useful way where I actually learn more by correcting it than just getting the right answer.
I could get the same experience from talking to a person for much less money though
It’s too verbose, I find (system prompt and user setting be damned). Claude’s generally more to the point.
I still prefer to self host, and am in the process of setting up my entire system to run off solar (tiny 2x250 watt solar array, 3 deep cycle marine batteries and sundry equipment).
End to end, my AI rig - a BC-250 (a cut down PS5, basically) consumes 50w standby / 200w on inference and can run Qwen 3.6-27b (on par with Sonnet 4.5 on the AAII) at good speeds.
With a smart power plug and Raspberry pi (2w) as the pilot fish, I can run my entire system “off grid”, with about 7 days battery back up.
For $1500 AUD, “Poor man’s Sonnet 4.5 at home” ain’t nothing to sneeze at.
They tend to work much better when you point them at things. Hallucination rates go way, way down when they aren’t pulling from their “memory.” They are, also, like you say, wrong in ways that are noticeable and often “interesting” in the Ibsen way. I also doubt that you could get the same experience for less money. I’d have to go back to college to get the education I’m getting with AI. At least community college. It’s a lot of near-experts at once. And when you point it at expert literature it basically is a senile college professor. But yeah the senile part of that statement is pretty important.
no its true. ChatGPT is confidently wrong all the time, but I find its wrong in ways I can learn from anyway. I ask the question. it gets the answer wrong. But its wrong in a useful way where I actually learn more by correcting it than just getting the right answer.
I could get the same experience from talking to a person for much less money though
It’s too verbose, I find (system prompt and user setting be damned). Claude’s generally more to the point.
I still prefer to self host, and am in the process of setting up my entire system to run off solar (tiny 2x250 watt solar array, 3 deep cycle marine batteries and sundry equipment).
End to end, my AI rig - a BC-250 (a cut down PS5, basically) consumes 50w standby / 200w on inference and can run Qwen 3.6-27b (on par with Sonnet 4.5 on the AAII) at good speeds.
With a smart power plug and Raspberry pi (2w) as the pilot fish, I can run my entire system “off grid”, with about 7 days battery back up.
For $1500 AUD, “Poor man’s Sonnet 4.5 at home” ain’t nothing to sneeze at.
They tend to work much better when you point them at things. Hallucination rates go way, way down when they aren’t pulling from their “memory.” They are, also, like you say, wrong in ways that are noticeable and often “interesting” in the Ibsen way. I also doubt that you could get the same experience for less money. I’d have to go back to college to get the education I’m getting with AI. At least community college. It’s a lot of near-experts at once. And when you point it at expert literature it basically is a senile college professor. But yeah the senile part of that statement is pretty important.