It’s too verbose, I find (system prompt and user setting be damned). Claude’s generally more to the point.
I still prefer to self host, and am in the process of setting up my entire system to run off solar (tiny 2x250 watt solar array, 3 deep cycle marine batteries and sundry equipment).
End to end, my AI rig - a BC-250 (a cut down PS5, basically) consumes 50w standby / 200w on inference and can run Qwen 3.6-27b (on par with Sonnet 4.5 on the AAII) at good speeds.
With a smart power plug and Raspberry pi (2w) as the pilot fish, I can run my entire system “off grid”, with about 7 days battery back up.
For $1500 AUD, “Poor man’s Sonnet 4.5 at home” ain’t nothing to sneeze at.
It’s too verbose, I find (system prompt and user setting be damned). Claude’s generally more to the point.
I still prefer to self host, and am in the process of setting up my entire system to run off solar (tiny 2x250 watt solar array, 3 deep cycle marine batteries and sundry equipment).
End to end, my AI rig - a BC-250 (a cut down PS5, basically) consumes 50w standby / 200w on inference and can run Qwen 3.6-27b (on par with Sonnet 4.5 on the AAII) at good speeds.
With a smart power plug and Raspberry pi (2w) as the pilot fish, I can run my entire system “off grid”, with about 7 days battery back up.
For $1500 AUD, “Poor man’s Sonnet 4.5 at home” ain’t nothing to sneeze at.