Tried getting aider.chat/ to generate a commit message using gemma2:2b and it was grossly verbose with loads of useless text.

Might be worth it to try different models to see which ones suck the least.

Hermes3:8b my beloved managed to actually generate a single calculator app and apply a basic update. 🤪 Sadly I have to choose between it and running 1 web app (element.io) or vscode due to only having 12 GB of ram. 😰

@mauve this looks kind of interesting :
github.com/twinnydotdev/symmet
p2p compute sharing for ai inference using hyperswarm ?

Follow

@fleeky Neat, it's less about distributing the load and more about connecting to inference servers. :o Cool use of p2p tho

Sign in to participate in the conversation
Mauvestodon

Escape ship from centralized social media run by Mauve.