Tried getting https://aider.chat/ to generate a commit message using gemma2:2b and it was grossly verbose with loads of useless text.
Might be worth it to try different models to see which ones suck the least.
Follow
Hermes3:8b my beloved managed to actually generate a single calculator app and apply a basic update. 🤪 Sadly I have to choose between it and running 1 web app (element.io) or vscode due to only having 12 GB of ram. 😰
@fleeky Neat, it's less about distributing the load and more about connecting to inference servers. :o Cool use of p2p tho
@mauve this looks kind of interesting :
https://github.com/twinnydotdev/symmetry-cli
p2p compute sharing for ai inference using hyperswarm ?