This post by @maggie has some great ideas on how #LLM tech can help enable #LocalFirst applications for regular folks. I've been wanting to do something similar within @agregore some day with local LLMs helping people author p2p web apps.
@mauve
I've yet to get a better response from a local LLM to a code question than I get from a web search or going to StackExchange etc. Are you finding good uses yet?
I confess I haven't tried too hard, but then most people won't and that's the point really anyway. 🤷♂️
I expect they should be good for accessibility, such as speech in/out but an not seeing those apps. Why not?! 🤦♂️
Although I see Mozilla have put a local LLM in Firefox to generate alt text for images.
@happyborg I've been using it with https://continue.dev as a local copilot. I mostly use it for doing basic refactoring or looking up syntax. I think search in general is getting worse and with local models you get the chance to do it all offline. I specifically care about having a fine tuned model people can have within their browser to let them make p2p apps fully offline and on mesh networks.
