Follow

For folks into , I'd suggest checking out continue.dev and their integrations with ollama and LM Studio.

I found that the best models have been WizardCoder 7B and OpenHermes 2.5. Make sure to offload execution to another box or limit the CPU threads for inference so you can keep some for your window manager.

· · Web · 0 · 0 · 0
Sign in to participate in the conversation
Mauvestodon

Escape ship from centralized social media run by Mauve.