Having tested a bunch of projects, I gotta say that OpenHermes 2.5 is the most helpful out of the ones I can run locally.

I recently wasted a bunch of time getting Phi-2 to do some summarization work, and it just couldn't stay focused for more than a sentence or two.

@mauve there are also quantized versions of the French project Mixtral that can run locally

Follow

@laskov Oh yeah, I read their release but haven't used it yet. Was there anything specific they excelled at?

Sign in to participate in the conversation
Mauvestodon

Escape ship from centralized social media run by Mauve.